You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This PR was squashed before being merged into the main branch.
Discussion
----------
[Platform] Replace untyped stream chunks with semantic DeltaInterface deltas
| Q | A
| ------------- | ---
| Bug fix? | yes
| New feature? | yes <!-- please update src/**/CHANGELOG.md files -->
| Docs? | yes/no <!-- required for new features -->
| Issues | n/a
| License | MIT
This PR introduces semantic streaming event objects so that one can react to specific LLM events without parsing the raw JSON. Think of this PR as being a first step towards full streaming support ;)
Commits
-------
232275d [Platform] Replace untyped stream chunks with semantic DeltaInterface deltas
Copy file name to clipboardExpand all lines: UPGRADE.md
+70-1Lines changed: 70 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,6 +27,12 @@ Agent
27
27
```
28
28
29
29
* The `SimilaritySearch` tool now accepts an optional `$promptTemplate` parameter to customize the result header (default: `'Found documents with the following information:'`)
30
+
*`Toolbox\StreamListener::onChunk()` has been renamed to `onDelta()`.
31
+
The listener now checks `$delta instanceof TextDelta` instead of
32
+
`is_string($chunk)` to accumulate the assistant text buffer.
33
+
* The `StreamListener` now reacts to `ToolCallComplete` instead of
34
+
`ToolCallResult`. If you have a custom `StreamListener` or check for
35
+
`ToolCallResult` in stream consumers, update to `ToolCallComplete`.
30
36
31
37
Mate
32
38
----
@@ -42,13 +48,76 @@ AI Bundle
42
48
* The `endpoint` option for `Ollama` is now `null` by default to allow the usage of a `ScopingHttpClient`
43
49
44
50
Platform
45
-
-----
51
+
--------
46
52
47
53
*`ModelCatalog` in `Ollama` has been replaced by `OllamaApiCatalog`
48
54
*`OllamaApiCatalog` in `Ollama` has been replaced to `ModelCatalog`
49
55
*`Ollama` model is now `final`
50
56
*`ModelCatalog` in `ElevenLabs` has been replaced by `ElevenLabsApiCatalog`
51
57
*`ElevenLabsApiCatalog` in `ElevenLabs` has been replaced to `ModelCatalog`
58
+
*`ChunkEvent` has been replaced by `DeltaEvent`. The `onChunk(ChunkEvent)` method
59
+
on `ListenerInterface` is now `onDelta(DeltaEvent)`. Update all implementations:
0 commit comments