2024-06-05: Conform app to new AI Chat Protocol
The big change in the latest release is that the app now confirms to the official Microsoft AI Chat Protocol, documented here:
https://github.com/microsoft/ai-chat-protocol/tree/main/spec#readme
There is also a JS SDK for that protocol that we will adopt soon to simplify our frontend parsing code.
You can see the pull request for more details, but basically:
- Instead of sending "stream": True to get a streaming response, we send to a different path, "/chat/stream".
- Instead of passing down the full choices list from the OpenAI response, we pass down only the first choice, specifically it's message or delta.
We have also updated the evaluator tool to work with either the new version of the backend protocol or the old, configurable via JMESPath expressions in the config JSON.
This change also includes a revamp of the Developer Settings to include tooltips, to try and make it more clear what each setting does.
What's Changed
- Bump the python-requirements group with 26 updates by @dependabot in #1673
- Update deploy_features.md by @hadirgax in #1689
- Add clickable help icons for developer settings by @pamelafox in #1522
- Upgrade to latest version of AI Chat Protocol by @pamelafox in #1682
New Contributors
Full Changelog: 2024-06-03b...2024-06-05