Skip to content

2024-06-05: Conform app to new AI Chat Protocol

Compare
Choose a tag to compare
@pamelafox pamelafox released this 05 Jun 18:25
· 297 commits to main since this release
dd7c1d2

The big change in the latest release is that the app now confirms to the official Microsoft AI Chat Protocol, documented here:
https://github.com/microsoft/ai-chat-protocol/tree/main/spec#readme
There is also a JS SDK for that protocol that we will adopt soon to simplify our frontend parsing code.
You can see the pull request for more details, but basically:

  • Instead of sending "stream": True to get a streaming response, we send to a different path, "/chat/stream".
  • Instead of passing down the full choices list from the OpenAI response, we pass down only the first choice, specifically it's message or delta.

We have also updated the evaluator tool to work with either the new version of the backend protocol or the old, configurable via JMESPath expressions in the config JSON.

This change also includes a revamp of the Developer Settings to include tooltips, to try and make it more clear what each setting does.

What's Changed

New Contributors

Full Changelog: 2024-06-03b...2024-06-05