Conversation
🧪 AI Answers Review Environmenthttps://dmtqwcv4hsag7dccwy3wb6fd7u0hgzkq.lambda-url.ca-central-1.on.aws/ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary | Résumé
Finished first model upgrade, now need to rationalize all the menus etc.
PROBLEM PROMPT: how to rationalize, across the entire app, how, when we upgrade to a new
model, do we change the default graph to the new model? In Settings - I've
now switched to GPT5one - we need a way now and in the future to push the old model to the bottom
of the list (no longer labelled default) and the new to the default status. That said, this
worked well during the process of testing the new model, in the live chat and in batches. 3 weeks
ago I set the default for staging/cdssandbox in settings to GPT5one - then a week ago I flipped
the settings for prod. And who knows, it's possible we'd have to flip back some day. In the
meantime though, we need a rational process for the change. Also the workflow in Settings
overrules the one for live chat from admin with options - notice how in the final screenshot it
looks as if it is using defaultGraph of 4.1 but when I run a chat, the logs show it's using 5.1.
So basically, this approach is now broken and needs a refactor. Note this is our first model
upgrade (from 4.1 to 5.1) so that's why we're identifying all these issues and need a better
procesS. Come up with a plan with some options - and check how other modern AI apps (haha that
means 2026 I guess!) do this.
Phase 1 — model.default Setting:
input
Phase 2 — GPT5 graph removal:*
Phase 3 — Single source of truth:
After deploy, set workflow.default=DefaultGraph and model.default=openai-gpt51 in Settings. Next
model upgrade: just add to config/workflows.js and flip Settings.
Test instructions | Instructions pour tester la modification