Claude 4 Models Self-Identify as Claude 3.5 Despite Actual Usage #7088
Closed
MarceloRicF
started this conversation in
Models + Providers
Replies: 1 comment
-
@MarceloRicF You generally can't trust a model to answer correctly when you ask what model it is. Based on the Claude Opus 4.1 System Card Addendum, it looks like that model was trained on public Internet data as of March 2025. This is prior to the existence of Claude 4 models, so there will be little to no data about it, while there will be a lot of data on Claude 3 models. You can try this out yourself by directly querying the API:
You will a similar response to the one you got through Continue:
If you try this multiple times, you will see that it gives varying responses each time. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Before submitting your bug report
Relevant environment info
Description
Claude 4 models configured in Continue.dev respond with self-identification as "Claude 3.5 Sonnet" when asked directly, creating user confusion about which model is actually being used. Despite this misidentification, usage data confirms actual Claude 4 token consumption and performance.
To reproduce
Expected: Model should correctly identify as Claude 4.1 Opus Actual: Model claims to be Claude 3.5 Sonnet despite being Claude 4
Log output
Beta Was this translation helpful? Give feedback.
All reactions