Configure per-configuration temperature

[joemanley201]

Description

• Add ability to set temperatures for models at the configuration level
• Add tests
• Move some magic numbers to constants and reuse them

Screen.Recording.2025-02-09.at.8.21.55.PM.mov

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested?

• Locally
• Automated tests

Checklist:

• My code follows the patterns of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation

Additional context

Related Issues

Reviewers

---

Important

Adds per-configuration model temperature settings with UI support and tests.

• Behavior:
  • Adds modelTemperature option to ApiHandlerOptions in api.ts for configuring model temperatures.
  • Updates handlers like AnthropicHandler, AwsBedrockHandler, GeminiHandler, etc., to use modelTemperature with a default fallback.
  • Introduces TemperatureControl component in TemperatureControl.tsx for UI temperature configuration.
• UI:
  • Integrates TemperatureControl in ApiOptions.tsx to allow users to set model temperature.
• Tests:
  • Adds tests for TemperatureControl in TemperatureControl.test.tsx to verify UI behavior.
• Misc:
  • Moves magic numbers to constants for better reuse and clarity.

^{This description was created by for d4b7a60. It will automatically update as commits are pushed.}

[changeset-bot]

⚠️ No Changeset found

Latest commit: bcd54d5

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[ellipsis-dev]

When the checkbox is toggled on and the current temperature value is undefined, nothing is set. Consider providing a default value (e.g., 0.5) so that enabling custom temperature immediately shows a sensible slider value.

[joemanley201]

This is the behavior we want - mainly because of how we're relying on the value to toggle checkbox on or off

[cte]

Nice!

[nissa-seru]

Awesome! Test-driving this locally - when I check the box and try to drag the slider around to configure the temperature, I notice it is very laggy (to the extent that it takes some time to settle after I finish dragging it.) Might be worth a quick check to see if you can repro this since it's a bit unexpected re UI behavior

[mrubens]

Awesome! Test-driving this locally - when I check the box and try to drag the slider around to configure the temperature, I notice it is very laggy (to the extent that it takes some time to settle after I finish dragging it.) Might be worth a quick check to see if you can repro this since it's a bit unexpected re UI behavior

Maybe we need a debounce in these slider callbacks?

[joemanley201]

Awesome! Test-driving this locally - when I check the box and try to drag the slider around to configure the temperature, I notice it is very laggy (to the extent that it takes some time to settle after I finish dragging it.) Might be worth a quick check to see if you can repro this since it's a bit unexpected re UI behavior

ooh thanks for trying this out. Do you see this for other sliders we have in our settings as well? or just this one?

[nissa-seru]

Just this one; for example, the slider to adjust the post-write delay does not have this issue. The checkbox for `Use custom temperature` does not have the issue either - just, very specifically, the slider. I've now managed to make the slider completely fritz out, where it will keep bouncing between two positions on the bar (and oddly enough, toggling and untoggling the checkbox as it does so.)

…

On Sat, Feb 8, 2025 at 11:47 AM Joe Manley ***@***.***> wrote: Awesome! Test-driving this locally - when I check the box and try to drag the slider around to configure the temperature, I notice it is very laggy (to the extent that it takes some time to settle after I finish dragging it.) Might be worth a quick check to see if you can repro this since it's a bit unexpected re UI behavior ooh thanks for trying this out. Do you see this for other sliders we have in our settings as well? or just this one? — Reply to this email directly, view it on GitHub <#863 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4NBSEQ7D7X6IEDGLDEHFPL2OYYLDAVCNFSM6AAAAABWXJN75SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBVHAZTQMBQGU> . You are receiving this because you commented.Message ID: ***@***.***>

[hannesrudolph]

@joemanley201

I have sonnet selected through OR and I am able to select a temp of 2 but sonnet only allows for 0 < x < 1.

[joemanley201]

sonnet

Good catch - will take a look at this now.

[joemanley201]

#912
Tested this after and it seems to be good. When I intentionally try to click on done immediately after changing the value, I can see the change not getting picked up (both onBlur and onChange). I think it's very rare for the end user to run into this.

As a follow up, I think we should audit our input boxes - or just add a tiny bit of more delay and introduce a loader.