feat: Global Inference for Bedrock models (#8750)

[hannesrudolph]

Related GitHub Issue

Closes: #8750

Roo Code Task Context (Optional)

No Roo Code task context for this PR

Description

Implements Global Inference support for Amazon Bedrock models that currently support it (Claude Sonnet 4, Claude Sonnet 4.5, Claude Haiku 4.5). Adds:

• New constant BEDROCK_GLOBAL_INFERENCE_MODEL_IDS to declare supported models.
• New settings flag awsUseGlobalInference (types and UI).
• Provider logic in AwsBedrockHandler to prefix global. for supported models (takes precedence over cross‑region); parseBaseModelId strips the prefix.
• UI toggle under Bedrock provider, shown only for supported models. Enabling Global Inference disables cross‑region.

Test Procedure

• Unit tests:
  • cd src && npx vitest run api/providers/tests/bedrock.spec.ts api/providers/tests/bedrock-inference-profiles.spec.ts
  • cd webview-ui && npx vitest run
• Manual:
  • In Settings → Providers → Bedrock, select a supported model (Sonnet 4 / 4.5 / Haiku 4.5).
  • Toggle “Use Global inference”. Cross‑region is disabled automatically.
  • Verify requests use global. and that parsing removes the prefix for model metadata.

Pre-Submission Checklist

• Issue Linked
• Scope limited to feature
• Self-review completed
• Tests pass locally
• Documentation/i18n considered (English string added; other locales can be updated separately)
• No breaking changes

Screenshots / Videos

No UI layout changes; adds one checkbox when applicable.

Documentation Updates

• No documentation updates are required.

Additional Notes

• Global Inference toggle only appears for models in BEDROCK_GLOBAL_INFERENCE_MODEL_IDS.

Get in Touch

@your-discord

---

Important

Adds global inference support for specific Amazon Bedrock models, updating settings, UI, and tests to accommodate the new feature.

• Behavior:
  • Adds global inference support for Amazon Bedrock models (Claude Sonnet 4, Claude Sonnet 4.5, Claude Haiku 4.5) in bedrock.ts.
  • Introduces awsUseGlobalInference setting in provider-settings.ts and UI toggle in Bedrock.tsx.
  • AwsBedrockHandler prefixes model IDs with global. for supported models when global inference is enabled.
• Constants:
  • Adds BEDROCK_GLOBAL_INFERENCE_MODEL_IDS in bedrock.ts to list supported models.
• Tests:
  • Updates tests in bedrock-inference-profiles.spec.ts and bedrock.spec.ts to cover new global inference logic.
• Translations:
  • Adds awsGlobalInference translation key in multiple locale files (e.g., settings.json for ru, tr, vi, zh-CN, zh-TW).

^{This description was created by for 598ccac. You can customize this summary. It will automatically update as commits are pushed.}

[roomote]

Code Review Summary

I've reviewed the latest changes and found no new issues. The addition of ap-southeast-4 (Melbourne) to the Australia regional inference profile is correctly implemented.

Issues Found

• Missing mutual exclusion in UI: The cross-region inference checkbox should also disable global inference when enabled, creating proper mutual exclusion between the two settings. Currently only one direction is handled.
• Translation error in Hindi locale: The Hindi translation contains Gujarati script. The word "શ્રેષ્ઠ" should be "श्रेष्ठ" in Hindi (Devanagari script).

---

Previous Reviews

• 7cb080a: Review #1
• 4493873: Review #2
• f87e1b9: Review #3
• 15526fa: Review #4
• b4f288c: Review #5
• a02975d: Review #6

_{Mention @roomote in a comment to trigger your PR Fixer agent and make changes to this pull request.}

[Copilot]

Pull Request Overview

This PR adds support for AWS Bedrock Global Inference profile routing, which enables automatic selection of optimal AWS regions for supported models. The feature is mutually exclusive with cross-region inference.

Key changes:

• Added new configuration option awsUseGlobalInference for enabling Global Inference profiles
• Introduced BEDROCK_GLOBAL_INFERENCE_MODEL_IDS constant listing supported models (Claude Sonnet 4, 4.5, and Haiku 4.5)
• Implemented UI checkbox that appears conditionally for supported models and enforces mutual exclusivity with cross-region inference

Reviewed Changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
webview-ui/src/i18n/locales/en/settings.json	Added translation key for Global Inference checkbox label
webview-ui/src/components/settings/providers/Bedrock.tsx	Added conditional UI checkbox for Global Inference with one-way mutual exclusion logic
src/api/providers/bedrock.ts	Implemented Global Inference prefix (global.) application logic with precedence over cross-region inference
packages/types/src/providers/bedrock.ts	Defined list of models supporting Global Inference
packages/types/src/provider-settings.ts	Added awsUseGlobalInference boolean field to Bedrock schema

Comments suppressed due to low confidence (1)

webview-ui/src/components/settings/providers/Bedrock.tsx:167

• The cross-region inference checkbox lacks reciprocal mutual exclusion logic. When enabling cross-region inference, it should also disable Global Inference (similar to how enabling Global Inference disables cross-region inference on lines 157-158). Update the onChange handler to: onChange={(checked: boolean) => { setApiConfigurationField('awsUseCrossRegionInference', checked); if (checked) setApiConfigurationField('awsUseGlobalInference', false); }}

			<Checkbox
				checked={apiConfiguration?.awsUseCrossRegionInference || false}
				onChange={handleInputChange("awsUseCrossRegionInference", noTransform)}>
				{t("settings:providers.awsCrossRegion")}
			</Checkbox>

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[roomote]

The mutual exclusion issue has been resolved. However, there is still one open issue regarding the Hindi translation that needs to be addressed before approval.

[XL-Lewis]

@roomote the jp and au (and potentially others) prefixes are currently missing from AWS_INFERENCE_PROFILE_MAPPING which need to be added as well: https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html

[roomote]

Fixed the reported issues. All local checks passed.

_{View commit | Revert commit}

[XL-Lewis]

@hannesrudolph Apologies - missed that this was a bug due to the addition of new, more specific regions by AWS.

[XL-Lewis]

@roomote The au region covers both ap-southeast-2 and ap-southeast-4, while jp covers 1 and 3

[roomote]

Fixed the reported issue. All local checks passed.

_{View commit | Revert commit}