Add IBM watsonx AI provider in the list of providers to connect to IBM hosted LLMs #8092

PrasangAPrajapati · 2025-09-17T22:09:26Z

Related GitHub Issue

Closes: #8087

Roo Code Task Context (Optional)

Description

Added IBM watsonx AI provider in the list of providers in the Roo Code VS Code extension to connect to IBM watsonx-hosted LLMs.
Added IBM watsonx AI provider in the list of embedded providers in the Roo Code VS Code extension to connect to IBM watsonx-hosted embedded models for code-indexing...

Test Procedure

You can start with the free trial: https://dataplatform.cloud.ibm.com/registration/stepone?context=wx
Sign up with Google (Do not use RedHat) - If you already have an account, just use Log In
Once you're logged in to the IBM Cloud, you'll be asked to add the address and the credit card information (Don't worry, you won't get charged)
Go to the Resources list from the left sidebar menu
Click on the Create resource button
Go to the Category - AI/Machine Learning
Click on watsonx.ai runtime
Select the Region (Dallas) and Lite plan, which is free
You can give the service name, and the resource group will be the default.
Accept terms and conditions and hit create
Now there is a button called Launch In -> Select IBM watsonx from the drop-down - it will create a watsonx instance
Go down on the page and create a project by clicking on the + icon (it may create automatically)
Go to Manage and click on the Services and integrations from the left menu bar (make sure the created watsonx.ai runtime is associated)
Go back to the home page by clicking on the top left IBM watsonx
Select your project from the drop-down shown in the Developer access area
Click on the Create API key and save the API key (you won't be able to see that again)
Note project ID and api key
Use the project ID and api key in the Roo Code IBM watsonx provider

Pre-Submission Checklist

Issue Linked: This PR is linked to an approved GitHub Issue (see "Related GitHub Issue" above).
Scope: My changes are focused on the linked issue (one major feature/fix per PR).
Self-Review: I have performed a thorough self-review of my code.
Testing: New and/or updated tests have been added to cover my changes (if applicable).
Documentation Impact: I have considered if my changes require documentation updates (see "Documentation Updates" section below).
Contribution Guidelines: I have read and agree to the Contributor Guidelines.

Screenshots / Videos

Documentation Updates

I am going to create a page on the Roo-Code website to add the IBM watsonx providers in the list of providers. It would be https://docs.roocode.com/providers/ibm-watsonx

Additional Notes

Get in Touch

Let's use the GH PR only for communication.

Important

This PR adds IBM watsonx as a new AI provider, including configuration, validation, UI integration, and testing support.

Behavior:
- Adds IBM watsonx as a new AI provider in provider-settings.ts and index.ts.
- Supports both IBM Cloud and Cloud Pak platforms with different authentication methods.
- Integrates model fetching and embedding capabilities.
Validation:
- Updates validate.ts to include validation for IBM watsonx API keys, project ID, and platform-specific settings.
UI:
- Adds UI components for IBM watsonx configuration in CodeIndexPopover.tsx and ApiOptions.tsx.
- Updates localization files for new settings in ko, nl, and pt-BR.
Testing:
- Adds tests for IBM watsonx in watsonx.spec.ts and embedders/watsonx.spec.ts.

^{This description was created by}^{for 8e0e30c. You can customize this summary. It will automatically update as commits are pushed.}

…code indexing..

…de indexing..

roomote

Thank you for your contribution! I've reviewed the changes and found several issues that need attention before this can be merged. The implementation adds IBM watsonx AI provider support, but there are some critical missing pieces and unrelated changes that should be addressed.

packages/types/src/providers/watsonx.ts

src/api/providers/watsonx.ts

webview-ui/src/components/settings/providers/WatsonxAI.tsx

README.md

packages/types/src/codebase-index.ts

…de indexing..

…sharp.ts

This reverts commit 798f3cc.

daniel-lxs

I found some issues that need attention. See the inline comments for details.

daniel-lxs · 2025-09-25T20:15:51Z

src/api/providers/watsonx.ts

+			}
+
+			this.service = WatsonXAI.newInstance(serviceOptions)
+			this.service.getAuthenticator().authenticate()


[P1] Unawaited authenticator.authenticate() in a non-async constructor risks a race and unhandled rejection. Either remove and rely on lazy auth, await in an async factory, or defer auth to the first API call.

daniel-lxs · 2025-09-25T20:15:51Z

src/services/code-index/embedders/watsonx.ts

+								let embedding = response.result.results[0].embedding
+								if (!embedding || embedding.length === 0) {
+									console.error(`Empty embedding returned for text at index ${textIndex}`)
+									const expectedDimension = this.getExpectedDimension(modelToUse)


[P1] Generating fallback embeddings (0.0001-filled vectors) pollutes the index and harms retrieval. Prefer surfacing an error and skipping the item (with logging) so quality isn’t degraded.

daniel-lxs · 2025-09-25T20:15:51Z

src/api/providers/watsonx.ts

+				detailedMessage = `Connection failed: ${errorMessage}. Please check your network connection and base URL.`
+			}
+
+			await vscode.window.showErrorMessage(detailedMessage)


[P2] Provider layer shouldn’t call VS Code UI (window.showErrorMessage). Emit an error event/result and let UI handle display to keep layers separated and enable headless usage.

daniel-lxs · 2025-09-25T20:15:52Z

src/api/providers/fetchers/watsonx.ts

+				throw new Error("Base URL is required for IBM Cloud Pak for Data")
+			}
+
+			if (username) {


[P2] For Cloud Pak, if the username (and corresponding auth) is missing, the client is created without authenticator and the call will fail later. Validate required fields up front and return an error.

daniel-lxs · 2025-09-25T20:15:52Z

src/services/code-index/embedders/watsonx.ts

+
+	async createEmbeddings(texts: string[], model?: string): Promise<EmbeddingResponse> {
+		const MAX_RETRIES = 3
+		const INITIAL_DELAY_MS = 1000


[P2] Hardcoded delays/rate limits (INITIAL_DELAY_MS/REQUEST_DELAY_MS/MAX_CONCURRENT_REQUESTS) will either throttle too much or still trip 429s. Make these configurable and consider adaptive backoff using response headers.

daniel-lxs · 2025-09-25T20:15:52Z

webview-ui/src/components/settings/providers/WatsonxAI.tsx

+			baseUrl = apiConfiguration.watsonxBaseUrl || ""
+		}
+
+		if (platform === "ibmCloud" && (!apiKey || !baseUrl)) {


[P2] Refresh Models for IBM Cloud proceeds without validating projectId; downstream requests that require projectId will fail. Block the action until projectId is provided.

daniel-lxs · 2025-09-25T20:15:52Z

src/api/providers/watsonx.ts

+		const platform = this.options.watsonxPlatform
+
+		try {
+			const serviceOptions: any = {


[P3] serviceOptions typed as any; replace with the SDK’s options type to improve maintainability and compile-time safety.

daniel-lxs · 2025-09-25T20:15:52Z

src/api/providers/fetchers/watsonx.ts

+	password?: string,
+): Promise<Record<string, ModelInfo>> {
+	try {
+		let options: any = {


[P3] options typed as any here and below; add concrete types for SDK client configuration and response mapping (model spec shape).

daniel-lxs · 2025-09-25T20:15:52Z

packages/types/src/providers/watsonx.ts

+import type { ModelInfo } from "../model.js"
+
+export type WatsonxAIModelId = keyof typeof watsonxAiModels
+export const watsonxAiDefaultModelId = ""


[P3] Empty default model id can lead to runtime calls with an empty model id if validation is bypassed. Prefer a safe explicit default (e.g., ibm/granite-3-3-8b-instruct) or require selection.

daniel-lxs · 2025-09-25T20:15:52Z

webview-ui/src/components/settings/providers/WatsonxAI.tsx

+				defaultModelId={watsonxAiDefaultModelId}
+				models={watsonxModels && Object.keys(watsonxModels).length > 0 ? watsonxModels : {}}
+				modelIdKey="watsonxModelId"
+				serviceName=""


[P3] ModelPicker serviceName/serviceUrl are empty; populate to improve UX and consistency with other providers.

PrasangAPrajapati added 22 commits August 25, 2025 10:22

add ibm-cloud watsonx AI npm dependency

a8e5a71

add IBM watsonx AI provider and IBM watsonx embedded AI provider for …

feda684

…code indexing..

Merge branch 'main' into watsonx-ai-integration

ad4b778

add watsonx missing provider in the typs

0362aae

fix lock file

408b554

fix providers issue

2129d11

fix providers issue

dd2eb49

fix providers issue

13f49fe

add refresh models button to get the models dynamically

5574351

allow any type to handle watsonx

4d9fbb0

add support for IBM Cloud Pak for Data

37c5584

add IBM cloud pak for data support for embedded watsonx models for co…

f1c700b

…de indexing..

add ibm-cloud-sdk-core dependency

6c269c1

set username to empty string instead of undefined

669240a

finish junit tests and naming convention changes to provider

f22f692

pass empty model id for default

ea8e61c

add timestamp script to generate vsix with timestamp added

1341c43

fix margins and text

99bdf52

update IBM watsonx embeddeer for code indeix

e196ea1

change it to retrieve models

97c98ac

merge main into watsonx-ai-integration

5c1f337

minor tweaks to fix for merge

f43b197

github-project-automation bot added this to Roo Code Roadmap and Roo Code Roadmap Sep 17, 2025

github-project-automation bot moved this to Triage in Roo Code Roadmap Sep 17, 2025

github-project-automation bot moved this to New in Roo Code Roadmap Sep 17, 2025

roomote bot reviewed Sep 17, 2025

View reviewed changes

hannesrudolph added the Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. label Sep 17, 2025

PrasangAPrajapati added 2 commits September 17, 2025 18:28

add ibm-cloud watsonx AI npm dependency

8176fcc

rebase to main

2beaa34

PrasangAPrajapati added 11 commits September 22, 2025 18:12

add refresh models button to get the models dynamically

63d71d4

add IBM cloud pak for data support for embedded watsonx models for co…

4bd8938

…de indexing..

finish junit tests and naming convention changes to provider

a25bd4b

update IBM watsonx embeddeer for code indeix

7d2136c

fix code indexing and remove duplicates

c72a633

add missing keys in each languages for translations

709f81f

revert some formatting changes

3343d52

format watsonx

b160e96

change variable

c709427

remove duplicate imports

90147b2

remove duplicate imports

2be16a1

dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. and removed size:XL This PR changes 500-999 lines, ignoring generated files. labels Sep 22, 2025

PrasangAPrajapati added 3 commits September 22, 2025 18:26

run format

5c16cdf

remove not needed file

7813862

Revert unintended changes to featherless.ts, codeSearchTool.ts and c-…

f2a5804

…sharp.ts

dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. and removed size:XXL This PR changes 1000+ lines, ignoring generated files. labels Sep 22, 2025

Minor UI changes to watsonx AI

93d86cb

hannesrudolph moved this from PR [Changes Requested] to PR [Needs Prelim Review] in Roo Code Roadmap Sep 23, 2025

hannesrudolph added PR - Needs Preliminary Review and removed PR - Changes Requested labels Sep 23, 2025

PrasangAPrajapati added 4 commits September 24, 2025 12:37

update authentication for IBM Cloud Pak for Data

d2edf65

Merge branch 'main' into watsonx-ai-integration

3bcfe6b

Merge branch 'main' into watsonx-ai-integration

798f3cc

Revert "Merge branch 'main' into watsonx-ai-integration"

bfb97a3

This reverts commit 798f3cc.

daniel-lxs reviewed Sep 25, 2025

View reviewed changes

daniel-lxs closed this Sep 25, 2025

github-project-automation bot moved this from New to Done in Roo Code Roadmap Sep 25, 2025

github-project-automation bot moved this from PR [Needs Prelim Review] to Done in Roo Code Roadmap Sep 25, 2025

Add IBM watsonx AI provider in the list of providers to connect to IBM hosted LLMs #8092

Add IBM watsonx AI provider in the list of providers to connect to IBM hosted LLMs #8092

Uh oh!

Conversation

PrasangAPrajapati commented Sep 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related GitHub Issue

Roo Code Task Context (Optional)

Description

Test Procedure

Pre-Submission Checklist

Screenshots / Videos

Documentation Updates

Additional Notes

Get in Touch

Uh oh!

roomote bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

daniel-lxs left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

PrasangAPrajapati commented Sep 17, 2025 •

edited

Loading