Tests regarding withStructuredOutput in standard chat tests are failing for some reason in Watsonx IBM

[FilipZmijewski]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

My fixed implementation of withStructuredOutput:

        const asJsonSchema = toJsonSchema(schema);
        llm = this.withConfig({
          tools: [
            {
              type: "function" as const,
              function: {
                name: functionName,
                description:
                  asJsonSchema.description ?? "Tool: " + functionName,
                parameters: asJsonSchema,
              },
            },
          ],
          // Ideally that would be set to required but this is not supported yet
          tool_choice: {
            type: "function",
            function: {
              name: functionName,
            },
          },
          ls_structured_output_format: {
            kwargs: { method: "jsonMode" },
            schema: asJsonSchema,
          },
        } as Partial<CallOptions>);
        outputParser = new WatsonxToolsOutputParser({
          returnSingle: true,
          keyName: functionName,
          zodSchema: schema,
        });

The part of test failing:

 expect(handler.extraParams).toEqual(
      expect.objectContaining({
        ls_structured_output_format: {
          kwargs: { method: "jsonMode" },
          schema: toJsonSchema(adderSchema),
        },
      })
    );

Description

Recently I have added some new features to Watsonx IBM implementation and when running tests I saw that standard langchain.js test from ChatModelIntegrationTests are failing. When I looked deeper it showed that tests regarding withStructredOutput failed. I found that strange since I have not touched that part of code.
I found the exact assertion that failed. Added what was missing but the issue still occurs. And you can see the below that apparently is missing. The ls_structured_output_format we want to assert is deep nested in the object so I understand that this is no asserting as true. But now the question is, is this my fault or something wrong with the test? I have compered my implementation of withStructuredOutput to other providers and this seems just fine so I am not sure. I see changes to this tests were added 4 weeks ago so this is still fresh.

System Info

└─ langchain@workspace:langchain
├─ Instances: 1
├─ Version: 0.3.29
│
└─ Dependencies
├─ @faker-js/faker@npm:^7.6.0 → npm:7.6.0
├─ @jest/globals@npm:^29.5.0 → npm:29.7.0
├─ @langchain/core@workspace:* → workspace:langchain-core
├─ @langchain/scripts@>=0.1.0 <0.2.0 → workspace:libs/langchain-scripts
├─ @tsconfig/recommended@npm:^1.0.2 → npm:1.0.8
├─ @types/handlebars@npm:^4.1.0 → npm:4.1.0
├─ @types/html-to-text@npm:^9 → npm:9.0.0
├─ @types/js-yaml@npm:^4 → npm:4.0.5
├─ @types/jsdom@npm:^21.1.1 → npm:21.1.1
├─ @types/uuid@npm:^9 → npm:9.0.8
├─ @types/ws@npm:^8 → npm:8.5.12
├─ axios@npm:^0.26.0 → npm:0.26.1
├─ cheerio@npm:1.0.0-rc.12 → npm:1.0.0-rc.12
├─ dotenv@npm:^16.0.3 → npm:16.4.7
├─ dpdm@npm:^3.14.0 → npm:3.14.0
├─ eslint-plugin-no-instanceof@npm:^1.0.1 → npm:1.0.1
├─ eslint@npm:^8.33.0 → npm:8.53.0
├─ handlebars@npm:^4.7.8 → npm:4.7.8
├─ jest-environment-node@npm:^29.6.4 → npm:29.7.0
├─ js-tiktoken@npm:^1.0.12 → npm:1.0.12
├─ js-yaml@npm:^4.1.0 → npm:4.1.0
├─ jsonpointer@npm:^5.0.1 → npm:5.0.1
├─ openapi-types@npm:^12.1.3 → npm:12.1.3
├─ p-retry@npm:4 → npm:4.6.2
├─ peggy@npm:^3.0.2 → npm:3.0.2
├─ prettier@npm:^2.8.3 → npm:2.8.8
├─ reflect-metadata@npm:^0.2.2 → npm:0.2.2
├─ release-it@npm:^18.1.2 → npm:18.1.2
├─ rimraf@npm:^5.0.1 → npm:5.0.10
├─ rollup@npm:^3.19.1 → npm:3.29.4
├─ typescript@patch:typescript@~5.8.3#~builtin<compat/typescript> → patch:typescript@npm%3A5.8.3#~builtin<compat/typescript>::version=5.8.3&hash=77c9e2
├─ uuid@npm:^10.0.0 → npm:10.0.0
├─ wikipedia@npm:^2.1.2 → npm:2.1.2
├─ yaml@npm:^2.2.1 → npm:2.7.1
├─ zod@npm:^3.25.32 → npm:3.25.51
├─ @langchain/anthropic@workspace:* → workspace:libs/langchain-anthropic [773c0]
├─ @langchain/aws@workspace:* → workspace:libs/langchain-aws [773c0]
├─ @langchain/cerebras@* → workspace:libs/langchain-cerebras [0b9fc]
├─ @langchain/cohere@workspace:* → workspace:libs/langchain-cohere [773c0]
├─ @langchain/deepseek@workspace:* → workspace:libs/langchain-deepseek [773c0]
├─ @langchain/google-genai@workspace:* → workspace:libs/langchain-google-genai [773c0]
├─ @langchain/google-vertexai-web@workspace:* → workspace:libs/langchain-google-vertexai-web [773c0]
├─ @langchain/google-vertexai@workspace:* → workspace:libs/langchain-google-vertexai [773c0]
├─ @langchain/groq@workspace:* → workspace:libs/langchain-groq [773c0]
├─ @langchain/mistralai@workspace:* → workspace:libs/langchain-mistralai [773c0]
├─ @langchain/ollama@workspace:* → workspace:libs/langchain-ollama [773c0]
├─ @langchain/openai@workspace:* → workspace:libs/langchain-openai [773c0]
├─ @langchain/textsplitters@workspace:* → workspace:libs/langchain-textsplitters [773c0]
├─ @langchain/xai@workspace:* → workspace:libs/langchain-xai [773c0]
├─ @swc/core@npm:^1.3.90 → npm:1.3.93 [6dbfd]
├─ @swc/jest@npm:^0.2.29 → npm:0.2.29 [6dbfd]
├─ @typescript-eslint/eslint-plugin@npm:^5.51.0 → npm:5.58.0 [773c0]
├─ @typescript-eslint/parser@npm:^5.51.0 → npm:5.58.0 [773c0]
├─ eslint-config-airbnb-base@npm:^15.0.0 → npm:15.0.0 [773c0]
├─ eslint-config-prettier@npm:^8.6.0 → npm:8.10.0 [6dbfd]
├─ eslint-plugin-import@npm:^2.27.5 → npm:2.31.0 [773c0]
├─ eslint-plugin-jest@npm:^27.6.0 → npm:27.6.0 [6d556]
├─ eslint-plugin-prettier@npm:^4.2.1 → npm:4.2.1 [6dbfd]
├─ jest@npm:^29.5.0 → npm:29.7.0 [6dbfd]
├─ langsmith@npm:^0.3.33 → npm:0.3.33 [0b9fc]
├─ openai@npm:^5.1.0 → npm:5.5.0 [0b9fc]
├─ ts-jest@npm:^29.1.0 → npm:29.1.0 [6dbfd]
└─ typeorm@npm:^0.3.20 → npm:0.3.24 [3a972]

node -v
v20.19.2

yarn -v
3.5.1

MacOS