Skip to content

add models (Minimax M2.1, Bytedance, Mistral) #926

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
leonardmq merged 4 commits into from
Jan 11, 2026
Merged

add models (Minimax M2.1, Bytedance, Mistral) #926

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
ac83fdf
add Cerebras for GLM 4.7 and GLM 4.6
leonardmq Jan 9, 2026
bab07e8
add bytedance seed models
leonardmq Jan 9, 2026
79548d3
add mistral models
leonardmq Jan 9, 2026
609ec63
add Minimax M2.1
leonardmq Jan 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
159 changes: 158 additions & 1 deletion libs/core/kiln_ai/adapters/ml_model_list.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,9 +93,16 @@ class ModelName(str, Enum):
phi_4_5p6b = "phi_4_5p6b"
phi_4_mini = "phi_4_mini"
mistral_large = "mistral_large"
mistral_3_large_2512 = "mistral_3_large_2512"
Copy link

@gemini-code-assist gemini-code-assist bot Jan 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

There's an inconsistency in this model's naming. On OpenRouter, the model ID is mistralai/mistral-large-2512 and it's named "Mistral Large 2512", without the "3". For consistency with the provider's naming, it's better to remove the _3_ from the enum member name.

Suggested change
mistral_3_large_2512 = "mistral_3_large_2512"
mistral_large_2512 = "mistral_large_2512"

Copy link
Collaborator

@tawnymanticore tawnymanticore Jan 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

disagree with gemini, it is called Mistral Large 3 https://openrouter.ai/mistralai/mistral-large-2512

mistral_nemo = "mistral_nemo"
mistral_small_3 = "mistral_small_3"
mistral_medium_3_1 = "mistral_medium_3_1"
mistral_small_creative = (
"mistral_small_creative" # mistralai/mistral-small-creative
)
ministral_3_14b_2512 = "ministral_3_14b_2512"
ministral_3_8b_2512 = "ministral_3_8b_2512"
ministral_3_3b_2512 = "ministral_3_3b_2512"
magistral_medium = "magistral_medium"
magistral_medium_thinking = "magistral_medium_thinking"
gemma_2_2b = "gemma_2_2b"
Expand Down Expand Up @@ -209,8 +216,11 @@ class ModelName(str, Enum):
hunyuan_a13b_no_thinking = "hunyuan_a13b_no_thinking"
minimax_m1_80k = "minimax_m1_80k"
minimax_m2 = "minimax_m2"
minimax_m2_1 = "minimax_m2_1"
pangu_pro_moe_72b_a16b = "pangu_pro_moe_72b_a16b"
bytedance_seed_oss_36b = "bytedance_seed_oss_36b"
bytedance_seed_1_6 = "bytedance_seed_1_6"
bytedance_seed_1_6_flash = "bytedance_seed_1_6_flash"
stepfun_step3 = "stepfun_step3"


Expand Down Expand Up @@ -2320,6 +2330,64 @@ class KilnModel(BaseModel):
),
],
),
# Mistral Small Creative
KilnModel(
family=ModelFamily.mistral,
name=ModelName.mistral_small_creative,
friendly_name="Mistral Small Creative",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="mistralai/mistral-small-creative",
structured_output_mode=StructuredOutputMode.json_instruction_and_object,
),
],
),
# Ministral 3 14B 2512
KilnModel(
family=ModelFamily.mistral,
name=ModelName.ministral_3_14b_2512,
friendly_name="Ministral 3 14B 2512",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="mistralai/ministral-14b-2512",
structured_output_mode=StructuredOutputMode.json_schema,
),
KilnModelProvider(
name=ModelProviderName.together_ai,
model_id="mistralai/Ministral-3-14B-Instruct-2512",
structured_output_mode=StructuredOutputMode.json_instruction_and_object,
supports_function_calling=False,
),
],
),
# Ministral 3 8B 2512
KilnModel(
family=ModelFamily.mistral,
name=ModelName.ministral_3_8b_2512,
friendly_name="Ministral 3 8B 2512",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="mistralai/ministral-8b-2512",
structured_output_mode=StructuredOutputMode.json_schema,
),
],
),
# Ministral 3 3B 2512
KilnModel(
family=ModelFamily.mistral,
name=ModelName.ministral_3_3b_2512,
friendly_name="Ministral 3 3B 2512",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="mistralai/ministral-3b-2512",
structured_output_mode=StructuredOutputMode.json_schema,
),
],
),
Comment on lines +2333 to +2390
Copy link
Contributor

@coderabbitai coderabbitai bot Jan 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major

🧩 Analysis chain

🏁 Script executed:

# Find the StructuredOutputMode enum definition and adapter implementations
rg -n "class StructuredOutputMode" --type=py
fd -e py -path "*adapter*" | head -20

Repository: Kiln-AI/Kiln

Length of output: 330

🏁 Script executed:

# Check OpenRouter and Together AI adapter implementations
rg -n "openrouter|together_ai" --type=py libs/core/kiln_ai/adapters/ -l

Repository: Kiln-AI/Kiln

Length of output: 1101

🏁 Script executed:

# Look for how structured_output_mode is handled in adapters
rg -n "structured_output_mode" --type=py libs/core/kiln_ai/adapters/ -A 3

Repository: Kiln-AI/Kiln

Length of output: 50369

🏁 Script executed:

# Get the StructuredOutputMode enum definition
cat -n libs/core/kiln_ai/datamodel/datamodel_enums.py | head -50

Repository: Kiln-AI/Kiln

Length of output: 2659

🏁 Script executed:

# Find OpenRouter and Together AI adapter implementations
find libs/core/kiln_ai/adapters -name "*openrouter*" -o -name "*together*"

Repository: Kiln-AI/Kiln

Length of output: 176

🏁 Script executed:

# Search for how structured_output_mode is processed in adapters
rg "def.*structured_output_mode|json_schema|json_instruction_and_object" libs/core/kiln_ai/adapters/model_adapters/ -A 3 -B 1

Repository: Kiln-AI/Kiln

Length of output: 35341

🏁 Script executed:

# Check lines 2333-2390 and nearby to see what models are being added
sed -n '2333,2390p' libs/core/kiln_ai/adapters/ml_model_list.py

Repository: Kiln-AI/Kiln

Length of output: 2113

🏁 Script executed:

# Check lines 2450-2462 mentioned in the comment
sed -n '2450,2462p' libs/core/kiln_ai/adapters/ml_model_list.py

Repository: Kiln-AI/Kiln

Length of output: 487

🏁 Script executed:

# Search for provider-specific validation or mode handling
rg "openrouter|together_ai" libs/core/kiln_ai/adapters/model_adapters/ -B 2 -A 5 | head -100

Repository: Kiln-AI/Kiln

Length of output: 10068

🏁 Script executed:

# Check if there's any validation that restricts modes per provider
rg "structured_output_mode.*openrouter|openrouter.*structured_output_mode|together_ai.*structured_output_mode" -i

Repository: Kiln-AI/Kiln

Length of output: 38

🏁 Script executed:

# Look for any tests that verify OpenRouter or Together AI support
rg "openrouter|together_ai" libs/core/kiln_ai/adapters/test_ml_model_list.py -B 3 -A 3

Repository: Kiln-AI/Kiln

Length of output: 2317

🏁 Script executed:

# Check for any special handling or documented restrictions for OpenRouter json_schema
rg "json_schema.*openrouter|openrouter.*json_schema" -i libs/core/

Repository: Kiln-AI/Kiln

Length of output: 257

🏁 Script executed:

# Look for Together AI specific mode handling
rg "together_ai" libs/core/kiln_ai/adapters/model_adapters/ -B 3 -A 3

Repository: Kiln-AI/Kiln

Length of output: 871

🏁 Script executed:

# Check the test suite for Together AI structured output mode testing
rg "together_ai" libs/core/kiln_ai/adapters/test_ml_model_list.py -B 3 -A 3 | head -60

Repository: Kiln-AI/Kiln

Length of output: 309

🏁 Script executed:

# Check if there are any integration docs or known limitations
fd "README|readme|INTEGRATION|integration" libs/core/kiln_ai/adapters/ | xargs cat 2>/dev/null

Repository: Kiln-AI/Kiln

Length of output: 3157

🏁 Script executed:

# Find the context of the OpenRouter json_schema limitation comment
rg "json_schema.*sometimes works" -B 5 -A 5 libs/core/kiln_ai/adapters/ml_model_list.py

Repository: Kiln-AI/Kiln

Length of output: 636

🏁 Script executed:

# Check if there are similar limitations for Together AI
rg "together_ai.*json_schema|json_instruction_and_object.*together" -B 3 -A 3 libs/core/kiln_ai/adapters/ml_model_list.py

Repository: Kiln-AI/Kiln

Length of output: 38

🏁 Script executed:

# Look for any existing OpenRouter models to see what modes they use
rg "openrouter" libs/core/kiln_ai/adapters/ml_model_list.py | grep -i "structured_output_mode" | head -20

Repository: Kiln-AI/Kiln

Length of output: 38

🏁 Script executed:

# Check for any tests that validate OpenRouter or Together AI model configurations
rg "test.*openrouter|test.*together_ai" libs/core/kiln_ai/adapters/ -l | xargs grep -l "structured_output_mode"

Repository: Kiln-AI/Kiln

Length of output: 274

🏁 Script executed:

# Look for all OpenRouter models and their structured_output_mode settings
rg "ModelProviderName.openrouter" libs/core/kiln_ai/adapters/ml_model_list.py -A 5 | grep -A 1 "openrouter" | grep "structured_output_mode"

Repository: Kiln-AI/Kiln

Length of output: 1132

🏁 Script executed:

# Check what modes are used across all OpenRouter models
rg "name=ModelProviderName.openrouter" libs/core/kiln_ai/adapters/ml_model_list.py -A 8 | grep "structured_output_mode" | sort | uniq -c

Repository: Kiln-AI/Kiln

Length of output: 497

🏁 Script executed:

# Get the full context of that OpenRouter limitation comment
sed -n '1290,1310p' libs/core/kiln_ai/adapters/ml_model_list.py

Repository: Kiln-AI/Kiln

Length of output: 885

🏁 Script executed:

# Check which Mistral models currently exist with OpenRouter
rg "mistral.*openrouter|openrouter.*mistral" -i libs/core/kiln_ai/adapters/ml_model_list.py -B 2 -A 5

Repository: Kiln-AI/Kiln

Length of output: 38

Use json_instruction_and_object for OpenRouter Mistral/Ministral models to avoid known json_schema instability.

OpenRouter has a documented limitation where json_schema is unreliable ("JSON_schema sometimes works so force that, but not consistently so still not recommended" — see existing Llama 3.3 model config). The newly added OpenRouter models should follow the safer pattern already established in the codebase:

  • mistral_small_creative (OpenRouter) correctly uses json_instruction_and_object ✓
  • ministral_3_14b_2512, ministral_3_8b_2512, ministral_3_3b_2512, and mistral_3_large_2512 (OpenRouter) should switch from json_schema to json_instruction_and_object to align with known provider stability
  • ministral_3_14b_2512 (Together AI) correctly uses json_instruction_and_object ✓

The adapter explicitly supports json_instruction_and_object mode, which pairs JSON instructions in the prompt with API-level json_object response format—a pattern already used in 24 other OpenRouter model configurations.

🤖 Prompt for AI Agents 
In @libs/core/kiln_ai/adapters/ml_model_list.py around lines 2333 - 2390, Update
the OpenRouter Mistral/Ministral model entries to use the stable structured
output mode: for KilnModel instances named ModelName.ministral_3_14b_2512,
ModelName.ministral_3_8b_2512, and ModelName.ministral_3_3b_2512, change the
KilnModelProvider entries that currently set StructuredOutputMode.json_schema to
StructuredOutputMode.json_instruction_and_object (leave the existing
mistral_small_creative and the Together AI provider for
ModelName.ministral_3_14b_2512 unchanged).

# Mistral Medium 3.1
KilnModel(
family=ModelFamily.mistral,
Expand Down Expand Up @@ -2379,6 +2447,19 @@ class KilnModel(BaseModel):
),
],
),
# Mistral Large 2512
KilnModel(
family=ModelFamily.mistral,
name=ModelName.mistral_3_large_2512,
friendly_name="Mistral Large 3 2512",
Comment on lines +2453 to +2454
Copy link

@gemini-code-assist gemini-code-assist bot Jan 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

To align with the suggested change in the ModelName enum and the provider's naming ("Mistral Large 2512"), the _3_ and 3 should be removed from name and friendly_name respectively.

Suggested change
name=ModelName.mistral_3_large_2512,
friendly_name="Mistral Large 3 2512",
name=ModelName.mistral_large_2512,
friendly_name="Mistral Large 2512",

providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="mistralai/mistral-large-2512",
structured_output_mode=StructuredOutputMode.json_schema,
),
],
),
# Mistral Large
KilnModel(
family=ModelFamily.mistral,
Expand Down Expand Up @@ -5171,6 +5252,12 @@ class KilnModel(BaseModel):
reasoning_capable=True,
reasoning_optional_for_structured_output=True,
),
KilnModelProvider(
name=ModelProviderName.cerebras,
model_id="zai-glm-4.7",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
),
],
),
# GLM 4.6
Expand All @@ -5190,6 +5277,12 @@ class KilnModel(BaseModel):
model_id="zai-org/GLM-4.6",
structured_output_mode=StructuredOutputMode.json_instructions,
),
KilnModelProvider(
name=ModelProviderName.cerebras,
model_id="zai-glm-4.6",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
),
],
),
# GLM 4.5V
Expand Down Expand Up @@ -5556,6 +5649,32 @@ class KilnModel(BaseModel):
),
],
),
# Minimax M2.1
KilnModel(
family=ModelFamily.minimax,
name=ModelName.minimax_m2_1,
friendly_name="Minimax M2.1",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="minimax/minimax-m2.1",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
supports_data_gen=True,
r1_openrouter_options=True,
require_openrouter_reasoning=True,
parser=ModelParserID.r1_thinking,
),
KilnModelProvider(
name=ModelProviderName.fireworks_ai,
model_id="accounts/fireworks/models/minimax-m2p1",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
supports_data_gen=True,
reasoning_optional_for_structured_output=True,
),
],
),
# Minimax M2
KilnModel(
family=ModelFamily.minimax,
Expand All @@ -5580,6 +5699,14 @@ class KilnModel(BaseModel):
supports_data_gen=True,
reasoning_optional_for_structured_output=True,
),
KilnModelProvider(
name=ModelProviderName.fireworks_ai,
model_id="accounts/fireworks/models/minimax-m2",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
supports_data_gen=True,
reasoning_optional_for_structured_output=True,
),
],
),
# Pangu Pro MOE
Expand All @@ -5598,7 +5725,7 @@ class KilnModel(BaseModel):
),
],
),
# Bytedance
# Bytedance Seed OSS 36B
KilnModel(
family=ModelFamily.bytedance,
name=ModelName.bytedance_seed_oss_36b,
Expand All @@ -5623,6 +5750,36 @@ class KilnModel(BaseModel):
),
],
),
# Bytedance Seed 1.6
KilnModel(
family=ModelFamily.bytedance,
name=ModelName.bytedance_seed_1_6,
friendly_name="ByteDance Seed 1.6",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="bytedance-seed/seed-1.6",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
supports_data_gen=True,
),
],
),
# Bytedance Seed 1.6 Flash
KilnModel(
family=ModelFamily.bytedance,
name=ModelName.bytedance_seed_1_6_flash,
friendly_name="ByteDance Seed 1.6 Flash",
providers=[
KilnModelProvider(
name=ModelProviderName.openrouter,
model_id="bytedance-seed/seed-1.6-flash",
structured_output_mode=StructuredOutputMode.json_schema,
reasoning_capable=True,
supports_data_gen=True,
),
],
),
# StepFun
KilnModel(
family=ModelFamily.stepfun,
Expand Down
Loading