Add support for OpenAI's gpt-oss open weight models

[0xdevalias]

• https://openai.com/open-models/

  • Open models by OpenAI

  • gpt-oss-120b
    A large open model designed to run in data centers and on high-end desktops and laptops.

  • gpt-oss-20b
    A medium-sized open model that can run on most desktops and laptops.

• https://node-llama-cpp.withcat.ai/blog/v3.12-gpt-oss

  • gpt-oss is here!

  • August 10, 2025

  • node-llama-cpp v3.12 is here, with full support for gpt-oss models!

  • gpt-oss

    gpt-oss comes in two flavors:

    • gpt-oss-20b - 21B parameters with 3.6B active parameters
    • gpt-oss-120b - 117B parameters with 5.1B active parameters

    Here are a few highlights of these models:

    • Due to the low number of active parameters, these models are very fast
    • These are reasoning models, and you can adjust their reasoning effort
    • They are very good at function calling, and are built with agentic capabilities in mind
    • These models were trained with native MXFP4 precision, so no need to quantize them further. They're small compared to their capabilities already
    • They are provided with an Apache 2.0 license, so you can use them in your commercial applications

See Also

• Bump node-llama-cpp from 3.7.0 to 3.12.3 #582
• Bump node-llama-cpp from 3.7.0 to 3.12.1 #568
• Bump node-llama-cpp from 3.7.0 to 3.12.0 #565
• Add an API provider abstraction layer to easily support more services/models/APIs #400
• added ollama support to humanifyjs #646

  • This adds the ollama command that can be used and uses the default model gpt-oss:20b

• added ollama support to humanifyjs #647