[Announcement] OpenAI gpt-oss Day 0 Support

[zhyncs]

Announcement

OpenAI gpt-oss models Day 0 support for SGLang is here! 🎉 It's the result of a collaborative effort across Eigen AI, NVIDIA, SGLang, and the broader open-source community! For more information, please refer to #8833 We’re hard at work on a new round of features and optimizations—thanks for being part of the journey. Stay tuned!

Installation

# build from source
git clone https://github.com/sgl-project/sglang
cd sglang
pip3 install -e "python[all]"

# hopper
pip3 install torch==2.8.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/test/cu126
pip3 install sgl-kernel==0.3.2

# blackwell cu128
pip3 install torch==2.8.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/test/cu128
pip3 install https://github.com/sgl-project/whl/releases/download/v0.3.2/sgl_kernel-0.3.2+cu128-cp39-abi3-manylinux2014_x86_64.whl

# blackwell cu129
pip3 install torch==2.8.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/test/cu129
https://github.com/sgl-project/whl/releases/download/v0.3.2/sgl_kernel-0.3.2-cp39-abi3-manylinux2014_x86_64.whl

Launch command

LMSYS OpenAI gpt-oss bf16

BF16

# 20b fp8/bf16 tp 1
python3 -m sglang.launch_server --model lmsys/gpt-oss-20b-bf16

# 120b fp8/bf16 tp 4
python3 -m sglang.launch_server --model lmsys/gpt-oss-120b-bf16 --tp 4

MXFP4

# 20b mxfp4 tp 1
python3 -m sglang.launch_server --model openai/gpt-oss-20b

# 120b mxfp4 tp 2
python3 -m sglang.launch_server --model openai/gpt-oss-120b --tp 2