Qwen3-32B-FP8

[Yuyz0112]

Please convert the following Hugging Face model to a model catalog:

-https://hf-mirror.com/Qwen/Qwen3-32B-FP8

[github-actions]

[Dewhale]
[INTERNAL]Tool Call:

{
  "toolName": "convert-hf-model-to-catalog",
  "args": {
    "repoUrl": "https://hf-mirror.com/Qwen/Qwen3-32B-FP8",
    "output": "yaml"
  },
  "toolCallId": "call_6k2WWG0LPIoYdhcAhNd3x7f7"
}

[INTERNAL]Tool Result:

{
  "toolName": "convert-hf-model-to-catalog",
  "result": "[{\"type\":\"text\",\"text\":\"Error: Fatal error: Not a huggingface.co URL\"}]",
  "toolCallId": "call_6k2WWG0LPIoYdhcAhNd3x7f7"
}

[github-actions]

[Dewhale]
It seems there was an error because the URL provided is not a valid Hugging Face URL. Please provide a URL from the official Hugging Face domain (e.g., https://huggingface.co/username/modelname).

[Yuyz0112]

https://huggingface.co/Qwen/Qwen3-32B-FP8

[github-actions]

[Dewhale]
[INTERNAL]Tool Call:

{
  "toolName": "convert-hf-model-to-catalog",
  "args": {
    "repoUrl": "https://huggingface.co/Qwen/Qwen3-32B-FP8",
    "output": "yaml"
  },
  "toolCallId": "call_GRuFTpzIp0kJqnTzBJ2NqGPr"
}

[INTERNAL]Tool Result:

{
  "toolName": "convert-hf-model-to-catalog",
  "result": "[{\"type\":\"text\",\"text\":\"Generated ModelCatalog configuration in YAML format:\\n\\napiVersion: v1\\nkind: ModelCatalog\\nmetadata:\\n  name: qwen3-32b-fp8\\n  display_name: Qwen/Qwen3-32B-FP8\\n  labels:\\n    icon_url: 'https://cdn-thumbnails.huggingface.co/social-thumbnails/Qwen.png'\\n    hf_repo_url: 'https://huggingface.co/Qwen/Qwen3-32B-FP8'\\nspec:\\n  model:\\n    registry: ''\\n    name: Qwen/Qwen3-32B-FP8\\n    file: model-00001-of-00007.safetensors\\n    version: latest\\n    task: text-generation\\n  engine:\\n    engine: vllm\\n    version: v1\\n  resources: {}\\n  replicas:\\n    num: 1\\n  deployment_options:\\n    scheduler:\\n      type: consistent_hash\\n      virtual_nodes: 150\\n      load_factor: 1.25\\n  variables:\\n    RAY_SCHEDULER_TYPE: consistent_hash\\n    engine_args:\\n      tensor_parallel_size: 1\\n      max_model_len: 32768\\n      enforce_eager: true\\n      gpu_memory_utilization: 0.95\\n      enable_chunked_prefill: true\\n      served_model_name: Qwen/Qwen3-32B-FP8\\n\"}]",
  "toolCallId": "call_GRuFTpzIp0kJqnTzBJ2NqGPr"
}

[github-actions]

[Dewhale]
Here is the generated ModelCatalog configuration for the Hugging Face model Qwen3-32B-FP8 in YAML format:

apiVersion: v1
kind: ModelCatalog
metadata:
  name: qwen3-32b-fp8
  display_name: Qwen/Qwen3-32B-FP8
  labels:
    icon_url: 'https://cdn-thumbnails.huggingface.co/social-thumbnails/Qwen.png'
    hf_repo_url: 'https://huggingface.co/Qwen/Qwen3-32B-FP8'
spec:
  model:
    registry: ''
    name: Qwen/Qwen3-32B-FP8
    file: model-00001-of-00007.safetensors
    version: latest
    task: text-generation
  engine:
    engine: vllm
    version: v1
  resources: {}
  replicas:
    num: 1
  deployment_options:
    scheduler:
      type: consistent_hash
      virtual_nodes: 150
      load_factor: 1.25
  variables:
    RAY_SCHEDULER_TYPE: consistent_hash
    engine_args:
      tensor_parallel_size: 1
      max_model_len: 32768
      enforce_eager: true
      gpu_memory_utilization: 0.95
      enable_chunked_prefill: true
      served_model_name: Qwen/Qwen3-32B-FP8

You can copy and use this configuration for your model catalog.