DeepSeek-R1-Distill-Qwen-1.5B

[Yuyz0112]

Please convert the following Hugging Face model to a model catalog:

-https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

[github-actions]

[Dewhale]
[INTERNAL]Tool Call:

{
  "toolName": "convert-hf-model-to-catalog",
  "args": {
    "repoUrl": "https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B",
    "output": "yaml"
  },
  "toolCallId": "call_T3zCO9fNE54kN4jb8TGMyHIS"
}

[INTERNAL]Tool Result:

{
  "toolName": "convert-hf-model-to-catalog",
  "result": "[{\"type\":\"text\",\"text\":\"Generated ModelCatalog configuration in YAML format:\\n\\napiVersion: v1\\nkind: ModelCatalog\\nmetadata:\\n  name: deepseek-r1-distill-qwen-1-5b\\n  display_name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B\\n  labels:\\n    icon_url: 'https://cdn-thumbnails.huggingface.co/social-thumbnails/deepseek-ai.png'\\n    hf_repo_url: 'https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B'\\nspec:\\n  model:\\n    registry: ''\\n    name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B\\n    file: model.safetensors\\n    version: latest\\n    task: text-generation\\n  engine:\\n    engine: vllm\\n    version: v1\\n  resources: {}\\n  replicas:\\n    num: 1\\n  deployment_options:\\n    scheduler:\\n      type: consistent_hash\\n      virtual_nodes: 150\\n      load_factor: 1.25\\n  variables:\\n    RAY_SCHEDULER_TYPE: consistent_hash\\n    engine_args:\\n      tensor_parallel_size: 1\\n      max_model_len: 32768\\n      enforce_eager: true\\n      gpu_memory_utilization: 0.95\\n      enable_chunked_prefill: true\\n      served_model_name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B\\n\"}]",
  "toolCallId": "call_T3zCO9fNE54kN4jb8TGMyHIS"
}

[github-actions]

[Dewhale]
Here is the generated ModelCatalog configuration in YAML format for the Hugging Face model:

apiVersion: v1
kind: ModelCatalog
metadata:
  name: deepseek-r1-distill-qwen-1-5b
  display_name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
  labels:
    icon_url: 'https://cdn-thumbnails.huggingface.co/social-thumbnails/deepseek-ai.png'
    hf_repo_url: 'https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B'
spec:
  model:
    registry: ''
    name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
    file: model.safetensors
    version: latest
    task: text-generation
  engine:
    engine: vllm
    version: v1
  resources: {}
  replicas:
    num: 1
  deployment_options:
    scheduler:
      type: consistent_hash
      virtual_nodes: 150
      load_factor: 1.25
  variables:
    RAY_SCHEDULER_TYPE: consistent_hash
    engine_args:
      tensor_parallel_size: 1
      max_model_len: 32768
      enforce_eager: true
      gpu_memory_utilization: 0.95
      enable_chunked_prefill: true
      served_model_name: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

You can copy and paste this configuration for your use.