File tree Expand file tree Collapse file tree 3 files changed +3
-4
lines changed
vllm_mistral_models/mistral-nemo-instruct-2407/1
vllm_models/llama-3.1-8b-instruct/1 Expand file tree Collapse file tree 3 files changed +3
-4
lines changed Original file line number Diff line number Diff line change 1- {"model" : " mistralai/Mistral-Nemo-Instruct-2407" , "disable_log_requests" : true , " gpu_memory_utilization" : 0.9 }
1+ {"model" : " mistralai/Mistral-Nemo-Instruct-2407" , "gpu_memory_utilization" : 0.9 }
Original file line number Diff line number Diff line change 1- {"model" : " meta-llama/Meta-Llama-3.1-8B-Instruct" , "disable_log_requests" : true , " gpu_memory_utilization" : 0.9 }
1+ {"model" : " meta-llama/Meta-Llama-3.1-8B-Instruct" , "gpu_memory_utilization" : 0.9 }
Original file line number Diff line number Diff line change 11#! /bin/bash
2- # Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+ # Copyright 2023-2025 , NVIDIA CORPORATION & AFFILIATES. All rights reserved.
33#
44# Redistribution and use in source and binary forms, with or without
55# modification, are permitted provided that the following conditions
@@ -47,7 +47,6 @@ rm -rf $MODEL_REPO $EXPORT_FILE *.tjson *.json *.csv
4747mkdir -p $MODEL_REPO /$MODEL_NAME /1
4848echo ' {
4949 "model":"gpt2",
50- "disable_log_requests": "true",
5150 "gpu_memory_utilization": 0.5
5251}' > $MODEL_REPO /$MODEL_NAME /1/model.json
5352
You can’t perform that action at this time.
0 commit comments