How to deploy multiple models in the same workspace?

[amulil]

I want to deploy llama2-7b and llama2-13b at the same time.

after I run the command:

python3 -m lmdeploy.serve.turbomind.deploy llama2 /path/to/llama2
sudo bash workspace/service_docker_up.sh 

I have a dir named workspace, but how can I have another workspace for llama2-13b.

Do I need to find a different path to save another workspace and change the docker name of service_docker_up.sh?

[lvhan028]

python3 -m lmdeploy.serve.turbomind.deploy llama2 /path/to/llama2-7b --dst-path /path/to/workspace/of/llama2-7b
python3 -m lmdeploy.serve.turbomind.deploy llama2 /path/to/llama2-13b --dst-path /path/to/workspace/of/llama2-13b