File tree Expand file tree Collapse file tree 2 files changed +3
-3
lines changed
docs/source/getting-started Expand file tree Collapse file tree 2 files changed +3
-3
lines changed Original file line number Diff line number Diff line change 5757```
5858
5959## Setup from docker
60- Download the pre-built docker image provided or build unified-cache-management docker image by commands below:
60+ Download the pre-built ` vllm-ascend ` docker image or build unified-cache-management docker image by commands below:
6161 ``` bash
6262 # Build docker image using source code, replace <branch_or_tag_name> with the branch or tag name needed
6363 git clone --depth 1 --branch < branch_or_tag_name> https://github.com/ModelEngine-Group/unified-cache-management.git
Original file line number Diff line number Diff line change @@ -83,8 +83,8 @@ vllm serve ${MODEL_PATH} \
8383--port 7800 \
8484--kv-transfer-config \
8585' {
86- "kv_connector": "UnifiedCacheConnectorV1 ",
87- "kv_connector_module_path": "ucm.integration.vllm.uc_connector ",
86+ "kv_connector": "UCMConnector ",
87+ "kv_connector_module_path": "ucm.integration.vllm.ucm_connector ",
8888 "kv_role": "kv_both",
8989 "kv_connector_extra_config": {
9090 "UCM_CONFIG_FILE": "/workspace/unified-cache-management/examples/ucm_config_example.yaml"
You can’t perform that action at this time.
0 commit comments