Skip to content

Commit ed13e4d

Browse files
Adding code llama to TGI (#311)
1 parent 5064cd5 commit ed13e4d

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

model-engine/model_engine_server/domain/use_cases/llm_model_endpoint_use_cases.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -102,6 +102,9 @@
102102
"falcon-7b-instruct": "tiiuae/falcon-7b-instruct",
103103
"falcon-40b": "tiiuae/falcon-40b",
104104
"falcon-40b-instruct": "tiiuae/falcon-40b-instruct",
105+
"code-llama-7b": "codellama/CodeLlama-7b-hf",
106+
"code-llama-13b": "codellama/CodeLlama-13b-hf",
107+
"code-llama-34b": "codellama/CodeLlama-34b-hf",
105108
},
106109
LLMInferenceFramework.VLLM: {
107110
"mpt-7b": "mosaicml/mpt-7b",

0 commit comments

Comments
 (0)