Skip to content

Commit 54ace7a

Browse files
committed
ci modifications
1 parent cc0dfeb commit 54ace7a

File tree

3 files changed

+7
-1
lines changed

3 files changed

+7
-1
lines changed

ci/L0_backend_vllm/vllm_backend/curl.out

Whitespace-only changes.

ci/L0_backend_vllm/vllm_backend/ensemble_config.pbtxt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ output [
4444
ensemble_scheduling {
4545
step [
4646
{
47-
model_name: "vllm_model"
47+
model_name: "vllm_opt"
4848
model_version: -1
4949
input_map {
5050
key: "text_input"

ci/L0_backend_vllm/vllm_backend/vllm_backend_test.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -167,6 +167,12 @@ def test_exclude_input_in_output_true(self):
167167
def test_ensemble_model(self):
168168
# Test to ensure that ensemble models are supported in vllm container.
169169
# If ensemble support not present, triton will error out at model loading stage.
170+
171+
# Before loading ensemble model, the dependency model is loaded.
172+
self.triton_client.load_model(self.vllm_model_name)
173+
self.assertTrue(self.triton_client.is_model_ready(self.vllm_model_name))
174+
175+
170176
self.triton_client.load_model(self.enseble_model_name)
171177
self.assertTrue(self.triton_client.is_model_ready(self.enseble_model_name))
172178

0 commit comments

Comments
 (0)