Skip to content

Commit ddac4d7

Browse files
[None][test] Add disag-serving auto scaling qa test (#10262)
Signed-off-by: Stanley Sun <[email protected]>
1 parent 69152c4 commit ddac4d7

File tree

2 files changed

+20
-0
lines changed

2 files changed

+20
-0
lines changed

tests/integration/test_lists/qa/llm_function_core.txt

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -826,6 +826,22 @@ disaggregated/test_workers.py::test_workers_conditional_disaggregation[TinyLlama
826826
disaggregated/test_workers.py::test_workers_kv_cache_events[TinyLlama-1.1B-Chat-v1.0]
827827
disaggregated/test_workers.py::test_workers_kv_cache_aware_router[TinyLlama-1.1B-Chat-v1.0]
828828
disaggregated/test_workers.py::test_workers_kv_cache_aware_router_eviction[TinyLlama-1.1B-Chat-v1.0]
829+
disaggregated/test_auto_scaling.py::test_service_discovery[etcd-round_robin]
830+
disaggregated/test_auto_scaling.py::test_service_discovery[etcd-load_balancing]
831+
disaggregated/test_auto_scaling.py::test_service_discovery[etcd-kv_cache_aware]
832+
disaggregated/test_auto_scaling.py::test_service_discovery[http-round_robin]
833+
disaggregated/test_auto_scaling.py::test_service_discovery[http-load_balancing]
834+
disaggregated/test_auto_scaling.py::test_service_discovery[http-kv_cache_aware]
835+
disaggregated/test_auto_scaling.py::test_minimal_instances[etcd-round_robin]
836+
disaggregated/test_auto_scaling.py::test_minimal_instances[http-round_robin]
837+
disaggregated/test_auto_scaling.py::test_worker_restart[etcd-round_robin]
838+
disaggregated/test_auto_scaling.py::test_worker_restart[etcd-load_balancing]
839+
disaggregated/test_auto_scaling.py::test_worker_restart[etcd-kv_cache_aware]
840+
disaggregated/test_auto_scaling.py::test_worker_restart[http-round_robin]
841+
disaggregated/test_auto_scaling.py::test_worker_restart[http-load_balancing]
842+
disaggregated/test_auto_scaling.py::test_worker_restart[http-kv_cache_aware]
843+
disaggregated/test_auto_scaling.py::test_disagg_server_restart[etcd-round_robin]
844+
disaggregated/test_auto_scaling.py::test_disagg_server_restart[http-round_robin]
829845

830846
# llm-api promote pytorch to default
831847
llmapi/test_llm_api_qa.py::TestLlmDefaultBackend::test_llm_args_logging

tests/integration/test_lists/qa/llm_function_core_sanity.txt

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -251,6 +251,10 @@ disaggregated/test_workers.py::test_workers_conditional_disaggregation[TinyLlama
251251
disaggregated/test_workers.py::test_workers_kv_cache_aware_router_eviction[TinyLlama-1.1B-Chat-v1.0]
252252
disaggregated/test_workers.py::test_workers_kv_cache_aware_router[TinyLlama-1.1B-Chat-v1.0]
253253
disaggregated/test_workers.py::test_workers_kv_cache_events[TinyLlama-1.1B-Chat-v1.0]
254+
disaggregated/test_auto_scaling.py::test_service_discovery[etcd-round_robin]
255+
disaggregated/test_auto_scaling.py::test_minimal_instances[etcd-round_robin]
256+
disaggregated/test_auto_scaling.py::test_worker_restart[etcd-round_robin]
257+
disaggregated/test_auto_scaling.py::test_disagg_server_restart[etcd-round_robin]
254258
test_e2e.py::test_openai_chat_harmony
255259
test_e2e.py::test_openai_consistent_chat
256260
test_e2e.py::test_openai_multi_chat_example

0 commit comments

Comments
 (0)