[CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (vllm-project#28247)

alex-jw-brooks · DarkLight1337 · web-flow · commit e70fbc599b8e · 2025-11-07T02:51:27.000Z
Signed-off-by: Alex-Brooks &lt;Alex.Brooks@ibm.com&gt;
Signed-off-by: Alex Brooks &lt;alex.brooks@ibm.com&gt;
Co-authored-by: Cyrus Leung &lt;cyrus.tl.leung@gmail.com&gt;
diff --git a/tests/entrypoints/openai/test_translation_validation.py b/tests/entrypoints/openai/test_translation_validation.py
@@ -79,7 +79,7 @@ async def test_basic_audio_with_lora(mary_had_lamb):
             temperature=0.0,
         )
     out = json.loads(translation)["text"].strip().lower()
-    assert "mary tenía un pequeño cordero" in out
+    assert "pequeño" in out.split(" ")
 
 
 # NOTE: (NickLucche) the large-v3-turbo model was not trained on translation!

Original file line number	Diff line number	Diff line change
`@@ -79,7 +79,7 @@ async def test_basic_audio_with_lora(mary_had_lamb):`
`79`	`79`	`temperature=0.0,`
`80`	`80`	`)`
`81`	`81`	`out = json.loads(translation)["text"].strip().lower()`
`82`		`- assert "mary tenía un pequeño cordero" in out`
	`82`	`+ assert "pequeño" in out.split(" ")`
`83`	`83`
`84`	`84`
`85`	`85`	`# NOTE: (NickLucche) the large-v3-turbo model was not trained on translation!`