Skip to content

Commit 6b0f3fc

Browse files
salma-elshafeysalma-elshafeyashaabansoliman
authored
Fix task completion result key (#44460)
* Fix task completion result key * address comments --------- Co-authored-by: salma-elshafey <[email protected]> Co-authored-by: ashaabansoliman <[email protected]>
1 parent 11fe035 commit 6b0f3fc

File tree

1 file changed

+5
-4
lines changed
  • sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_task_completion

1 file changed

+5
-4
lines changed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_task_completion/_task_completion.py

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -153,10 +153,11 @@ async def _do_eval(self, eval_input: Dict) -> Dict[str, Union[float, str]]: # t
153153
llm_output = prompty_output_dict.get("llm_output", {})
154154

155155
if isinstance(llm_output, dict):
156-
success = llm_output.get("success", 0)
157-
if isinstance(success, str):
158-
success = 1 if success.upper() == "TRUE" else 0
159-
156+
success_value = llm_output.get("success", False)
157+
if isinstance(success_value, str):
158+
success = 1 if success_value.lower() == "true" else 0
159+
else:
160+
success = 1 if success_value else 0
160161
success_result = "pass" if success == 1 else "fail"
161162
reason = llm_output.get("explanation", "")
162163
return {

0 commit comments

Comments
 (0)