Skip to content

Commit cf4acb0

Browse files
Copilotsingankit
andcommitted
Add documentation for conversation pairing logic to address reviewer concern about potential mismatches
Co-authored-by: singankit <[email protected]>
1 parent c0539d8 commit cf4acb0

File tree

1 file changed

+5
-0
lines changed
  • sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_common

1 file changed

+5
-0
lines changed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_common/_base_eval.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -222,11 +222,16 @@ def converter(conversation: Dict) -> List[DerivedEvalInput]:
222222
return []
223223

224224
# Pair queries with responses - handle different scenarios
225+
# Note: This uses simple sequential pairing for edge cases. In mismatched scenarios,
226+
# this may not represent perfect conversational flow (e.g., multiple assistant responses
227+
# might form a single complete answer), but provides predictable graceful degradation.
225228
if len(queries) == len(responses):
226229
pairs = list(zip(queries, responses))
227230
elif len(queries) < len(responses):
231+
# More responses than queries: pair each query with corresponding response by index
228232
pairs = list(zip(queries, responses[: len(queries)]))
229233
else:
234+
# More queries than responses: pair available responses with corresponding queries by index
230235
pairs = list(zip(queries[: len(responses)], responses))
231236

232237
for query, response in pairs:

0 commit comments

Comments
 (0)