Skip to content

Commit 0a9b02d

Browse files
authored
new tests (Azure#38571)
* new tests * remove gleu * run black * skip * test ci: restore multimodal test * test ci: restore conversation test * change skip type * remove skips because they don't work * test only convo in CI * only skip convo test * just run multi * 2 tests * fix param placement * skip multi * just singlton * remove cs from first test * remove rai evals * remove prompty evals * all but 1 eval * update recordings * 2 evals * just cs * 2 rai service * prompty only * disable pf proxy * delay * more fixture tweaks * more os setting * skip windows in CI * re-enabled all tests * remove env setting * re-reacord * disable 1 test
1 parent 9bf137b commit 0a9b02d

File tree

6 files changed

+431
-2
lines changed

6 files changed

+431
-2
lines changed

sdk/evaluation/azure-ai-evaluation/assets.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,5 +2,5 @@
22
"AssetsRepo": "Azure/azure-sdk-assets",
33
"AssetsRepoPrefixPath": "python",
44
"TagPrefix": "python/evaluation/azure-ai-evaluation",
5-
"Tag": "python/evaluation/azure-ai-evaluation_a63b4a27cf"
5+
"Tag": "python/evaluation/azure-ai-evaluation_d414254496"
66
}

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_similarity/_similarity.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ async def __call__(self, *, query: str, response: str, ground_truth: str, **kwar
8080

8181
class SimilarityEvaluator:
8282
"""
83-
Evaluates similarity score for a given query, response, and ground truth or a multi-turn conversation.
83+
Evaluates similarity score for a given query, response, and ground truth.
8484
8585
The similarity measure evaluates the likeness between a ground truth sentence (or document) and the
8686
AI model's generated prediction. This calculation involves creating sentence-level embeddings for both

sdk/evaluation/azure-ai-evaluation/tests/conftest.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
from .__openai_patcher import TestProxyConfig, TestProxyHttpxClientBase # isort: split
22
from . import __pf_service_isolation # isort: split # noqa: F401
33

4+
import os
45
import json
56
import multiprocessing
67
import time

0 commit comments

Comments
 (0)