File tree Expand file tree Collapse file tree 7 files changed +2
-30
lines changed
sdk/evaluation/azure-ai-evaluation
azure/ai/evaluation/_evaluators Expand file tree Collapse file tree 7 files changed +2
-30
lines changed Original file line number Diff line number Diff line change @@ -57,6 +57,8 @@ evaluate(
5757
5858### Bugs Fixed
5959
60+ - Fixed issue where Entra ID authentication was not working with ` AzureOpenAIModelConfiguration `
61+
6062### Other Changes
6163
6264## 1.0.0b2 (2024-09-24)
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Coherence
33description: Evaluates coherence score for QA scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 max_tokens: 1
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Fluency
33description: Evaluates fluency score for QA scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 max_tokens: 1
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Groundedness
33description: Evaluates groundedness score for QA scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 max_tokens: 1
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Relevance
33description: Evaluates relevance score for QA scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 max_tokens: 1
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Retrieval
33description: Evaluates retrieval score for Chat scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 top_p: 1.0
Original file line number Diff line number Diff line change @@ -3,11 +3,6 @@ name: Similarity
33description: Evaluates similarity score for QA scenario
44model:
55 api: chat
6- configuration:
7- type: azure_openai
8- azure_deployment: ${env:AZURE_DEPLOYMENT}
9- api_key: ${env:AZURE_OPENAI_API_KEY}
10- azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
116 parameters:
127 temperature: 0.0
138 max_tokens: 1
You can’t perform that action at this time.
0 commit comments