You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-foundry/how-to/develop/evaluate-sdk.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -407,7 +407,7 @@ For NLP evaluators, only a score is given in the `{metric_name}` key.
407
407
408
408
Like six other AI-assisted evaluators, `GroundednessEvaluator` is a prompt-based evaluator that outputs a score on a 5-point scale (the higher the score, the more grounded the result is). On the other hand, `GroundednessProEvaluator` (preview) invokes our backend evaluation service powered by Azure AI Content Safety and outputs `True` if all content is grounded, or `False` if any ungrounded content is detected.
409
409
410
-
We open-source the prompts of our quality evaluators except for `GroundednessProEvaluator` (powered by Azure AI Content Safety) for transparency. These prompts serve as instructions for a language model to perform their evaluation task, which requires a human-friendly definition of the metric and its associated scoring rubrics (what the five levels of quality mean for the metric). We highly recommend that users customize the definitions and grading rubrics to their scenario specifics. See details in [Custom Evaluators](#custom-evaluators).
410
+
We open-source the prompts of our quality evaluators except for `GroundednessProEvaluator` (powered by Azure AI Content Safety) for transparency. These prompts serve as instructions for a language model to perform their evaluation task, which requires a human-friendly definition of the metric and its associated scoring rubrics (what the five levels of quality mean for the metric). We highly recommend that users customize the definitions and grading rubrics to their scenario specifics.
| Public Network Access = Enabled | Account key enabled | SAS/Account Key | Yes, UX and SDK|
223
-
| Public Network Access = Enabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK <br><br> *Note:* for UX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token ||||
224
-
| Enabled from selected virtual networks and IP addresses | Account key enabled | Account key | Yes, UX and SDK <br><br> *Note:* for UX, the IP of the compute running the browser must be in the selected list|
225
-
| Enabled from selected virtual networks and IP addresses | Account key enabled | SAS | Yes, UX and SDK <br><br> *Note:* for UX, the IP of the compute running the browser must be in the selected list|
226
-
| Enabled from selected virtual networks and IP addresses | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK. <br><br>*Note:* for UX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token. Also ensure the IP of the compute running the browser must be in the selected list||||
227
-
| Public Network Access = Disabled | Account key enabled | SAS/Account Key | Yes, UX and SDK. <br><br> *Note:* for UX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage|
228
-
| Public Network Access = Disabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK. <br><br> *Note:* for UX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage|
| Public Network Access = Enabled | Account key enabled | SAS/Account Key | Yes, UX and SDK |
223
+
| Public Network Access = Enabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK <br><br> *Note:* for UX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token |
224
+
| Enabled from selected virtual networks and IP addresses | Account key enabled | Account key | Yes, UX and SDK <br><br> *Note:* for UX, the IP of the compute running the browser must be in the selected list |
225
+
| Enabled from selected virtual networks and IP addresses | Account key enabled | SAS | Yes, UX and SDK <br><br> *Note:* for UX, the IP of the compute running the browser must be in the selected list |
226
+
| Enabled from selected virtual networks and IP addresses | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK. <br><br>*Note:* for UX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token. Also ensure the IP of the compute running the browser must be in the selected list |
227
+
| Public Network Access = Disabled | Account key enabled | SAS/Account Key | Yes, UX and SDK. <br><br> *Note:* for UX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage |
228
+
| Public Network Access = Disabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UX and SDK. <br><br> *Note:* for UX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage |
229
229
230
230
231
231
The scenarios above should work in a Managed Vnet workspace as well. See setup of Managed Vnet AI Foundry hub here: [How to configure a managed network for Azure AI Foundry hubs](./configure-managed-network.md)
@@ -587,10 +587,10 @@ Several enterprise scenarios are supported for MaaS fine-tuning. The table below
| Public Network Access = Enabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UXandSDK<br><br>*Note:*forUX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token | | | |
590
+
| Public Network Access = Enabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UXandSDK<br><br>*Note:*forUX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token |
591
591
| Enabled from selected virtual networks andIP addresses | Account key enabled | Account key | Yes, UXandSDK<br><br>*Note:*forUX, the IP of the compute running the browser must be in the selected list|
592
592
| Enabled from selected virtual networks andIP addresses | Account key enabled |SAS| Yes, UXandSDK<br><br>*Note:*forUX, the IP of the compute running the browser must be in the selected list|
593
-
| Enabled from selected virtual networks andIP addresses | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UXandSDK. <br><br>*Note:*forUX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token. Also ensure the IP of the compute running the browser must be in the selected list | | | |
593
+
| Enabled from selected virtual networks andIP addresses | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UXandSDK. <br><br>*Note:*forUX, you may need to add Storage Blob Data Reader or Storage Blob Data Contributor for your user ID on the storage account, or change the connection's authentication to use Account key/SAS token. Also ensure the IP of the compute running the browser must be in the selected list |
594
594
| Public Network Access = Disabled | Account key enabled |SAS/Account Key | Yes, UXandSDK. <br><br>*Note:*forUX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage |
595
595
| Public Network Access = Disabled | Account key disabled | Entra-Based Auth (Credentialless) | Yes, UXandSDK. <br><br>*Note:*forUX data upload and submission to work, the workspace _needs to be accessed from within the Vnet_ that has appropriate access to the storage |
0 commit comments