You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Though the AI Red Teaming Agent (preview) can be run [locally](./develop/run-scans-ai-red-teaming-agent) during prototyping and development to help identify safety risks, running them in the cloud allows for pre-deployment AI red teaming runs on larger combinations of attack strategies and risk categories for a fuller analysis.
20
+
Though the AI Red Teaming Agent (preview) can be run [locally](./develop/run-scans-ai-red-teaming-agent.md) during prototyping and development to help identify safety risks, running them in the cloud allows for pre-deployment AI red teaming runs on larger combinations of attack strategies and risk categories for a fuller analysis.
### Prerequisite set up steps for Azure AI Foundry Projects
27
-
28
26
If this is your first time running evaluations or AI red teaming runs on your Azure AI Foundry project, you might need to do a few additional setup steps.
29
27
30
28
1.[Create and connect your storage account](https://github.com/azure-ai-foundry/foundry-samples/blob/main/samples/microsoft/infrastructure-setup/01-connections/connection-storage-account.bicep) to your Azure AI Foundry project at the resource level. This bicep template provisions and connects a storage account to your Foundry project with key authentication.
Copy file name to clipboardExpand all lines: articles/ai-foundry/how-to/develop/run-scans-ai-red-teaming-agent.md
+10-8Lines changed: 10 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,6 +24,16 @@ This article guides you through the process of
24
24
- Creating an AI Red Teaming Agent locally
25
25
- Running automated scans locally and viewing the results
26
26
27
+
## Prerequisites
28
+
29
+
- An Azure AI Foundry project or hubs based project. To learn more, see [Create a project](/how-to/create-projects.md)
30
+
31
+
If this is your first time running evaluations or AI red teaming runs on your Azure AI Foundry project, you might need to do a few additional setup steps.
32
+
33
+
1.[Create and connect your storage account](https://github.com/azure-ai-foundry/foundry-samples/blob/main/samples/microsoft/infrastructure-setup/01-connections/connection-storage-account.bicep) to your Azure AI Foundry project at the resource level. This bicep template provisions and connects a storage account to your Foundry project with key authentication.
34
+
2. Make sure the connected storage account has access to all projects.
35
+
3. If you connected your storage account with Microsoft Entra ID, make sure to give MSI (Microsoft Identity) permissions for Storage Blob Data Owner to both your account and Foundry project resource in Azure portal.
36
+
27
37
## Getting started
28
38
29
39
First install the `redteam` package as an extra from Azure AI Evaluation SDK, this provides the PyRIT functionality:
> PyRIT only works with Python 3.10, 3.11, 3.12 but doesn't support Python 3.9. If you're using Python 3.9, you must upgrade your Python version to use this feature.
37
47
38
-
### Prerequisite set up steps for Azure AI Foundry Projects
39
-
40
-
If this is your first time running evaluations or AI red teaming runs on your Azure AI Foundry project, you might need to do a few additional setup steps.
41
-
42
-
1.[Create and connect your storage account](https://github.com/azure-ai-foundry/foundry-samples/blob/main/samples/microsoft/infrastructure-setup/01-connections/connection-storage-account.bicep) to your Azure AI Foundry project at the resource level. This bicep template provisions and connects a storage account to your Foundry project with key authentication.
43
-
2. Make sure the connected storage account has access to all projects.
44
-
3. If you connected your storage account with Microsoft Entra ID, make sure to give MSI (Microsoft Identity) permissions for Storage Blob Data Owner to both your account and Foundry project resource in Azure portal.
45
-
46
48
## Create and run an AI Red Teaming Agent
47
49
48
50
You can instantiate the AI Red Teaming agent with your Azure AI Project and Azure Credentials.
Copy file name to clipboardExpand all lines: articles/ai-foundry/how-to/view-ai-red-teaming-results.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ Or by attack complexity classification:
35
35
36
36
Drilling down further into the data tab provides a row-level view of each attack-response pair, enabling deeper insights into system issues and behaviors. For each attack-response pair, you can see additional information such as whether or not the attack was successful, what attack strategy was used and its attack complexity. There's also an option for a human in the loop reviewer to provide human feedback by selecting the thumbs up or thumbs down icon.
37
37
38
-
:::image type="content" source="../../media/evaluations/red-teaming-agent/ai-red-team-data.png" alt-text="Screenshot of AI Red Teaming data page in Azure AI Foundry." lightbox="../media/evaluations/red-teaming-agent/ai-red-team-data.png":::
38
+
:::image type="content" source="../media/evaluations/red-teaming-agent/ai-red-team-data.png" alt-text="Screenshot of AI Red Teaming data page in Azure AI Foundry." lightbox="../media/evaluations/red-teaming-agent/ai-red-team-data.png":::
39
39
40
40
To view each conversation, selecting **View more** opens up the full conversation for more detailed analysis of the AI system's response.
0 commit comments