Skip to content

Commit 0360df2

Browse files
committed
update
1 parent 98c5ba3 commit 0360df2

File tree

1 file changed

+19
-1
lines changed

1 file changed

+19
-1
lines changed

articles/machine-learning/prompt-flow/how-to-secure-prompt-flow.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,24 @@ When you're developing your LLM application using prompt flow, you want a secure
3030
- Related Azure Cognitive Services as such Azure OpenAI, Azure content safety and Azure AI Search, you can use network config to make them as private then using private endpoint to let Azure Machine Learning services communicate with them.
3131
- Other non Azure resources such as SerpAPI etc. If you have strict outbound rule, you need add FQDN rule to access them.
3232

33+
## Options in different network set up
34+
35+
In Azure machine learning, we have two options to secure network isolation, bring your own network or using workspace managed virtual network. Learn more about [Secure workspace resources](../how-to-network-isolation-planning.md).
36+
37+
Here is table to illustrate the options in different network set up for prompt flow.
38+
39+
|Ingress|Egress |Compute type in authoring |Compute type in inference |Network options for workspace|
40+
|-------|-------|----------------------------------------|---------------------------------------------------------|-----------------------------|
41+
|Public |Public |Serverless (recommend), Compute instance| Managed online endpoint (recommend), K8s online endpoint|Managed (recommend) /Bring you own|
42+
|Private|Public |Serverless (recommend), Compute instance| Managed online endpoint (recommend), K8s online endpoint|Managed (recommend) /Bring you own|
43+
|Public |Private|Serverless (recommend), Compute instance| Managed online endpoint |Managed|
44+
|Private|Private|Serverless (recommend), Compute instance| Managed online endpoint |Managed|
45+
46+
- In private VNet scenario, we would recommend to use workspace enabled managed virtual network. It's the easiest way to secure your workspace and related resources.
47+
- You can also have one workspace for prompt flow authoring with your virtual network and another workspace for prompt flow deployment using managed online endpoint with workspace managed virtual network.
48+
- We didn't support mixed using of managed virtual network and bring your own virtual network in single workspace. And as managed online endpoint is support managed virtual network only, you can't deploy prompt flow to managed online endpoint in workspace which enabled bring your own virtual network.
49+
50+
3351
## Secure prompt flow with workspace managed virtual network
3452

3553
Workspace managed virtual network is the recommended way to support network isolation in prompt flow. It provides easily configuration to secure your workspace. After you enable managed virtual network in the workspace level, resources related to workspace in the same virtual network, will use the same network setting in the workspace level. You can also configure the workspace to use private endpoint to access other Azure resources such as Azure OpenAI, Azure content safety, and Azure AI Search. You also can configure FQDN rule to approve outbound to non-Azure resources use by your prompt flow such as SerpAPI etc.
@@ -92,7 +110,7 @@ Workspace managed virtual network is the recommended way to support network isol
92110
## Known limitations
93111
94112
- AI studio don't support bring your own virtual network, it only support workspace managed virtual network.
95-
- Managed online endpoint only supports workspace with managed virtual network. If you want to use your own virtual network, you might need one workspace for prompt flow authoring with your virtual network and another workspace for prompt flow deployment using managed online endpoint with workspace managed virtual network.
113+
- Managed online endpoint with selected egress only supports workspace with managed virtual network. If you want to use your own virtual network, you might need one workspace for prompt flow authoring with your virtual network and another workspace for prompt flow deployment using managed online endpoint with workspace managed virtual network.
96114

97115
## Next steps
98116

0 commit comments

Comments
 (0)