Skip to content

Commit 36bdd95

Browse files
Update concept-model-catalog.md
1 parent 20b8153 commit 36bdd95

File tree

1 file changed

+17
-0
lines changed

1 file changed

+17
-0
lines changed

articles/machine-learning/concept-model-catalog.md

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -155,6 +155,23 @@ Phi-3-medium-4k-instruct, Phi-3-medium-128k-instruct | [Microsoft Managed Count
155155

156156
Azure Machine Learning implements a default configuration of [Azure AI Content Safety](../ai-services/content-safety/overview.md) text moderation filters for harmful content (hate, self-harm, sexual, and violence) for language models deployed with MaaS. To learn more about content filtering (preview), see [harm categories in Azure AI Content Safety](../ai-services/content-safety/concepts/harm-categories.md). Content filtering (preview) occurs synchronously as the service processes prompts to generate content, and you may be billed separately as per [AACS pricing](https://azure.microsoft.com/pricing/details/cognitive-services/content-safety/) for such use. You can disable content filtering (preview) for individual serverless endpoints when you first deploy a language model or in the deployment details page by selecting the content filtering toggle. You may be at higher risk of exposing users to harmful content if you turn off content filters.
157157

158+
### Network isolation for models deployed via Serverless APIs
159+
160+
Endpoints for models deployed as Serverless APIs follow the public_network_access flag setting of the workspace in which the deployment exists. To secure your MaaS endpoint, disable the public_network_access flag on your workspace. Securing inbound communication from a client to your endpoint is possible by using a private endpoint for the workspace.
161+
162+
**Setting the public_network_access flag for the workspace:**
163+
* Go to the [Azure Portal](https://ms.portal.azure.com/)
164+
* Search for the Resource group to which the workspace belongs, and click on your workspace from the resources shown under this Resource group
165+
* On the overview page, use the left navigation bar to go to Settings > Networking
166+
* Here under the Public Access tab you will have the option to set the Public Network Access flag settings
167+
* Save your changes (changes may take upto five minutes to propagate)
168+
169+
**Limitations:**
170+
* If you have a workspace with private endpoint created before July 11, new MaaS endpoints added to this workspace will not follow the networking configuration of the hub. New private endpoint and serverless API deployments need to be created.
171+
* If you have a workspace with MaaS deployments created before July 11 and you enable private endpoint on this workspace, the existing MaaS endpoints will not follow the workspace's networking configuration. New serverless API deployments need to be created.
172+
* Currently [On Your Data](#rag-with-models-deployed-as-serverless-apis) support is not available for MaaS deployments in private workspaces (public_network_access flag disabled).
173+
* Any network cofiguration change (eg. enabling or disabling the public_network_access flag) may take upto five minutes to propagate.
174+
158175
## Learn more
159176

160177
* Learn [how to use foundation Models in Azure Machine Learning](./how-to-use-foundation-models.md) for fine-tuning, evaluation, and deployment using Azure Machine Learning studio UI or code based methods.

0 commit comments

Comments
 (0)