init

Author: cloga

articles/machine-learning/prompt-flow/get-started-prompt-flow.md

@@ -26,10 +26,6 @@ This article walks you through the main user journey of using Prompt flow in Azu
 > Prompt flow is **not supported** in the workspace which has data isolation enabled. The enableDataIsolation flag can only be set at the workspace creation phase and can't be updated.
 >
 >Prompt flow is **not supported** in the project workspace which was created with a workspace hub. The workspace hub is a private preview feature.
->
->Prompt flow is **not supported** in workspaces that enable managed VNet. Managed VNet is a private preview feature.
->
->Prompt flow is **not supported** if you secure your Azure AI services account(Azure openAI, Azure cognitive search, Azure content safety) with virtual networks. If you want to use these as connection in prompt flow please allow access from all networks.
 
 In your Azure Machine Learning workspace, you can enable Prompt flow by turning on **Build AI solutions with Prompt flow** in the **Manage preview features** panel.
 

articles/machine-learning/prompt-flow/how-to-create-manage-runtime.md

@@ -108,7 +108,6 @@ Go to runtime detail page and select update button at the top. You can change ne
 > [!NOTE]
 > If you used a custom environment, you need to rebuild it using latest prompt flow image first, and then update your runtime with the new custom environment.
 
-## Troubleshooting guide for runtime
 
 ### Common issues
 

articles/machine-learning/prompt-flow/how-to-customize-environment-runtime.md

@@ -174,87 +174,6 @@ Follow [this document to add custom application](../how-to-create-compute-instan
 
 :::image type="content" source="./media/how-to-customize-environment-runtime/runtime-creation-add-custom-application-ui.png" alt-text="Screenshot of compute showing custom applications. " lightbox = "./media/how-to-customize-environment-runtime/runtime-creation-add-custom-application-ui.png":::
 
-## Create managed online deployment that can be used as Prompt flow runtime (deprecated)
-
-> [!IMPORTANT]
-> Managed online endpoint/deployment as runtime is **deprecated**. Please use [Migrate guide for managed online endpoint/deployment runtime](./migrate-managed-inference-runtime.md).
-
-### Create managed online deployment that can be used as Prompt flow runtime via CLI v2
-
-Learn more about [deploy and score a machine learning model by using an online endpoint](../how-to-deploy-online-endpoints.md)
-
-#### Create managed online endpoint
-
-To define a managed online endpoint, you can use the following yaml template. Make sure to replace the `ENDPOINT_NAME` with the desired name for your endpoint.
-
-```yaml
-$schema: https://azuremlschemas.azureedge.net/latest/managedOnlineEndpoint.schema.json
-name: <ENDPOINT_NAME>
-description: this is a sample promptflow endpoint
-auth_mode: key
-```
-
-Use following CLI command `az ml online-endpoint create -f <yaml_file> -g <resource_group> -w <workspace_name>` to create managed online endpoint. To learn more, see [Deploy and score a machine learning model by using an online endpoint](../how-to-deploy-online-endpoints.md).
-
-#### Create Prompt flow runtime image config file
-
-To configure your Prompt flow runtime, place the following config file in your model folder. This config file provides the necessary information for the runtime to work properly.
-
-For the `mt_service_endpoint` parameter, follow this format: `https://<region>.api.azureml.ms`. For example, if your region is eastus, then your service endpoint should be `https://eastus.api.azureml.ms`
-
-```yaml
-storage:
-  storage_account: <WORKSPACE_LINKED_STORAGE>
-deployment:
-  subscription_id: <SUB_ID>
-  resource_group: <RG_NAME>
-  workspace_name: <WORKSPACE_NAME>
-  endpoint_name: <ENDPOINT_NAME>
-  deployment_name: blue
-  mt_service_endpoint: <PROMPT_FLOW_SERVICE_ENDPOINT>
-```
-
-#### Create managed online endpoint
-
-You need to replace the following placeholders with your own values:
-
-- `ENDPOINT_NAME`: the name of the endpoint you created in the previous step
-- `PRT_CONFIG_FILE`: the name of the config file that contains the port and runtime settings. Include the parent model folder name, for example, if model folder name is `model`, then the config file name should be `model/config.yaml`.
-- `IMAGE_NAME` to name of your own image, for example: `mcr.microsoft.com/azureml/promptflow/promptflow-runtime:<newest_version>`, you can also follow [Customize environment with docker context for runtime](#customize-environment-with-docker-context-for-runtime) to create your own environment.
-
-```yaml
-$schema: https://azuremlschemas.azureedge.net/latest/managedOnlineDeployment.schema.json
-name: blue
-endpoint_name: <ENDPOINT_NAME>
-type: managed
-model:
-  path: ./
-  type: custom_model
-instance_count: 1
-# 4core, 32GB
-instance_type: Standard_E4s_v3
-request_settings:
-  max_concurrent_requests_per_instance: 10
-  request_timeout_ms: 90000
-environment_variables:
-  PRT_CONFIG_FILE: <PRT_CONFIG_FILE>
-environment:
-  name: promptflow-runtime
-  image: <IMAGE_NAME>
-  inference_config:
-    liveness_route:
-      port: 8080
-      path: /health
-    readiness_route:
-      port: 8080
-      path: /health
-    scoring_route:
-      port: 8080
-      path: /score
-
-```
-
-Use following CLI command `az ml online-deployment create -f <yaml_file> -g <resource_group> -w <workspace_name>` to create managed online deployment that can be used as a Prompt flow runtime.
 
 ## Next steps
 

articles/machine-learning/prompt-flow/how-to-deploy-for-real-time-inference.md

@@ -45,6 +45,11 @@ If you didn't complete the tutorial, you need to build a flow. Testing the flow
 
 We'll use the sample flow **Web Classification** as example to show how to deploy the flow. This sample flow is a standard flow. Deploying chat flows is similar. Evaluation flow doesn't support deployment.
 
+## Define the environment used by deployment
+When you deploy prompt flow to managed online endpoint in UI. You need define the environment used by this flow. By default, it will use the latest prompt image version. You can specify extra packages you needed in `requirements.txt`. You can find `requirements.txt` in the root folder of your flow folder, which is system generated file.
+
+:::image type="content" source="./media/how-to-deploy-for-real-time-inference/requirements-text.png" alt-text="Screenshot of Web requiremnts-text. " lightbox = "./media/how-to-deploy-for-real-time-inference/requirements-text.png":::
+
 ## Create an online endpoint
 
 Now that you have built a flow and tested it properly, it's time to create your online endpoint for real-time inference. 

articles/machine-learning/prompt-flow/how-to-secure-prompt-flow.md

@@ -54,10 +54,12 @@ Workspace managed virtual network is the recommended way to support network isol
 
     :::image type="content" source="./media/how-to-secure-prompt-flow/outbound-rule-non-azure-resources.png" alt-text="Screenshot of user defined outbound rule for non Azure resource." lightbox = "./media/how-to-secure-prompt-flow/outbound-rule-non-azure-resources.png":::
 
+4. In workspace which enable managed VNet, you can only deployment to managed online endpoint. You can follow [Secure your managed online endpoints with network isolation](../how-to-secure-kubernetes-inferencing-environment.md) to secure your managed online endpoint.
 ## Secure prompt flow use your own virtual network
 
 - To set up Azure Machine Learning related resources as private, see [Secure workspace resources](../how-to-secure-workspace-vnet.md).
 - Meanwhile, you can follow [private Azure Cognitive Services](../../ai-services/cognitive-services-virtual-networks.md) to make them as private.
+- If you want to deploy prompt flow in workspace which secured by your own virtual network, you can deploy it to AKS cluster which is in the same virtual network. You can follow [Secure your RAG workflows with network isolation](../how-to-secure-rag-workflows.md) to secure your AKS cluster.
 - You can either create private endpoint to the same virtual network or leverage virtual network peering to make them communicate with each other.
 
 ## Limitations
@@ -66,15 +68,10 @@ Workspace managed virtual network is the recommended way to support network isol
 - Workspace hub / lean workspace and AI studio don't support bring your own virtual network.
 - Managed online endpoint only supports workspace managed virtual network. If you want to use your own virtual network, you may need one workspace for prompt flow authoring with your virtual network and another workspace for prompt flow deployment using managed online endpoint with workspace managed virtual network.
 
-## FAQ
-
-### Why I can't create or upgrade my flow when I disable public network access of storage account?
-Prompt flow rely on fileshare to store snapshot of flow. Prompt flow didn't support private storage account now. Here are some workarounds you can try:
-- Make the storage account as public access enabled if there is no security concern. 
-- If you are only use UI to authoring promptflow, you can add following flights (flight=PromptFlowCodeFirst=false) to use our old UI.
-- You can use our CLI/SDK to authoring promptflow, CLI/SDK authong didn't rely on fileshare. See [Integrate Prompt Flow with LLM-based application DevOps ](how-to-integrate-with-llm-app-devops.md).
-
 ## Next steps
 
 - [Secure workspace resources](../how-to-secure-workspace-vnet.md)
-- [Workspace managed network isolation](../how-to-managed-network.md)
+- [Workspace managed network isolation](../how-to-managed-network.md)
+- [Secure Azure Kubernetes Service inferencing environment](../how-to-secure-online-endpoint.md)
+- [Secure your managed online endpoints with network isolation](../how-to-secure-kubernetes-inferencing-environment.md)
+- [Secure your RAG workflows with network isolation](../how-to-secure-rag-workflows.md)

articles/machine-learning/prompt-flow/media/faq/workingdirectory.png

@@ -41,4 +41,21 @@ To resolve the issue, you have two options:
 
 - **Option 2**
   - Update your runtime to latest version.
-  - Remove the old tool and re-create a new tool.
+  - Remove the old tool and re-create a new tool.
+
+## Why I can't create or upgrade my flow when I disable public network access of storage account?
+Prompt flow rely on fileshare to store snapshot of flow. Prompt flow didn't support private storage account now. Here are some workarounds you can try:
+- Make the storage account as public access enabled if there is no security concern. 
+- If you are only using UI to authoring promptflow, you can add following flights (flight=PromptFlowCodeFirst=false) to use our old UI.
+- You can use our CLI/SDK to authoring promptflow, CLI/SDK authong didn't rely on fileshare. See [Integrate Prompt Flow with LLM-based application DevOps ](../how-to-integrate-with-llm-app-devops.md). 
+
+
+## Why I can't upgrade my old flow?
+Prompt flow rely on fileshare to store snapshot of flow. If fileshare have some issue, you may encounter this issue. Here are some workarounds you can try:
+- If you are using private storage account, please see [Why I can't create or upgrade my flow when I disable public network access of storage account?](#why-i-cant-create-or-upgrade-my-flow-when-i-disable-public-network-access-of-storage-account)
+- If the storage account is enabled public access, please check whether there are datastore named `workspaceworkingdirectory` in your workspace, it should be fileshare type.
+![workspaceworkingdirectory](../media/faq/workingdirectory.png) 
+    - If you didn't get this datastore, you need add it in your workspace.
+        - Create fileshare with name `code-391ff5ac-6576-460f-ba4d-7e03433c68b6`
+        - Create data store with name `workspaceworkingdirectory` . See [Create datastores](../../how-to-datastore.md)
+    - If you have `workspaceworkingdirectory` datastore but its type is `blob` instead of `fileshare`, please create new workspace and use storage didn't enable hierarchical namespaces ADLS Gen2 as workspace default storage account. See [Create workspace](../../how-to-manage-workspace.md#create-a-workspace)