Skip to content

Commit f92adc1

Browse files
Merge pull request #265547 from eric-urban/eur/ai-studio-refresh
ai studio refresh docs
2 parents b631d61 + c8d1c28 commit f92adc1

17 files changed

+54
-56
lines changed

articles/ai-studio/how-to/costs-plan-manage.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@ When you use cost analysis, you view Azure AI hub resource costs in graphs and t
8787

8888
### Monitor Azure AI Studio project costs
8989

90-
You can get to cost analysis from the [Azure portal](https://portal.azure.com). You can also get to cost analysis from the [Azure AI Studio portal](https://ai.azure.com).
90+
You can get to cost analysis from the [Azure portal](https://portal.azure.com). You can also get to cost analysis from the [Azure AI Studio](https://ai.azure.com).
9191

9292
> [!IMPORTANT]
9393
> Your Azure AI project costs are only a subset of your overall application or solution costs. You need to monitor costs for all Azure resources used in your application or solution. See [Azure AI hub resources](../concepts/ai-resources.md) for more information.
@@ -96,14 +96,14 @@ For the examples in this section, assume that all Azure AI Studio resources are
9696

9797
Here's an example of how to monitor costs for an Azure AI Studio project. The costs are used as an example only. Your costs will vary depending on the services that you use and the amount of usage.
9898

99-
1. Sign in to [Azure AI Studio portal](https://ai.azure.com).
99+
1. Sign in to [Azure AI Studio](https://ai.azure.com).
100100
1. Select your project and then select **Settings** from the left navigation menu.
101101

102102
:::image type="content" source="../media/cost-management/project-costs/project-settings-go-view-costs.png" alt-text="Screenshot of the Azure AI Studio portal showing how to see project settings." lightbox="../media/cost-management/project-costs/project-settings-go-view-costs.png":::
103103

104-
1. Select **See project cost on Azure portal**. The Azure portal opens to the cost analysis page for your project.
104+
1. Select **View cost for resources**. The [Azure portal](https://portal.azure.com) opens to the cost analysis page for your project.
105105

106-
1. Expand the **Resource** column to see the costs for each service that's underlying your [Azure AI project](../concepts/ai-resources.md#organize-work-in-projects-for-customization). But this view doesn't include costs for all resources that you use in an Azure AI Studio project.
106+
1. Expand the **Resource** column to see the costs for each service that's underlying your [Azure AI project](../concepts/ai-resources.md#organize-work-in-projects-for-customization). But this view doesn't include costs for all resources that you use in an Azure AI project.
107107

108108
:::image type="content" source="../media/cost-management/project-costs/costs-per-project-resource.png" alt-text="Screenshot of the Azure portal cost analysis with the Azure AI project and associated resources." lightbox="../media/cost-management/project-costs/costs-per-project-resource.png":::
109109

@@ -125,7 +125,7 @@ Here's an example of how to monitor costs for an Azure AI Studio project. The co
125125

126126
:::image type="content" source="../media/cost-management/project-costs/costs-per-project-resource-details.png" alt-text="Screenshot of the Azure portal cost analysis with Azure AI project expanded." lightbox="../media/cost-management/project-costs/costs-per-project-resource-details.png":::
127127

128-
1. Expand **contoso_ai_resource** to see the costs for services underlying the [Azure AI](../concepts/ai-resources.md#azure-ai-hub-resources) resource. You can also apply a filter to focus on other costs in your resource group.
128+
1. Expand **contoso_ai_resource** to see the costs for services underlying the [Azure AI hub](../concepts/ai-resources.md#azure-ai-hub-resources) resource. You can also apply a filter to focus on other costs in your resource group.
129129

130130
You can also view resource group costs directly from the Azure portal. To do so:
131131
1. Sign in to [Azure portal](https://portal.azure.com).

articles/ai-studio/how-to/generate-data-qa.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-ai-studio
77
ms.custom:
88
- ignite-2023
99
ms.topic: how-to
10-
ms.date: 11/15/2023
10+
ms.date: 2/6/2024
1111
ms.reviewer: eur
1212
ms.author: eur
1313
author: eric-urban
@@ -124,7 +124,7 @@ print(f"Tokens used: {result['token_usage']}")
124124

125125
## Using the generated data in prompt flow
126126

127-
One of the features of prompt flow is the ability to test and evaluate your flows on batch of inputs. This approach is useful for checking the quality and performance of your flows before deploying them. To use this feature, you need to provide the data in a specific (.jsonl) format that prompt flow can understand. We prepare this data from the questions and answers that we have generated in [Generate data from text](#generate-data-from-text) step. We use this data for batch run and flow evaluation.
127+
One of the features of [prompt flow](./prompt-flow.md) is the ability to test and [evaluate your flows](./evaluate-flow-results.md) with a batch of inputs. This approach is useful for checking the quality and performance of your flows before deploying them. To use this feature, you need to provide the data in a specific (.jsonl) format that prompt flow can understand. Now prepare this data from the questions and answers that we generated in [Generate data from text](#generate-data-from-text) step. We use this data for batch run and flow evaluation.
128128

129129
### Format and save the generated data
130130

@@ -156,7 +156,7 @@ data_df.to_json(output_file, lines=True, orient="records")
156156

157157
### Use the data for evaluation
158158

159-
To use the "generated_qa.jsonl" file for evaluation, you need to add this file as data to your evaluation flow. Go to a flow in Azure AI Studio and select **Evaluate**.
159+
To use the `generated_qa.jsonl` file for evaluation, you need to add this file as data to your evaluation flow. Go to a flow in Azure AI Studio and select **Evaluate**.
160160

161161
1. Enter details in **Basic Settings**
162162
2. Select **Add new data** from **Batch run settings**.

articles/ai-studio/how-to/index-add.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -116,9 +116,9 @@ If the Azure AI hub resource the project uses was created through Azure portal:
116116

117117
## Use an index in prompt flow
118118

119-
1. Open your AI Studio project
120-
1. In Flows, create a new Flow or open an existing flow
121-
1. On the top menu of the flow designer, select **More tools**, and then select ***Index Lookup***
119+
1. Open your AI Studio project.
120+
1. In **Flows**, create a new flow or open an existing flow.
121+
1. On the top menu of the flow designer, select **More tools**, and then select ***Index Lookup***.
122122

123123
:::image type="content" source="../media/index-retrieve/index-lookup-tool.png" alt-text="Screenshot of Vector index Lookup from More Tools." lightbox="../media/index-retrieve/index-lookup-tool.png":::
124124

articles/ai-studio/how-to/prompt-flow-tools/faiss-index-lookup-tool.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ The following are available input parameters:
4242

4343
## Outputs
4444

45-
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by promptflow-vectordb SDK. For the Faiss Index Search, the following fields are populated:
45+
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by the `promptflow-vectordb` SDK. For the Faiss Index Search, the following fields are populated:
4646

4747
| Field Name | Type | Description |
4848
| ---- | ---- | ----------- |

articles/ai-studio/how-to/prompt-flow-tools/index-lookup-tool.md

Lines changed: 6 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -34,12 +34,13 @@ The following are available input parameters:
3434

3535
| Name | Type | Description | Required |
3636
| ---- | ---- | ----------- | -------- |
37-
| mlindex_content | string | Type of Index to be used. Input depends on Index type. Example of an Azure Cog Search Index JSON can be seen below the table* | Yes |
38-
| queries | string, Union[string, List[String]] | The text to be queried.| Yes |
39-
|query_type | string | The type of query to be performed. Options include Keyword, Semantic, Hybrid, etc. | Yes |
37+
| mlindex_content | string | Type of index to be used. Input depends on the index type. An example of an Azure AI Search index JSON can be seen below the table. | Yes |
38+
| queries | string, `Union[string, List[String]]` | The text to be queried.| Yes |
39+
|query_type | string | The type of query to be performed. Options include Keyword, Semantic, Hybrid, and others. | Yes |
4040
| top_k | integer | The count of top-scored entities to return. Default value is 3. | No |
4141

42-
\**ACS JSON Example:*
42+
Here's an example of an Azure AI Search index input.
43+
4344
```json
4445
embeddings:
4546
api_base: <api_base>
@@ -68,14 +69,11 @@ index:
6869
index: <index_name>
6970
kind: acs
7071
semantic_configuration_name: azureml-default
71-
72-
73-
7472
```
7573

7674
## Outputs
7775

78-
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by promptflow-vectordb SDK. For the Vector Index Search, the following fields are populated:
76+
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by the `promptflow-vectordb` SDK. For the Vector Index Search, the following fields are populated:
7977

8078
| Field Name | Type | Description |
8179
| ---- | ---- | ----------- |

articles/ai-studio/how-to/prompt-flow-tools/prompt-flow-tools-overview.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: Learn about prompt flow tools that are available in Azure AI Studio
55
manager: nitinme
66
ms.service: azure-ai-studio
77
ms.topic: overview
8-
ms.date: 12/6/2023
8+
ms.date: 2/6/2024
99
ms.reviewer: keli19
1010
ms.author: lagayhar
1111
author: lgayhardt
@@ -35,7 +35,7 @@ To discover more custom tools developed by the open-source community, see [More
3535
## Remarks
3636
- If existing tools don't meet your requirements, you can [develop your own custom tool and make a tool package](https://microsoft.github.io/promptflow/how-to-guides/develop-a-tool/create-and-use-tool-package.html).
3737
- To install the custom tools, if you are using the automatic runtime, you can readily install the package by adding the custom tool package name into the `requirements.txt` file in the flow folder. Then select the **Save and install** button to start installation. After completion, you can see the custom tools displayed in the tool list. To learn more, see [How to create and manage a runtime](../create-manage-runtime.md).
38-
:::image type="content" source="./media/prompt-flow-tools-overview/install-package-on-automatic-runtime.png" alt-text="Screenshot of how to install packages on automatic runtime."lightbox = "./media/prompt-flow-tools-overview/install-package-on-automatic-runtime.png":::
38+
:::image type="content" source="../../media/prompt-flow/install-package-on-automatic-runtime.png" alt-text="Screenshot of how to install packages on automatic runtime."lightbox = "../../media/prompt-flow/install-package-on-automatic-runtime.png":::
3939

4040
## Next steps
4141

articles/ai-studio/how-to/prompt-flow-tools/python-tool.md

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ manager: nitinme
66
ms.service: azure-ai-studio
77
ms.custom: ignite-2023, devx-track-python
88
ms.topic: how-to
9-
ms.date: 11/15/2023
9+
ms.date: 2/6/2024
1010
ms.reviewer: keli19
1111
ms.author: lagayhar
1212
author: lgayhardt
@@ -112,19 +112,19 @@ If you're developing a python tool that requires calling external services with
112112
Create a custom connection that stores all your LLM API KEY or other required credentials.
113113

114114
1. Go to Prompt flow in your workspace, then go to **connections** tab.
115-
2. Select **Create** and select **Custom**.
116-
3. In the right panel, you can define your connection name, and you can add multiple *Key-value pairs* to store your credentials and keys by selecting **Add key-value pairs**.
117-
4. Besides your key value pairs, please also add following extra meta data to the connection:
118-
- azureml.flow.connection_type: Custom
119-
- azureml.flow.module: promptflow.connections
120-
121-
:::image type="content" source="./media/python-tool/custom-connection-meta.png" alt-text="Screenshot that shows add extra meta to custom connection in AI Studio." lightbox = "./media/python-tool/custom-connection-meta.png":::
115+
1. Select **Create** and select **Custom**.
116+
1. In the right panel, you can define your connection name, and you can add multiple *Key-value pairs* to store your credentials and keys by selecting **Add key-value pairs**.
117+
118+
> [!NOTE]
119+
> Make sure at least one key-value pair is set as secret, otherwise the connection will not be created successfully. You can set one Key-Value pair as secret by **is secret** checked, which will be encrypted and stored in your key value.
122120

121+
1. Add the following custom keys to the connection:
122+
- `azureml.flow.connection_type`: `Custom`
123+
- `azureml.flow.module`: `promptflow.connections`
123124

124-
> [!NOTE]
125-
> - You can set one Key-Value pair as secret by **is secret** checked, which will be encrypted and stored in your key value.
126-
> - Make sure at least one key-value pair is set as secret, otherwise the connection will not be created successfully.
125+
:::image type="content" source="../../media/prompt-flow/custom-connection-keys.png" alt-text="Screenshot that shows add extra meta to custom connection in AI Studio." lightbox = "../../media/prompt-flow/custom-connection-keys.png":::
127126

127+
128128

129129
### Consume custom connection in Python
130130

articles/ai-studio/how-to/prompt-flow-tools/serp-api-tool.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-ai-studio
77
ms.custom:
88
- ignite-2023
99
ms.topic: how-to
10-
ms.date: 11/15/2023
10+
ms.date: 2/6/2024
1111
ms.reviewer: keli19
1212
ms.author: lagayhar
1313
author: lgayhardt
@@ -29,12 +29,12 @@ Create a Serp connection:
2929
1. Sign in to [Azure AI Studio](https://studio.azureml.net/).
3030
1. Go to **Settings** > **Connections**.
3131
1. Select **+ New connection**.
32-
1. Create a custom connection with the following details:
33-
- azureml.flow.connection_type: Serp
34-
- azureml.flow.module: promptflow.connections
35-
- api_key: Your_Serp_API_key, please mark it as a secret.
32+
1. Add the following custom keys to the connection:
33+
- `azureml.flow.connection_type`: `Custom`
34+
- `azureml.flow.module`: `promptflow.connections`
35+
- `api_key`: Your_Serp_API_key. You must check the **is secret** checkbox to keep the API key secure.
3636

37-
:::image type="content" source="./media/serp-api-tool/serp-connection-meta.png" alt-text="Screenshot that shows add extra meta to custom connection in AI Studio." lightbox = "./media/serp-api-tool/serp-connection-meta.png":::
37+
:::image type="content" source="../../media/prompt-flow/serp-custom-connection-keys.png" alt-text="Screenshot that shows add extra meta to custom connection in AI Studio." lightbox = "../../media/prompt-flow/serp-custom-connection-keys.png":::
3838

3939
The connection is the model used to establish connections with Serp API. Get your API key from the SerpAPI account dashboard.
4040

articles/ai-studio/how-to/prompt-flow-tools/vector-db-lookup-tool.md

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-ai-studio
77
ms.custom:
88
- ignite-2023
99
ms.topic: how-to
10-
ms.date: 11/15/2023
10+
ms.date: 2/6/2024
1111
ms.reviewer: keli19
1212
ms.author: lagayhar
1313
author: lgayhardt
@@ -50,23 +50,22 @@ The tool searches data from a third-party vector database. To use it, you should
5050
:::image type="content" source="../../media/prompt-flow/vector-db-lookup-tool.png" alt-text="Screenshot of the Vector DB Lookup tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/embedding-tool.png":::
5151

5252
1. Select the connection to one of your provisioned resources. For example, select **CognitiveSearchConnection**.
53-
1. Enter values for the Vector DB Lookup tool input parameters described [here](#inputs-and-outputs).
53+
1. Enter values for the Vector DB Lookup tool input parameters described [here](#inputs).
5454
1. Add more tools to your flow as needed, or select **Run** to run the flow.
55-
1. The outputs are described [here](#inputs-and-outputs).
55+
1. The outputs are described [here](#outputs).
5656

5757

58-
## Inputs and outputs
58+
## Inputs
5959

6060
The tool accepts the following inputs:
6161
- [Azure AI Search](#azure-ai-search)
6262
- [Qdrant](#qdrant)
6363
- [Weaviate](#weaviate)
6464

65-
The JSON output includes the top-k scored entities. The entity follows a generic schema of vector search result provided by promptflow-vectordb SDK.
6665

6766
## Outputs
6867

69-
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by promptflow-vectordb SDK.
68+
The JSON output includes the top-k scored entities. The entity follows a generic schema of vector search result provided by the promptflow-vectordb SDK.
7069

7170

7271
### Azure AI Search

articles/ai-studio/how-to/prompt-flow-tools/vector-index-lookup-tool.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ The following are available input parameters:
4343

4444
## Outputs
4545

46-
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by promptflow-vectordb SDK. For the Vector Index Search, the following fields are populated:
46+
The following JSON format response is an example returned by the tool that includes the top-k scored entities. The entity follows a generic schema of vector search result provided by the `promptflow-vectordb` SDK. For the Vector Index Search, the following fields are populated:
4747

4848
| Field Name | Type | Description |
4949
| ---- | ---- | ----------- |

0 commit comments

Comments
 (0)