Skip to content

Commit 90befd6

Browse files
authored
Merge pull request #308 from MicrosoftDocs/main
Publish to live, Tuesday 4 AM PST, 9/17
2 parents 135d681 + 30915dd commit 90befd6

File tree

5 files changed

+32
-11
lines changed

5 files changed

+32
-11
lines changed

articles/ai-services/custom-vision-service/overview.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,8 +18,7 @@ keywords: image recognition, image identifier, image recognition app, custom vis
1818

1919
Azure AI Custom Vision is an image recognition service that lets you build, deploy, and improve your own **image identifier** models. An image identifier applies labels to images, according to their visual characteristics. Each label represents a classification or object. Custom Vision allows you to specify your own labels and train custom models to detect them.
2020

21-
> [!TIP]
22-
> The Azure AI vision Image Analysis API, based on Florence foundational model, now supports custom models with few-shot learning capability. [Use Image Analysis 4.0](../computer-vision/how-to/model-customization.md) to create custom image identifier models using the latest technology from Azure. To migrate a Custom Vision project to the new Image Analysis 4.0 system, see the [Migration guide](../computer-vision/how-to/migrate-from-custom-vision.md). To compare the two services, see the [Comparison page](./concepts/compare-alternatives.md).
21+
2322

2423

2524
You can use Custom Vision through a client library SDK, REST API, or through the [Custom Vision web portal](https://customvision.ai/). Follow a quickstart to get started.

articles/ai-services/openai/includes/fine-tuning-studio.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,9 +65,9 @@ Different model types require a different format of training data.
6565

6666
# [chat completion models](#tab/turbo)
6767

68-
The training and validation data you use **must** be formatted as a JSON Lines (JSONL) document. For `gpt-35-turbo-0613` the fine-tuning dataset must be formatted in the conversational format that is used by the [Chat completions](../how-to/chatgpt.md) API.
68+
The training and validation data you use **must** be formatted as a JSON Lines (JSONL) document. For `gpt-35-turbo` (all versions), `gpt-4`, `gpt-4o`, and `gpt-4o-mini`, the fine-tuning dataset must be formatted in the conversational format that is used by the [Chat completions](../how-to/chatgpt.md) API.
6969

70-
If you would like a step-by-step walk-through of fine-tuning a `gpt-35-turbo-0613` model please refer to the [Azure OpenAI fine-tuning tutorial.](../tutorials/fine-tune.md)
70+
If you would like a step-by-step walk-through of fine-tuning a `gpt-4o-mini` (2024-07-18) model please refer to the [Azure OpenAI fine-tuning tutorial.](../tutorials/fine-tune.md)
7171

7272
### Example file format
7373

200 KB
Loading

articles/ai-services/openai/tutorials/fine-tune.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -755,7 +755,7 @@ This command isn't available in the 0.28.1 OpenAI Python library. Upgrade to the
755755
{
756756
"id": "ftchkpt-148ab69f0a404cf9ab55a73d51b152de",
757757
"created_at": 1715743077,
758-
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-372c72db22c34e6f9ccb62c26ee0fbd9",
758+
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-0e208cf33a6a466994aff31a08aba678",
759759
"fine_tuning_job_id": "ftjob-372c72db22c34e6f9ccb62c26ee0fbd9",
760760
"metrics": {
761761
"full_valid_loss": 1.8258173013035255,
@@ -772,7 +772,7 @@ This command isn't available in the 0.28.1 OpenAI Python library. Upgrade to the
772772
{
773773
"id": "ftchkpt-e559c011ecc04fc68eaa339d8227d02d",
774774
"created_at": 1715743013,
775-
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-372c72db22c34e6f9ccb62c26ee0fbd9:ckpt-step-90",
775+
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-0e208cf33a6a466994aff31a08aba678:ckpt-step-90",
776776
"fine_tuning_job_id": "ftjob-372c72db22c34e6f9ccb62c26ee0fbd9",
777777
"metrics": {
778778
"full_valid_loss": 1.7958603267428241,
@@ -789,7 +789,7 @@ This command isn't available in the 0.28.1 OpenAI Python library. Upgrade to the
789789
{
790790
"id": "ftchkpt-8ae8beef3dcd4dfbbe9212e79bb53265",
791791
"created_at": 1715742984,
792-
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-372c72db22c34e6f9ccb62c26ee0fbd9:ckpt-step-80",
792+
"fine_tuned_model_checkpoint": "gpt-4o-mini-2024-07-18.ft-0e208cf33a6a466994aff31a08aba678:ckpt-step-80",
793793
"fine_tuning_job_id": "ftjob-372c72db22c34e6f9ccb62c26ee0fbd9",
794794
"metrics": {
795795
"full_valid_loss": 1.6909511662736725,
@@ -850,7 +850,7 @@ Alternatively, you can deploy your fine-tuned model using any of the other commo
850850
| resource_group | The resource group name for your Azure OpenAI resource |
851851
| resource_name | The Azure OpenAI resource name |
852852
| model_deployment_name | The custom name for your new fine-tuned model deployment. This is the name that will be referenced in your code when making chat completion calls. |
853-
| fine_tuned_model | Retrieve this value from your fine-tuning job results in the previous step. It will look like `gpt-4o-mini-2024-07-18.ft-b044a9d3cf9c4228b5d393567f693b83`. You'll need to add that value to the deploy_data json. |
853+
| fine_tuned_model | Retrieve this value from your fine-tuning job results in the previous step. It will look like `gpt-4o-mini-2024-07-18.ft-0e208cf33a6a466994aff31a08aba678`. You'll need to add that value to the deploy_data json. |
854854

855855
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md)]
856856

@@ -874,7 +874,7 @@ deploy_data = {
874874
"properties": {
875875
"model": {
876876
"format": "OpenAI",
877-
"name": "<YOUR_FINE_TUNED_MODEL>", #retrieve this value from the previous call, it will look like gpt-4o-mini-2024-07-18.ft-b044a9d3cf9c4228b5d393567f693b83
877+
"name": "<YOUR_FINE_TUNED_MODEL>", #retrieve this value from the previous call, it will look like gpt-4o-mini-2024-07-18.ft-0e208cf33a6a466994aff31a08aba678
878878
"version": "1"
879879
}
880880
}
@@ -894,7 +894,7 @@ print(r.json())
894894

895895
You can check on your deployment progress in the Azure OpenAI Studio:
896896

897-
:::image type="content" source="../media/tutorials/fine-tuning/status.png" alt-text="Screenshot of the initial DataFrame table results from the CSV file." lightbox="../media/tutorials/fine-tuning/status.png":::
897+
:::image type="content" source="../media/tutorials/fine-tuning/studio-deployment-status.png" alt-text="Screenshot of Deployment progress on Azure OpenAI Studio." lightbox="../media/tutorials/fine-tuning/studio-deployment-status.png":::
898898

899899
It isn't uncommon for this process to take some time to complete when dealing with deploying fine-tuned models.
900900

@@ -968,7 +968,7 @@ You can delete the deployment in [Azure OpenAI Studio](https://oai.azure.com/),
968968

969969
## Troubleshooting
970970

971-
### How do I enable fine-tuning? Create a custom model is greyed out in Azure OpenAI Studio?
971+
### How do I enable fine-tuning? Create a custom model is grayed out in Azure OpenAI Studio
972972

973973
In order to successfully access fine-tuning you need **Cognitive Services OpenAI Contributor assigned**. Even someone with high-level Service Administrator permissions would still need this account explicitly set in order to access fine-tuning. For more information please review the [role-based access control guidance](/azure/ai-services/openai/how-to/role-based-access-control#cognitive-services-openai-contributor).
974974

articles/search/search-get-started-rag.md

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -272,6 +272,28 @@ This section uses Visual Studio Code and Python to call the chat completion APIs
272272

273273
You might also try the query without semantic ranking by setting `use_semantic_reranker=False` in the query parameters step. Semantic ranking can noticably improve the relevance of query results and the ability of the LLM to return useful information. Experimentation can help you decide whether it makes a difference for your content.
274274

275+
## Troubleshooting errors
276+
277+
To debug authentication errors, insert the following code before the step that calls the search engine and the LLM.
278+
279+
```python
280+
import sys
281+
import logging # Set the logging level for all azure-storage-* libraries
282+
logger = logging.getLogger('azure.identity')
283+
logger.setLevel(logging.DEBUG)
284+
285+
handler = logging.StreamHandler(stream=sys.stdout)
286+
formatter = logging.Formatter('[%(levelname)s %(name)s] %(message)s')
287+
handler.setFormatter(formatter)
288+
logger.addHandler(handler)
289+
```
290+
291+
Rerun the query script. You should now get INFO and DEBUG statements in the output that provide more detail about the issue.
292+
293+
If you see output messages related to ManagedIdentityCredential and token acquisition failures, it could be that you have multiple tenants, and your Azure sign-in is using a tenant that doesn't have your search service. To get your tenant ID, search the Azure portal for "tenant properties".
294+
295+
Run `az login --tenant <YOUR-TENANT-ID>` at a command prompt, and then rerun the script.
296+
275297
## Clean up
276298

277299
When you're working in your own subscription, it's a good idea at the end of a project to identify whether you still need the resources you created. Resources left running can cost you money. You can delete resources individually or delete the resource group to delete the entire set of resources.

0 commit comments

Comments
 (0)