Skip to content

Commit cfeaad8

Browse files
committed
Resolve merge conflicts
2 parents becdf2b + a5f44d0 commit cfeaad8

File tree

923 files changed

+13696
-11811
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

923 files changed

+13696
-11811
lines changed

.openpublishing.redirection.json

Lines changed: 135 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,11 @@
1515
"redirect_url": "/azure/search/search-how-to-dotnet-sdk",
1616
"redirect_document_id": false
1717
},
18+
{
19+
"source_path_from_root": "/articles/ai-services/agents/how-to/tools/overview.md",
20+
"redirect_url": "/azure/ai-services/agents/overview",
21+
"redirect_document_id": false
22+
},
1823
{
1924
"source_path_from_root": "/articles/search/search-howto-index-csv-blobs.md",
2025
"redirect_url": "/azure/search/search-how-to-index-csv-blobs",
@@ -25,10 +30,140 @@
2530
"redirect_url": "/azure/search/search-how-to-large-index",
2631
"redirect_document_id": false
2732
},
33+
{
34+
"source_path_from_root": "/articles/ai-services/agents/concepts/agents.md",
35+
"redirect_url": "/azure/ai-services/agents/overview",
36+
"redirect_document_id": false
37+
},
2838
{
2939
"source_path_from_root": "/articles/ai-services/openai/how-to/use-your-data-securely.md",
3040
"redirect_url": "/azure/ai-services/openai/how-to/on-your-data-configuration",
3141
"redirect_document_id": false
42+
},
43+
{
44+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/concepts/data-formats.md",
45+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
46+
"redirect_document_id": false
47+
},
48+
{
49+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/concepts/entity-components.md",
50+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
51+
"redirect_document_id": false
52+
},
53+
{
54+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/concepts/evaluation-metrics.md",
55+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
56+
"redirect_document_id": false
57+
},
58+
{
59+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/call-api.md",
60+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
61+
"redirect_document_id": false
62+
},
63+
{
64+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/create-project.md",
65+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
66+
"redirect_document_id": false
67+
},
68+
{
69+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/deploy-model.md",
70+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
71+
"redirect_document_id": false
72+
},
73+
{
74+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/design-schema.md",
75+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
76+
"redirect_document_id": false
77+
},
78+
{
79+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/fail-over.md",
80+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
81+
"redirect_document_id": false
82+
},
83+
{
84+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/label-data.md",
85+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
86+
"redirect_document_id": false
87+
},
88+
{
89+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/train-model.md",
90+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
91+
"redirect_document_id": false
92+
},
93+
{
94+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/how-to/view-model-evaluation.md",
95+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
96+
"redirect_document_id": false
97+
},
98+
{
99+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/language-support.md",
100+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
101+
"redirect_document_id": false
102+
},
103+
{
104+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/overview.md",
105+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
106+
"redirect_document_id": false
107+
},
108+
{
109+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/quickstart.md",
110+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
111+
"redirect_document_id": false
112+
},
113+
{
114+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/reference/glossary.md",
115+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
116+
"redirect_document_id": false
117+
},
118+
{
119+
"source_path_from_root": "/articles/ai-services/language-service/custom-text-analytics-for-health/reference/service-limits.md",
120+
"redirect_url": "/azure/ai-services/language-service/text-analytics-for-health/overview",
121+
"redirect_document_id": false
122+
},
123+
{
124+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/concepts/data-formats.md",
125+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
126+
"redirect_document_id": false
127+
},
128+
{
129+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/call-api.md",
130+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
131+
"redirect_document_id": false
132+
},
133+
{
134+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/create-project.md",
135+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
136+
"redirect_document_id": false
137+
},
138+
{
139+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/deploy-model.md",
140+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
141+
"redirect_document_id": false
142+
},
143+
{
144+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/design-schema.md",
145+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
146+
"redirect_document_id": false
147+
},
148+
{
149+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/label-data.md",
150+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
151+
"redirect_document_id": false
152+
},
153+
{
154+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/how-to/train-model.md",
155+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
156+
"redirect_document_id": false
157+
},
158+
{
159+
"source_path_from_root": "/articles/ai-services/language-service/sentiment-opinion-mining/custom/quickstart.md",
160+
"redirect_url": "/azure/ai-services/language-service/sentiment-opinion-mining/overview",
161+
"redirect_document_id": false
162+
},
163+
{
164+
"source_path_from_root": "/articles/ai-services/openai/references/azure-machine-learning.md",
165+
"redirect_url": "/azure/ai-services/openai/concepts/use-your-data",
166+
"redirect_document_id": false
32167
}
33168
]
34169
}

.whatsnew.json

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
{
2+
"$schema": "https://whatsnewapi.azurewebsites.net/schema",
3+
"docSetProductName": "Azure AI Services",
4+
"rootDirectory": "articles/",
5+
"docLinkSettings": {
6+
"linkFormat": "relative",
7+
"relativeLinkPrefix": "../"
8+
},
9+
"navigationOptions": {
10+
"maximumNumberOfArticles": 5,
11+
"tocParentNode": "Latest documentation updates",
12+
"repoTocFolder": "articles/ai-services",
13+
"indexParentNode": "Latest documentation updates",
14+
"repoIndexFolder": "articles/ai-services"
15+
},
16+
"areas": [
17+
{
18+
"names": [ "ai-services" ],
19+
"heading": "Azure AI Services"
20+
},
21+
{
22+
"names": [ "ai-studio" ],
23+
"heading": "Azure AI Foundry"
24+
},
25+
{
26+
"names": [ "machine-learning" ],
27+
"heading": "Azure Machine Learning"
28+
},
29+
{
30+
"names": [ "search" ],
31+
"heading": "Azure AI Search"
32+
33+
}
34+
]
35+
}

articles/ai-foundry/model-inference/breadcrumb/toc.yml

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,10 +2,10 @@
22
tocHref: /azure/
33
topicHref: /azure/index
44
items:
5-
- name: Azure AI services
6-
tocHref: /azure/ai-services/
7-
topicHref: /azure/ai-services/index
5+
- name: AI Foundry
6+
tocHref: /azure/ai-foundry/
7+
topicHref: /azure/ai-studio/index
88
items:
9-
- name: Azure AI Model Inference
10-
tocHref: /azure/ai-foundry/
9+
- name: Model Inference
10+
tocHref: /azure/ai-foundry/model-inference/
1111
topicHref: /azure/ai-foundry/model-inference/index

articles/ai-foundry/model-inference/concepts/deployment-types.md

Lines changed: 19 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
title: Understanding deployment types in Azure AI model inference
33
titleSuffix: Azure AI Foundry
44
description: Learn how to use deployment types in Azure AI model deployments
5-
author: mrbullwinkle
5+
author: santiagxf
66
manager: nitinme
77
ms.service: azure-ai-model-inference
88
ms.topic: how-to
@@ -13,43 +13,36 @@ ms.custom: ignite-2024, github-universe-2024
1313

1414
# Deployment types in Azure AI model inference
1515

16-
Azure AI model inference in Azure AI services provides customers with choices on the hosting structure that fits their business and usage patterns. The service offers two main types of deployment: **standard** and **provisioned**. Standard is offered with a global deployment option, routing traffic globally to provide higher throughput. Provisioned is also offered with a global deployment option, allowing customers to purchase and deploy provisioned throughput units across Azure global infrastructure.
16+
Azure AI model inference makes models available using the *model deployment* concept in Azure AI Services resources. *Model deployments* are also Azure resources and, when created, they give access to a given model under certain configurations. Such configuration includes the infrastructure require to process the requests.
1717

18-
All deployments can perform the exact same inference operations, however the billing, scale, and performance are substantially different. As part of your solution design, you need to make two key decisions:
18+
Azure AI model inference provides customers with choices on the hosting structure that fits their business and usage patterns. Those options are translated to different deployments types (or SKUs) that are available at model deployment time in the Azure AI Services resource.
1919

20-
- **Data residency needs**: global vs. regional resources
21-
- **Call volume**: standard vs. provisioned
20+
:::image type="content" source="../media/add-model-deployments/models-deploy-deployment-type.png" alt-text="Screenshot showing how to customize the deployment type for a given model deployment." lightbox="../media/add-model-deployments/models-deploy-deployment-type.png":::
2221

23-
Deployment types support varies by model and model provider. You can see which deployment type (SKU) each model supports in the [Models section](models.md).
22+
Different model providers offer different deployments SKUs that you can select from. When selecting a deployment type, consider your **data residency needs** and **call volume/capacity** requirements.
2423

25-
## Global versus regional deployment types
24+
## Deployment types for Azure OpenAI models
2625

27-
For standard and provisioned deployments, you have an option of two types of configurations within your resource – **global** or **regional**. Global standard is the recommended starting point.
26+
The service offers two main types of deployments: **standard** and **provisioned**. For a given deployment type, customers can align their workloads with their data processing requirements by choosing an Azure geography (`Standard` or `Provisioned-Managed`), Microsoft specified data zone (`DataZone-Standard` or `DataZone Provisioned-Managed`), or Global (`Global-Standard` or `Global Provisioned-Managed`) processing options.
2827

29-
Global deployments leverage Azure's global infrastructure, dynamically route customer traffic to the data center with best availability for the customer's inference requests. This means you get the highest initial throughput limits and best model availability with Global while still providing our uptime SLA and low latency. For high volume workloads above the specified usage tiers on standard and global standard, you may experience increased latency variation. For customers that require the lower latency variance at large workload usage, we recommend purchasing provisioned throughput.
28+
To learn more about deployment options for Azure OpenAI models see [Azure OpenAI documentation](../../../ai-services/openai/how-to/deployment-types.md).
3029

31-
Our global deployments are the first location for all new models and features. Customers with large throughput requirements should consider our provisioned deployment offering.
30+
## Deployment types for Models-as-a-Service models
3231

33-
## Standard
32+
Models from third-party model providers with pay-as-you-go billing (collectively called Models-as-a-Service), makes models available in Azure AI model inference under **standard** deployments with a Global processing option (`Global-Standard`).
3433

35-
Standard deployments provide a pay-per-call billing model on the chosen model. Provides the fastest way to get started as you only pay for what you consume. Models available in each region and throughput may be limited.
34+
### Global-Standard
3635

37-
Standard deployments are optimized for low to medium volume workloads with high burstiness. Customers with high consistent volume may experience greater latency variability.
36+
Global deployments leverage Azure's global infrastructure to dynamically route traffic to the data center with best availability for each request. Global standard provides the highest default quota and eliminates the need to load balance across multiple resources. Data stored at rest remains in the designated Azure geography, while data may be processed for inferencing in any Azure location. Learn more about [data residency](https://azure.microsoft.com/explore/global-infrastructure/data-residency/).
3837

39-
Only Azure OpenAI models support this deployment type.
38+
> [!NOTE]
39+
> Models-as-a-Service offers regional deployment options under [Serverless API endpoints](../../../ai-studio/how-to/deploy-models-serverless.md) in Azure AI Foundry. Prompts and outputs are processed within the geography specified during deployment. However, those deployments can't be accessed using the Azure AI model inference endpoint in Azure AI Services.
4040
41-
## Global standard
41+
## Control deployment options
4242

43-
Global deployments are available in the same Azure AI services resources as non-global deployment types but allow you to leverage Azure's global infrastructure to dynamically route traffic to the data center with best availability for each request. Global standard provides the highest default quota and eliminates the need to load balance across multiple resources.
43+
Administrators can control which model deployment types are available to their users by using Azure Policies. Learn more about [How to control AI model deployment with custom policies](../../../ai-studio/how-to/custom-policy-model-deployment.md).
4444

45-
Customers with high consistent volume may experience greater latency variability. The threshold is set per model. For applications that require the lower latency variance at large workload usage, we recommend purchasing provisioned throughput if available.
45+
## Related content
4646

47-
## Global provisioned
48-
49-
Global deployments are available in the same Azure AI services resources as non-global deployment types but allow you to leverage Azure's global infrastructure to dynamically route traffic to the data center with best availability for each request. Global provisioned deployments provide reserved model processing capacity for high and predictable throughput using Azure global infrastructure.
50-
51-
Only Azure OpenAI models support this deployment type.
52-
53-
## Next steps
54-
55-
- [Quotas & limits](../quotas-limits.md)
47+
- [Quotas & limits](../quotas-limits.md)
48+
- [Data privacy, and security for Models-as-a-Service models](../../../ai-studio/how-to/concept-data-privacy.md)

articles/ai-foundry/model-inference/concepts/endpoints.md

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
title: Model inference endpoint in Azure AI services
33
titleSuffix: Azure AI Foundry
44
description: Learn about the model inference endpoint in Azure AI services
5-
author: mrbullwinkle
5+
author: santiagxf
66
manager: nitinme
77
ms.service: azure-ai-model-inference
88
ms.topic: how-to
@@ -38,7 +38,11 @@ To learn more about how to create deployments see [Add and configure model deplo
3838

3939
## Azure AI inference endpoint
4040

41-
The Azure AI inference endpoint allows customers to use a single endpoint with the same authentication and schema to generate inference for the deployed models in the resource. This endpoint follows the [Azure AI model inference API](../../../ai-studio/reference/reference-model-inference-api.md) which all the models in Azure AI model inference support.
41+
The Azure AI inference endpoint allows customers to use a single endpoint with the same authentication and schema to generate inference for the deployed models in the resource. This endpoint follows the [Azure AI model inference API](.././reference/reference-model-inference-api.md) which all the models in Azure AI model inference support. It support the following modalidities:
42+
43+
* Text embeddings
44+
* Image embeddings
45+
* Chat completions
4246

4347
You can see the endpoint URL and credentials in the **Overview** section:
4448

@@ -84,4 +88,4 @@ The Azure OpenAI endpoint is supported by the **OpenAI SDK (`AzureOpenAI` class)
8488
## Next steps
8589

8690
- [Models](models.md)
87-
- [Deployment types](deployment-types.md)
91+
- [Deployment types](deployment-types.md)

0 commit comments

Comments
 (0)