You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Removed first-person references (where possible), added code snippets, added notes about lab pre-requisites and how to get into a state to run labs individually.
Copy file name to clipboardExpand all lines: 00_Introduction/README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,4 +18,4 @@ The future of software involves combining AI and data services, also known as in
18
18
19
19
## Introduction
20
20
21
-
This guide will walk you through the creating intelligent solutions that combines vCore-based Azure Cosmos DB for MongoDB vector search and document retrieval with Azure OpenAI services to build a chat bot experience. The guide includes labs that build and deploy a sample chat app using these technologies, with a focus on vCore-based Azure Cosmos DB for MongoDB, Vector Search, and Azure OpenAI using the Python programming language. For those new to using Azure OpenAI and Vector Search technologies, the guide includes explanations of the core concepts and techniques used when implementing these technologies.
21
+
This guide will walks through the creating intelligent solutions that combines vCore-based Azure Cosmos DB for MongoDB vector search and document retrieval with Azure OpenAI services to build a chat bot experience. The guide includes labs that build and deploy a sample chat app using these technologies, with a focus on vCore-based Azure Cosmos DB for MongoDB, Vector Search, and Azure OpenAI using the Python programming language. For those new to using Azure OpenAI and Vector Search technologies, the guide includes explanations of the core concepts and techniques used when implementing these technologies.
Copy file name to clipboardExpand all lines: 01_Azure_Overview/README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -99,7 +99,7 @@ Launch the Cloud Shell in a browser at [https://shell.azure.com](https://shell.a
99
99
100
100
#### PowerShell Module
101
101
102
-
The Azure portal and Windows PowerShell can be used for managing Azure Cosmos DB for Mongo DB API. To get started with Azure PowerShell, install the [Azure PowerShell cmdlets](https://learn.microsoft.com/en-us/powershell/module/az.cosmosdb/) for Cosmos DB with the following PowerShell command in an administrator-level PowerShell window:
102
+
The Azure portal and Windows PowerShell can be used for managing Azure Cosmos DB for Mongo DB API. To get started with Azure PowerShell, install the [Azure PowerShell cmdlets](https://learn.microsoft.com/powershell/module/az.cosmosdb/) for Cosmos DB with the following PowerShell command in an administrator-level PowerShell window:
[Azure Cosmos DB](https://learn.microsoft.com/en-us/azure/cosmos-db/introduction) is a globally distributed, multi-model database service that enables you to query and store data using NoSQL models using one of five APIs: SQL (document database), Cassandra (column-family), MongoDB (document database), Azure Table, and Gremlin (graph database). It provides turnkey global distribution, elastic scaling of throughput and storage worldwide, single-digit millisecond latencies at the 99th percentile, and guaranteed high availability with multi-homing capabilities. Azure Cosmos DB provides comprehensive service level agreements (SLAs) for throughput, latency, availability, and consistency guarantees, something not found in any other database service.
3
+
[Azure Cosmos DB](https://learn.microsoft.com/azure/cosmos-db/introduction) is a globally distributed, multi-model database service that enables querying and storing data using NoSQL models using one of five APIs: SQL (document database), Cassandra (column-family), MongoDB (document database), Azure Table, and Gremlin (graph database). It provides turnkey global distribution, elastic scaling of throughput and storage worldwide, single-digit millisecond latencies at the 99th percentile, and guaranteed high availability with multi-homing capabilities. Azure Cosmos DB provides comprehensive service level agreements (SLAs) for throughput, latency, availability, and consistency guarantees, something not found in any other database service.
4
4
5
5
## Azure Cosmos DB and AI
6
6
7
7
The surge of AI-powered applications has led to the need to integrate data from multiple data stores, introducing another layer of complexity as each data store tends to have its own workflow and operational performance. Azure Cosmos DB simplifies this process by providing a unified platform for all data types, including AI data. Azure Cosmos DB supports relational, document, vector, key-value, graph, and table data models, making it an ideal platform for AI applications. The wide array of data model support combined with guaranteed high availability, high throughput, low latency, and tunable consistency are huge advantages when building these types of applications.
8
8
9
9
## Azure Cosmos DB for Mongo DB
10
10
11
-
The focus for this developer guide is [Azure Cosmos DB for MongoDB](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/introduction). Developers can leverage their current MongoDB expertise and use their preferred MongoDB drivers, SDKs, and tools simply by directing applications to the connection string for on the Azure Cosmos DB for MongoDB account.
11
+
The focus for this developer guide is [Azure Cosmos DB for MongoDB](https://learn.microsoft.com/azure/cosmos-db/mongodb/introduction). Developers can leverage their current MongoDB expertise and use their preferred MongoDB drivers, SDKs, and tools simply by directing applications to the connection string for on the Azure Cosmos DB for MongoDB account.
12
12
13
13
### Azure Cosmos DB for Mongo DB API Architectures
14
14
15
-
The [RU architecture](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/ru/introduction) for Azure Cosmos DB for MongoDB offers instantaneous scalability with zero warmup period, automatic and transparent sharding, and 99.999% availability. It supports active-active databases across multiple regions, cost-efficient, granular, unlimited scalability, real-time analytics, and serverless deployments where you pay only per operation.
15
+
The [RU architecture](https://learn.microsoft.com/azure/cosmos-db/mongodb/ru/introduction) for Azure Cosmos DB for MongoDB offers instantaneous scalability with zero warmup period, automatic and transparent sharding, and 99.999% availability. It supports active-active databases across multiple regions, cost-efficient, granular, unlimited scalability, real-time analytics, and serverless deployments paying only per operation.
16
16
17
-
[vCore-based Azure Cosmos DB for MongoDB architecture](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/vcore/introduction) integrates AI-based applications with your data, with text indexing for easy querying. Simplify your development process with high-capacity vertical scaling and free 35-day backups with a point-in-time restore (PITR).
17
+
[vCore-based Azure Cosmos DB for MongoDB architecture](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/introduction) integrates AI-based applications with private organizational data, with text indexing for easy querying. Simplify the development process with high-capacity vertical scaling and free 35-day backups with a point-in-time restore (PITR).
18
18
19
-
The [choice between vCore and Request Units (RU)](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/choose-model) in Azure Cosmos DB for MongoDB API depends on the workload. A list of [compatibility and feature support between RU and vCore](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/vcore/compatibility) is available.
19
+
The [choice between vCore and Request Units (RU)](https://learn.microsoft.com/azure/cosmos-db/mongodb/choose-model) in Azure Cosmos DB for MongoDB API depends on the workload. A list of [compatibility and feature support between RU and vCore](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/compatibility) is available.
20
20
21
21
vCore provides predictable performance and cost and is ideal for running high-performance, mission-critical workloads with low latency and high throughput. With vCore, the number of vCPUs and the memory the database needs is configurable and can be scaled up or down as needed.
22
22
23
23
Conversely, RU is a consumption-based model that charges based on the number of operations the database performs, including reads, writes, and queries. RU is ideal for scenarios where the workload has unpredictable traffic patterns or a need to optimize cost for bursty workloads.
24
24
25
-
A steady-state workload with predictable traffic patterns is best suited for vCore since it provides more predictable performance and cost. However, RU may be a better choice if the workload has unpredictable traffic patterns or requires bursty performance since it allows you to pay only for the resources used.
25
+
A steady-state workload with predictable traffic patterns is best suited for vCore since it provides more predictable performance and cost. However, RU may be a better choice if the workload has unpredictable traffic patterns or requires bursty performance since it allows for paying only for the resources used.
26
26
27
-
>**NOTE**: AI-supporting workloads, such as vector search, must use vCore, as vector search is not supported with RU accounts.
27
+
>**NOTE**: AI-supporting workloads, such as vector search, must use the vCore architecture, as vector search is not supported with RU accounts.
Copy file name to clipboardExpand all lines: 03_Overview_Azure_OpenAI/README.md
+19-19Lines changed: 19 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,16 +22,16 @@ With Azure OpenAI, customers get the security capabilities of Microsoft Azure wh
22
22
23
23
## Azure OpenAI Data Privacy and Security
24
24
25
-
Azure OpenAI stores and processes data to provide the service and to monitor for uses that violate the applicable product terms. Azure OpenAI is fully controlled by Microsoft. Microsoft hosts the OpenAI models in Microsoft Azure for your usage of Azure OpenAI, and does not interact with any services operated by OpenAI.
25
+
Azure OpenAI stores and processes data to provide the service and to monitor for uses that violate the applicable product terms. Azure OpenAI is fully controlled by Microsoft. Microsoft hosts the OpenAI models in Microsoft Azure for the usage of Azure OpenAI, and does not interact with any services operated by OpenAI.
26
26
27
-
Here are a few important things to know in regards to the security and privacy of your prompts (inputs) and completions (outputs), your embeddings, and your training data when using Azure OpenAI:
27
+
Here are a few important things to know in regards to the security and privacy of prompts (inputs) and completions (outputs), embeddings, and training data when using Azure OpenAI:
28
28
29
29
- are NOT available to other customers.
30
30
- are NOT available to OpenAI.
31
31
- are NOT used to improve OpenAI models.
32
32
- are NOT used to improve any Microsoft or 3rd party products or services.
33
-
- are NOT used for automatically improving Azure OpenAI models for your use in your resource (The models are stateless, unless you explicitly fine-tune models with your training data).
34
-
-Your fine-tuned Azure OpenAI models are available exclusively for your use.
33
+
- are NOT used for automatically improving Azure OpenAI models for use in the deployed resource (The models are stateless, unless explicitly fine-tuning models with explicitly provided training data).
34
+
-Fine-tuned Azure OpenAI models are available exclusively for the account in which it was created.
35
35
36
36
## Azure AI Platform
37
37
@@ -52,57 +52,57 @@ Here's a list of the AI services within the [Azure AI platform](https://learn.mi
52
52
53
53
| Service | Description |
54
54
| --- | --- |
55
-
| Azure AI Search | Bring AI-powered cloud search to your mobile and web apps |
55
+
| Azure AI Search | Bring AI-powered cloud search to mobile and web apps |
56
56
| Azure OpenAI | Perform a wide variety of natural language tasks |
57
57
| Bot Service | Create bots and connect them across channels |
58
58
| Content Safety | An AI service that detects unwanted contents |
59
-
| Custom Vision | Customize image recognition to fit your business |
59
+
| Custom Vision | Customize image recognition to fit the business |
60
60
| Document Intelligence | Turn documents into usable data at a fraction of the time and cost |
61
61
| Face | Detect and identify people and emotions in images |
62
62
| Immersive Reader | Help users read and comprehend text |
63
63
| Language | Build apps with industry-leading natural language understanding capabilities |
64
64
| Machine Learning | ML professionals, data scientists, and engineers can use Azure Machine Learning in their day-to-day workflows to train and deploy models, such as those built from an open-source platform, such as PyTorch, TensorFlow, or scikit-learn |
65
65
| Speech | Speech to text, text to speech, translation and speaker recognition |
66
66
| Translator | Translate more than 100 languages and dialects |
67
-
| Video Indexer | Extract actionable insights from your videos |
67
+
| Video Indexer | Extract actionable insights from videos |
68
68
| Vision | Analyze content in images and videos |
69
69
70
70
> **Note:** Follow this link for additional tips to help in determining the which Azure AI service is most appropriate for a specific project requirement: <https://azure.microsoft.com/products/category/ai>
71
71
72
-
The tools that you will use to customize and configure models are different from those that you'll use to call the Azure AI services. Out of the box, most Azure AI services allow you to send data and receive insights without any customization.
72
+
The tools that used to customize and configure models are different from those used to call the Azure AI services. Out of the box, most Azure AI services allow for sending data and receive insights without any customization.
73
73
74
74
For example:
75
75
76
-
-You can send an image to the Azure AI Vision service to detect words and phrases or count the number of people in the frame
77
-
-You can send an audio file to the Speech service and get transcriptions and translate the speech to text at the same time
76
+
-Sending an image to the Azure AI Vision service to detect words and phrases or count the number of people in the frame
77
+
-Sending an audio file to the Speech service and get transcriptions and translate the speech to text at the same time
78
78
79
79
Azure offers a wide range of tools that are designed for different types of users, many of which can be used with Azure AI services. Designer-driven tools are the easiest to use, and are quick to set up and automate, but might have limitations when it comes to customization. The REST APIs and client libraries provide users with more control and flexibility, but require more effort, time, and expertise to build a solution. When using REST APIs and client libraries, there is an expectation that the developer is comfortable working with modern programming languages like C#, Java, Python, JavaScript, or another popular programming language.
80
80
81
81
### Azure Machine Learning
82
82
83
83
[Azure Machine Learning](https://learn.microsoft.com/azure/machine-learning/overview-what-is-azure-machine-learning?view=azureml-api-2) is a cloud service for accelerating and managing the machine learning (ML) project lifecycle. ML professionals, data scientists, and engineers can use it in their day-to-day workflows to train and deploy models and manage machine learning operations (MLOps).
84
84
85
-
Azure Machine Learning can be used to create a model or use a model built from an open-source platform, such as PyTorch, TensorFlow, or scikit-learn. Additionally, MLOps tools help you monitor, retrain, and redeploy models.
85
+
Azure Machine Learning can be used to create a model or use a model built from an open-source platform, such as PyTorch, TensorFlow, or scikit-learn. Additionally, MLOps tools help monitor, retrain, and redeploy models.
86
86
87
-
ML projects often require a team with a varied skill set to build and maintain. Azure Machine Learning has tools that help enable you to:
87
+
ML projects often require a team with a varied skill set to build and maintain. Azure Machine Learning has tools that help enable:
88
88
89
-
-Collaborate with your team via shared notebooks, compute resources, serverless compute, data, and environments
89
+
-Collaboration within a team via shared notebooks, compute resources, serverless compute, data, and environments
90
90
91
-
-Develop models for fairness and explainability, tracking and auditability to fulfill lineage and audit compliance requirements
91
+
-Developing models for fairness and explainability, tracking and auditability to fulfill lineage and audit compliance requirements
92
92
93
-
-Deploy ML models quickly and easily at scale, and manage and govern them efficiently with MLOps
93
+
-Deploying ML models quickly and easily at scale, and manage and govern them efficiently with MLOps
94
94
95
-
-Run machine learning workloads anywhere with built-in governance, security, and compliance
95
+
-Running machine learning workloads anywhere with built-in governance, security, and compliance
96
96
97
-
Enterprises working in the Microsoft Azure cloud can use familiar security and role-based access control for infrastructure. You can set up a project to deny access to protected data and select operations.
97
+
Enterprises working in the Microsoft Azure cloud can use familiar security and role-based access control for infrastructure. A project can be set up to deny access to protected data and select operations.
98
98
99
99
#### Azure Machine Learning vs Azure Open AI
100
100
101
101
Many of the Azure AI services are suited to a very specific AI / ML need. The Azure Machine Learning and Azure OpenAI services offer more flexible usage based on the solution requirements.
102
102
103
103
Here are a couple differentiators to help determine which of these to services to use when comparing the two:
104
104
105
-
- Azure Machine Learning service is appropriate for solutions where a custom model needs to be trained specifically on your own data.
105
+
- Azure Machine Learning service is appropriate for solutions where a custom model needs to be trained specifically on private data.
106
106
107
107
- Azure OpenAI service is appropriate for solutions that require pre-trained models that provide natural language processing or vision services, such as the GPT-4 or DALL-E models from OpenAI.
108
108
@@ -124,7 +124,7 @@ Azure AI Studio enables teams to collaborate efficiently and effectively on AI p
124
124
125
125

126
126
127
-
Tasks you can accomplish with Azure AI Studio include:
127
+
Tasks accomplished using Azure AI Studio include:
128
128
129
129
- Deploying models from the model catalog to real-time inferencing endpoints for client applications to consume.
130
130
- Deploying and testing generative AI models in an Azure OpenAI service.
0 commit comments