Skip to content

Commit 2d2a4e4

Browse files
authored
Merge pull request #230617 from MicrosoftDocs/main
3/14 OOB Publish at 8AM
2 parents f26676f + f87a764 commit 2d2a4e4

File tree

51 files changed

+1871
-126
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

51 files changed

+1871
-126
lines changed

articles/app-service/configure-common.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -394,7 +394,7 @@ az webapp config connection-string list --resource-group <group-name> --name <ap
394394
...
395395
396396
# Update the app with the JSON file
397-
az webapp config appsettings set --resource-group <group-name> --name <app-name> --settings @settings.json
397+
az webapp config connection-string set --resource-group <group-name> --name <app-name> --settings @settings.json
398398
```
399399

400400
# [Azure PowerShell](#tab/ps)

articles/azure-functions/functions-add-output-binding-storage-queue-vs-code.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ This article assumes that you're already signed in to your Azure subscription fr
5656

5757
In the [previous quickstart article](./create-first-function-vs-code-csharp.md), you created a function app in Azure along with the required storage account. The connection string for this account is stored securely in the app settings in Azure. In this article, you write messages to a Storage queue in the same account. To connect to your storage account when running the function locally, you must download app settings to the *local.settings.json* file.
5858

59-
1. Press <kbd>F1</kbd> to open the command palette, then search for and run the command `Azure Functions: Download Remote Settings....`.
59+
1. Press <kbd>F1</kbd> to open the command palette, then search for and run the command `Azure Functions: Download Remote Settings...`.
6060

6161
1. Choose the function app you created in the previous article. Select **Yes to all** to overwrite the existing local settings.
6262

articles/cognitive-services/openai/concepts/models.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -164,37 +164,37 @@ When using our embeddings models, keep in mind their limitations and risks.
164164

165165
| Model ID | Supports Completions | Supports Embeddings | Base model Regions | Fine-Tuning Regions | Max Request (tokens) | Training Data (up to) |
166166
| --------- | -------------------- | ------------------- | --------------------- | ------------------- | -------------------- | ---------------------- |
167-
| ada | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe | 2,049 | Oct 2019|
168-
| text-ada-001 | Yes | No | East US<sup>2</sup>, South Central US, West Europe | N/A | 2,049 | Oct 2019|
169-
| babbage | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe | 2,049 | Oct 2019 |
170-
| text-babbage-001 | Yes | No | East US<sup>2</sup>, South Central US, West Europe | N/A | 2,049 | Oct 2019 |
171-
| curie | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe | 2,049 | Oct 2019 |
172-
| text-curie-001 | Yes | No | East US<sup>2</sup>, South Central US, West Europe | N/A | 2,049 | Oct 2019 |
173-
| davinci<sup>1</sup> | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe | 2,049 | Oct 2019|
167+
| ada | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe<sup>2</sup> | 2,049 | Oct 2019|
168+
| text-ada-001 | Yes | No | East US, South Central US, West Europe | N/A | 2,049 | Oct 2019|
169+
| babbage | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe<sup>2</sup> | 2,049 | Oct 2019 |
170+
| text-babbage-001 | Yes | No | East US, South Central US, West Europe | N/A | 2,049 | Oct 2019 |
171+
| curie | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe<sup>2</sup> | 2,049 | Oct 2019 |
172+
| text-curie-001 | Yes | No | East US, South Central US, West Europe | N/A | 2,049 | Oct 2019 |
173+
| davinci<sup>1</sup> | Yes | No | N/A | East US<sup>2</sup>, South Central US, West Europe<sup>2</sup> | 2,049 | Oct 2019|
174174
| text-davinci-001 | Yes | No | South Central US, West Europe | N/A | | |
175175
| text-davinci-002 | Yes | No | East US, South Central US, West Europe | N/A | 4,097 | Jun 2021 |
176176
| text-davinci-003 | Yes | No | East US | N/A | 4,097 | Jun 2021 |
177-
| text-davinci-fine-tune-002<sup>1</sup> | Yes | No | N/A | East US, West Europe | | |
177+
| text-davinci-fine-tune-002<sup>1</sup> | Yes | No | N/A | East US, West Europe<sup>2</sup> | | |
178178
| gpt-35-turbo<sup>3</sup> (ChatGPT) | Yes | No | N/A | East US, South Central US | 4,096 | Sep 2021
179179

180180
<sup>1</sup> The model is available by request only. Currently we aren't accepting new requests to use the model.
181-
<br><sup>2</sup> East US is currently unavailable for new customers to fine-tune due to high demand. Please use US South Central region for US based training.
181+
<br><sup>2</sup> East US and West Europe are currently unavailable for new customers to fine-tune due to high demand. Please use US South Central region for fine-tuning.
182182
<br><sup>3</sup> Currently, only version `"0301"` of this model is available. This version of the model will be deprecated on 8/1/2023 in favor of newer version of the gpt-35-model. See [ChatGPT model versioning](../how-to/chatgpt.md#model-versioning) for more details.
183183

184184
### Codex Models
185185
| Model ID | Supports Completions | Supports Embeddings | Base model Regions | Fine-Tuning Regions | Max Request (tokens) | Training Data (up to) |
186186
| --- | --- | --- | --- | --- | --- | --- |
187-
| code-cushman-001<sup>1</sup> | Yes | No | South Central US, West Europe | East US<sup>2</sup> , South Central US, West Europe | 2,048 | |
187+
| code-cushman-001<sup>1</sup> | Yes | No | South Central US, West Europe | East US<sup>2</sup> , South Central US, West Europe<sup>2</sup> | 2,048 | |
188188
| code-davinci-002 | Yes | No | East US, West Europe | N/A | 8,001 | Jun 2021 |
189-
| code-davinci-fine-tune-002<sup>1</sup> | Yes | No | N/A | East US<sup>2</sup> , West Europe | | |
189+
| code-davinci-fine-tune-002<sup>1</sup> | Yes | No | N/A | East US<sup>2</sup> , West Europe<sup>2</sup> | | |
190190

191191
<sup>1</sup> The model is available for fine-tuning by request only. Currently we aren't accepting new requests to fine-tune the model.
192192
<br><sup>2</sup> East US is currently unavailable for new customers to fine-tune due to high demand. Please use US South Central region for US based training.
193193

194194
### Embeddings Models
195195
| Model ID | Supports Completions | Supports Embeddings | Base model Regions | Fine-Tuning Regions | Max Request (tokens) | Training Data (up to) |
196196
| --- | --- | --- | --- | --- | --- | --- |
197-
| text-ada-embeddings-002 | No | Yes | East US, South Central US, West Europe | N/A | 8,191 | Sep 2021 |
197+
| text-ada-embeddings-002 | No | Yes | East US, South Central US, West Europe | N/A |2,046 | Sep 2021 |
198198
| text-similarity-ada-001 | No | Yes | East US, South Central US, West Europe | N/A | 2,046 | Aug 2020 |
199199
| text-similarity-babbage-001 | No | Yes | South Central US, West Europe | N/A | 2,046 | Aug 2020 |
200200
| text-similarity-curie-001 | No | Yes | East US, South Central US, West Europe | N/A | 2046 | Aug 2020 |

articles/cognitive-services/openai/quotas-limits.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,8 +32,8 @@ The following sections provide you with a quick guide to the quotas and limits t
3232
| Max training jobs queued | 20 |
3333
| Max Files per resource | 50 |
3434
| Total size of all files per resource | 1 GB |
35-
| Max training job time (job will fail if exceeded) | 120 hours |
36-
| Max training job size (tokens in training file) x (# of epochs) | **Ada**: 40-M tokens <br> **Babbage**: 40-M tokens <br> **Curie**: 40-M tokens <br> **Cushman**: 40-M tokens <br> **Davinci**: 10-M |
35+
| Max training job time (job will fail if exceeded) | 720 hours |
36+
| Max training job size (tokens in training file) x (# of epochs) | 2 Billion |
3737

3838
*The limits are subject to change. We anticipate that you will need higher limits as you move toward production and your solution scales. When you know your solution requirements, please reach out to us by applying for a quota increase here: <https://aka.ms/oai/quotaincrease>
3939

articles/cognitive-services/openai/whats-new.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ keywords:
1919

2020
- **ChatGPT (gpt-35-turbo) public preview**. To learn more checkout the new [quickstart](./quickstart.md), and [how-to articles](./how-to/chatgpt.md).
2121

22+
- Increased training limits for fine-tuning: The max training job size (tokens in training file) x (# of epochs) is 2 Billion tokens for all models. We have also increased the max training job from 120 to 720 hours.
2223
- Adding additional use cases to your existing access.  Previously, the process for adding new use cases required customers to reapply to the service. Now, we're releasing a new process that allows you to quickly add new use cases to your use of the service. This process follows the established Limited Access process within Azure Cognitive Services. [Existing customers can attest to any and all new use cases here](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUM003VEJPRjRSOTZBRVZBV1E5N1lWMk1XUyQlQCN0PWcu). Please note that this is required anytime you would like to use the service for a new use case you did not originally apply for.
2324

2425
## February 2023

articles/container-registry/tutorial-registry-cache.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ Implementing Caching for ACR provides the following benefits:
5757

5858
- Quarantine functions like signing, scanning, and manual compliance approval are on the roadmap but not included in this release.
5959

60-
- Caching will only occur after at least one pull request is complete on the available container image. For every new image available, a new pull request must be complete. Caching for ACR does not automatically pull new versions of images when a new version is available. It is on the roadmap but not supported in this release.
60+
- Caching will only occur after at least one image pull request is complete on the available container image. For every new image available, a new image pull request must be complete. Caching for ACR does not automatically pull new versions of images when a new version is available. It is on the roadmap but not supported in this release.
6161

6262
- Caching for ACR only supports Docker Hub and Microsoft Artifact Registry. Multiple other registries including self-hosted registries are on the roadmap but aren't included in this release.
6363

@@ -71,4 +71,4 @@ Implementing Caching for ACR provides the following benefits:
7171

7272
<!-- LINKS - External -->
7373

74-
[docker-rate-limit]:https://aka.ms/docker-rate-limit
74+
[docker-rate-limit]:https://aka.ms/docker-rate-limit

articles/data-factory/connector-hive.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -236,6 +236,9 @@ source(
236236

237237
* Complex types such as arrays, maps, structs, and unions are not supported for read.
238238
* Hive connector only supports Hive tables in Azure HDInsight of version 4.0 or greater (Apache Hive 3.1.0)
239+
* By default, Hive driver provides "tableName.columnName" in sink. If you do not wish to see the table name in the column name, then there are two ways to fix this.
240+
a. Check the setting "hive.resultset.use.unique.column.names" in Hive server side and set it to false.
241+
b. Use column mapping to rename the column name.
239242

240243
## Lookup activity properties
241244

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
---
2+
title: Hierarchy model in Azure Data Manager for Agriculture
3+
description: Provides information on the data model to organize your agriculture data.
4+
author: gourdsay #Required; your GitHub user alias, with correct capitalization.
5+
ms.author: angour
6+
ms.service: data-manager-for-agri
7+
ms.topic: conceptual #Required; leave this attribute/value as-is.
8+
ms.date: 02/14/2023
9+
ms.custom: template-concept #Required; leave this attribute/value as-is.
10+
---
11+
12+
# Hierarchy model to organize agriculture related data
13+
14+
> [!NOTE]
15+
> Microsoft Azure Data Manager for Agriculture is currently in preview. For legal terms that apply to features that are in beta, in preview, or otherwise not yet released into general availability, see the [**Supplemental Terms of Use for Microsoft Azure Previews**](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
16+
> Microsoft Azure Data Manager for Agriculture requires registration and is available to only approved customers and partners during the preview period. To request access to Microsoft Data Manager for Agriculture during the preview period, use this [**form**](https://aka.ms/agridatamanager).
17+
18+
To generate actionable insights data related to growers, farms, and fields should be organized in a well defined manner. Firms operating in the agriculture industry often perform longitudinal studies and need high quality data to generate insights. Data Manager for Agriculture organizes agronomic data in the below manner.
19+
20+
>:::image type="content" source="./media/data-model.png" alt-text="Screenshot showing farm hierarchy model.":::
21+
22+
## Understanding farm hierarchy
23+
24+
### Party
25+
* Party is the owner and custodian of any data related to their farm. You could imagine Party to be the legal entity that is running the business.
26+
* The onus of defining the Party entity is with the customer setting up Data Manager for Agriculture.
27+
28+
### Farm
29+
* Farms are logical entities. A farm is a collection of fields.
30+
* Farms don't have any geometry associated with them. Farm entity helps you organize your growing operations. For example Contoso Inc is the Party that has farms in Oregon and Idaho.
31+
32+
### Field
33+
* Fields denote a stable boundary that is in general agnostic to seasons and other temporal constructs. For example, field could be the boundary denoted in government records.
34+
* Fields are multi-polygon. For example, a road might divide the farm in two or more parts.
35+
* Fields are multi-boundary.
36+
37+
### Seasonal field
38+
* This is the most important construct in the farming world. A seasonal fields definition includes the following things
39+
* Boundary
40+
* Season
41+
* Crop
42+
* A seasonal field is associated with a field or a farm
43+
* In Data Manager for Agriculture, seasonal fields are mono crop entities. In cases where farmers are cultivating different crops simultaneously, they have to create one seasonal field per crop.
44+
* A seasonal field is associated with one season. If a farmer cultivates across multiple seasons, they have to create one seasonal field per season.
45+
* It's multi-polygon. Same crop can be planted in different areas within the farm.
46+
47+
48+
### Boundary
49+
* Boundary represents the geometry of a field or a seasonal field.
50+
* It's represented as a multi-polygon GeoJSON consisting of vertices (lat/long).
51+
52+
### Season
53+
* Season represents the temporal aspect of farming. It is a function of local agronomic practices, procedures and weather.
54+
55+
### Crop
56+
* Crop entity provides the phenotypic details of the planted crop.
57+
58+
### Crop product
59+
* Crop Product entity refers to the commercial variety (brand, product) of the planted seeds. A seasonal field can contain information about various varieties of seeds planted (belonging to the same crop).
60+
61+
## Next steps
62+
63+
* Test our APIs [here](/rest/api/data-manager-for-agri).
Lines changed: 70 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,70 @@
1+
---
2+
title: Ingesting satellite data in Azure Data Manager for Agriculture
3+
description: Provides step by step guidance to ingest Satellite data
4+
author: gourdsay #Required; your GitHub user alias, with correct capitalization.
5+
ms.author: angour
6+
ms.service: data-manager-for-agri
7+
ms.topic: conceptual #Required; leave this attribute/value as-is.
8+
ms.date: 02/14/2023
9+
ms.custom: template-concept #Required; leave this attribute/value as-is.
10+
---
11+
12+
# Using satellite imagery in Azure Data Manager for Agriculture
13+
Our data manager supports geospatial and temporal data. Remote sensing satellite imagery (which is geospatial and temporal) has huge applications in the field of agriculture. Farmers, agronomists and data scientists use of satellite imagery extensively to generate insights. Using satellite data in Data Manager for agriculture involves following steps.
14+
15+
> [!NOTE]
16+
> Microsoft Azure Data Manager for Agriculture is currently in preview. For legal terms that apply to features that are in beta, in preview, or otherwise not yet released into general availability, see the [**Supplemental Terms of Use for Microsoft Azure Previews**](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
17+
> Microsoft Azure Data Manager for Agriculture requires registration and is available to only approved customers and partners during the preview period. To request access to Microsoft Data Manager for Agriculture during the preview period, use this [**form**](https://aka.ms/agridatamanager).
18+
19+
>:::image type="content" source="./media/satellite-flow.png" alt-text="Diagram showing satellite data ingestion flow..":::
20+
21+
## Satellite sources supported by Azure Data Manager for Agriculture
22+
In our public preview, we support ingesting data from Sentinel-2 constellation.
23+
24+
## Sentinel-2
25+
[Sentinel-2](https://sentinel.esa.int/web/sentinel/missions/sentinel-2) is a satellite constellation launched by 'European Space Agency' (ESA) under the Copernicus mission. This constellation has a pair of satellites and carries a Multi-Spectral Instrument (MSI) payload that samples 13 spectral bands: four bands at 10 m, six bands at 20 m and three bands at 60 m spatial resolution.
26+
27+
> [!Tip]
28+
> Sentinel-2 has two products: Level 1 (top of the atmosphere) data and its atmospherically corrected variant Level 2 (bottom of the atmosphere) data. We support ingesting and retrieving Level 1 and Level 2 data from Sentinel 2.
29+
30+
## Image names and resolutions
31+
The image names and resolutions that are supported by APIs used to ingest and read satellite data (for Sentinel-2) in our service:
32+
33+
| Category | Image Name | Description | Native resolution |
34+
|:-----:|:----:|:----:|:----:|
35+
|Raw bands| B01 | Coastal aerosol | 60 m |
36+
|Raw bands| B02 | Blue| 10 m |
37+
|Raw bands| B03 | Green | 10 m |
38+
|Raw bands| B04 | Red | 10 m |
39+
|Raw bands| B05 | Vegetation red edge | 20 m |
40+
|Raw bands| B06 | Vegetation red edge | 20 m |
41+
|Raw bands| B07 | Vegetation red edge | 20 m |
42+
|Raw bands| B08 | NIR | 10 m |
43+
|Raw bands| B8A | Narrow NIR | 20 m |
44+
|Raw bands| B09 | Water vapor | 60 m |
45+
|Raw bands| B11 | SWIR | 20 m |
46+
|Raw bands| B12 | SWIR | 20 m |
47+
|Sen2Cor processor output| AOT | Aerosol optical thickness map | 10 m |
48+
|Sen2Cor processor output| SCL | Scene classification data | 20 m |
49+
|Sen2Cor processor output| SNW | Snow probability| 20 m |
50+
|Sen2Cor processor output| CLD | Cloud probability| 20 m |
51+
|Derived Indices| NDVI | Normalized difference vegetation index | 10 m/20 m/60 m (user defined) |
52+
|Derived Indices| NDWI | Normalized difference water index | 10 m/20 m/60 m (user defined) |
53+
|Derived Indices| EVI | Enhanced vegetation index | 10 m/20 m/60 m (user defined) |
54+
|Derived Indices| LAI | Leaf Area Index | 10 m/20 m/60 m (user defined) |
55+
|Derived Indices| LAIMask | Leaf Area Index Mask | 10 m/20 m/60 m (user defined) |
56+
|CLP| Cloud probability, based on [s2cloudless](https://github.com/sentinel-hub/sentinel2-cloud-detector). | Values range from 0 (no clouds) to 255 (clouds). | 10 m/20 m/60 m (user defined)|
57+
|CLM| Cloud masks based on [s2cloudless](https://github.com/sentinel-hub/sentinel2-cloud-detector) | Value of 1 represents clouds, 0 represents no clouds and 255 represents no data. | 10 m/20 m/60 m (user defined)|
58+
|dataMask | Binary mask to denote availability of data | 0 represents non availability of data OR pixels lying outside the 'Area of interest' | Not applicable, per pixel value|
59+
60+
## Points to note
61+
* We use CRS EPSG: 4326 for Sentinel-2 data. The resolutions quoted in the APIs are at the equator.
62+
* For preview:
63+
* A maximum of five satellite jobs can be run concurrently, per tenant.
64+
* A satellite job can ingest data for a maximum of one year in a single API call.
65+
* Only TIFs are supported.
66+
* Only 10 m, 20 m and 60 m images are supported.
67+
68+
## Next steps
69+
70+
* Test our APIs [here](/rest/api/data-manager-for-agri).

0 commit comments

Comments
 (0)