You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/search-how-to-index-csv-blobs.md
+11-12Lines changed: 11 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: Search over CSV blobs
2
+
title: Search over CSV blobs using delimitedText parsing
3
3
titleSuffix: Azure AI Search
4
-
description: Extract CSV blobs from Azure Blob Storage or Azure Files and import as search documents into Azure AI Search using the delimitedText parsing mode.
4
+
description: Extract CSV blobs from Azure Blob Storage or Azure Files, and import as search documents into Azure AI Search using the delimitedText parsing mode.
5
5
6
6
manager: nitinme
7
7
author: HeidiSteen
@@ -11,12 +11,12 @@ ms.service: azure-ai-search
11
11
ms.custom:
12
12
- ignite-2023
13
13
ms.topic: how-to
14
-
ms.date: 01/17/2024
14
+
ms.date: 10/23/2024
15
15
---
16
16
17
17
# Index CSV blobs and files using delimitedText parsing mode
In Azure AI Search, indexers for Azure Blob Storage and Azure Files support a `delimitedText` parsing mode for CSV files that treats each line in the CSV as a separate search document. For example, given the following comma-delimited text, the `delimitedText` parsing mode would result in two documents in the search index:
22
22
@@ -26,7 +26,7 @@ id, datePublished, tags
26
26
2, 2016-07-07, "cloud,mobile"
27
27
```
28
28
29
-
If a field inside the CSV file contains the delimeter, it should be wrapped in quotes. If the field contains a quote, it must be escaped using double quotes (`""`).
29
+
If a field inside the CSV file contains the delimiter, it should be wrapped in quotes. If the field contains a quote, it must be escaped using double quotes (`""`).
30
30
31
31
```text
32
32
id, datePublished, tags
@@ -35,9 +35,9 @@ id, datePublished, tags
35
35
36
36
Without the `delimitedText` parsing mode, the entire contents of the CSV file would be treated as one search document.
37
37
38
-
Whenever you're creating multiple search documents from a single blob, be sure to review [Indexing blobs to produce multiple search documents](search-howto-index-one-to-many-blobs.md) to understand how document key assignments work. The blob indexer is capable of finding or generating values that uniquely define each new document. Specifically, it can create a transitory `AzureSearch_DocumentKey` that generated when a blob is parsed into smaller parts, where the value is then used as the search document's key in the index.
38
+
Whenever you create multiple search documents from a single blob, be sure to review [Indexing blobs to produce multiple search documents](search-howto-index-one-to-many-blobs.md) to understand how document key assignments work. The blob indexer is capable of finding or generating values that uniquely define each new document. Specifically, it can create a transitory `AzureSearch_DocumentKey` when a blob is parsed into smaller parts, where the value is then used as the search document's key in the index.
39
39
40
-
## Setting up CSV indexing
40
+
## Set up CSV indexing
41
41
42
42
To index CSV blobs, create or update an indexer definition with the `delimitedText` parsing mode on a [Create Indexer](/rest/api/searchservice/indexers/create) request.
43
43
@@ -51,8 +51,7 @@ Only UTF-8 encoding is supported.
51
51
}
52
52
```
53
53
54
-
`firstLineContainsHeaders` indicates that the first (nonblank) line of each blob contains headers.
55
-
If blobs don't contain an initial header line, the headers should be specified in the indexer configuration:
54
+
`firstLineContainsHeaders` indicates that the first (nonblank) line of each blob contains headers. If blobs don't contain an initial header line, the headers should be specified in the indexer configuration:
Copy file name to clipboardExpand all lines: articles/search/search-region-support.md
+63-74Lines changed: 63 additions & 74 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -35,105 +35,94 @@ You can create an Azure AI Search resource in any of the following Azure public
35
35
36
36
### Americas
37
37
38
-
| Region | AI integration | Semantic ranker | Availability zones |
39
-
|--|--|--|--|
40
-
| Brazil South | ✅ | ✅ ||
41
-
| Canada Central | ✅ | ✅ | ✅ |
42
-
| Canada East || ✅ ||
43
-
| East US <sup>1</sup>| ✅ | ✅ | ✅ |
44
-
| East US 2 | ✅ | ✅ | ✅ |
45
-
| Central US <sup>2</sup> | ✅ | ✅ | ✅ |
46
-
| North Central US | ✅ | ✅ ||
47
-
| South Central US <sup>1</sup> | ✅ | ✅ | ✅ |
48
-
| West US | ✅ | ✅ ||
49
-
| West US 2 | ✅ | ✅ | ✅ |
50
-
| West US 3 <sup>1</sup> | ✅ | ✅ |✅ |
51
-
| West Central US | ✅ | ✅ ||
52
-
53
-
<sup>1</sup> Currently, this region is at full capacity and not accepting new search services.
54
-
55
-
<sup>2</sup> This region has capacity, but some tiers are [not available](search-sku-tier.md#region-availability-by-tier).
38
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
39
+
|--|--|--|--|--|
40
+
| Brazil South | ✅ | ✅ |||
41
+
| Canada Central | ✅ | ✅ | ✅ ||
42
+
| Canada East || ✅ |||
43
+
| East US | ✅ | ✅ | ✅ ||
44
+
| East US 2 | ✅ | ✅ | ✅ | Basic, S1 |
45
+
| Central US | ✅ | ✅ | ✅ ||
46
+
| North Central US | ✅ | ✅ |||
47
+
| South Central US | ✅ | ✅ | ✅ | All Tiers |
48
+
| West US | ✅ | ✅ |||
49
+
| West US 2 | ✅ | ✅ | ✅ ||
50
+
| West US 3 | ✅ | ✅ |✅ | Basic, S1 |
51
+
| West Central US | ✅ | ✅ |||
56
52
57
53
### Europe
58
54
59
-
| Region | AI integration | Semantic ranker | Availability zones |
60
-
|--|--|--|--|
61
-
| North Europe | ✅ | ✅ | ✅ |
62
-
| West Europe <sup>1, 2</sup>| ✅ | ✅ | ✅ |
63
-
| France Central | ✅ | ✅ | ✅ |
64
-
| Germany West Central | ✅ || ✅ |
65
-
| Italy North ||| ✅ |
66
-
| Norway East | ✅ || ✅ |
67
-
| Poland Central ||||
68
-
| Spain Central <sup>2</sup> ||| ✅ |
69
-
| Sweden Central | ✅ || ✅ |
70
-
| Switzerland North | ✅ | ✅ | ✅ |
71
-
| Switzerland West | ✅ | ✅ | ✅ |
72
-
| UK South | ✅ | ✅ | ✅ |
73
-
| UK West || ✅ ||
74
-
75
-
<sup>1</sup> Currently, this region is at full capacity and not accepting new search services.
76
-
77
-
<sup>2</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
55
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
56
+
|--|--|--|--|--|
57
+
| North Europe | ✅ | ✅ | ✅ ||
58
+
| West Europe <sup>1</sup>| ✅ | ✅ | ✅ | All Tiers |
59
+
| France Central | ✅ | ✅ | ✅ ||
60
+
| Germany West Central | ✅ || ✅ ||
61
+
| Italy North ||| ✅ ||
62
+
| Norway East | ✅ || ✅ ||
63
+
| Poland Central |||||
64
+
| Spain Central <sup>1</sup> ||| ✅ ||
65
+
| Sweden Central | ✅ || ✅ ||
66
+
| Switzerland North | ✅ | ✅ | ✅ ||
67
+
| Switzerland West | ✅ | ✅ | ✅ ||
68
+
| UK South | ✅ | ✅ | ✅ ||
69
+
| UK West || ✅ |||
78
70
79
-
### Middle East
71
+
<sup>1</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
80
72
81
-
| Region | AI integration | Semantic ranker | Availability zones |
82
-
|--|--|--|--|
83
-
| Israel Central <sup>2</sup> ||| ✅ |
84
-
| Qatar Central <sup>1, 2</sup> ||| ✅ |
85
-
| UAE North | ✅ || ✅ |
73
+
### Middle East
86
74
87
-
<sup>1</sup> Currently, this region is at full capacity and not accepting new search services.
75
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
76
+
|--|--|--|--|--|
77
+
| Israel Central <sup>1</sup> ||| ✅ ||
78
+
| Qatar Central <sup>1</sup> ||| ✅ ||
79
+
| UAE North | ✅ || ✅ ||
88
80
89
-
<sup>2</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
81
+
<sup>1</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
90
82
91
83
### Africa
92
84
93
-
| Region | AI integration | Semantic ranker | Availability zones |
94
-
|--|--|--|--|
95
-
| South Africa North | ✅ || ✅ |
85
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
86
+
|--|--|--|--|--|
87
+
| South Africa North | ✅ || ✅ ||
96
88
97
89
### Asia Pacific
98
90
99
-
| Region | AI integration | Semantic ranker | Availability zones |
100
-
|--|--|--|--|
101
-
| Australia East | ✅ | ✅ | ✅ |
102
-
| Australia Southeast || ✅ ||
103
-
| East Asia | ✅ | ✅ | ✅ |
104
-
| Southeast Asia | ✅ | ✅ | ✅ |
105
-
| Central India <sup>1</sup> | ✅ | ✅ | ✅ |
91
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
92
+
|--|--|--|--|--|
93
+
| Australia East | ✅ | ✅ | ✅ ||
94
+
| Australia Southeast || ✅ |||
95
+
| East Asia | ✅ | ✅ | ✅ ||
96
+
| Southeast Asia | ✅ | ✅ | ✅ ||
97
+
| Central India | ✅ | ✅ | ✅| S2, S3, S3HD, L1, L2|
106
98
| Jio India West | ✅ | ✅ ||
107
-
| South India <sup>2</sup> ||| ✅ |
108
-
| Japan East <sup>1</sup>| ✅ | ✅ | ✅ |
99
+
| South India <sup>1</sup> ||| ✅ |
100
+
| Japan East | ✅ | ✅ | ✅ |
109
101
| Japan West | ✅ | ✅ ||
110
102
| Korea Central | ✅ | ✅ | ✅ |
111
103
| Korea South || ✅ ||
112
104
113
-
<sup>1</sup> This region has capacity, but some tiers are [not available](search-sku-tier.md#region-availability-by-tier).
114
-
115
-
<sup>2</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
105
+
<sup>1</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
116
106
117
107
## Azure Government regions
118
108
119
-
| Region | AI integration | Semantic ranker | Availability zones |
120
-
|--|--|--|--|
121
-
| Arizona | ✅ | ✅ ||
122
-
| Texas ||||
123
-
| Virginia <sup>1</sup> | ✅ | ✅ | ✅ |
109
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
110
+
|--|--|--|--|--|
111
+
| Arizona | ✅ | ✅ |||
112
+
| Texas |||||
113
+
| Virginia | ✅ | ✅ | ✅| All Tiers|
124
114
125
-
<sup>1</sup> Currently, this region is at full capacity and not accepting new search services.
126
115
127
116
## Azure operated by 21Vianet
128
117
129
-
| Region | AI integration | Semantic ranker | Availability zones |
130
-
|--|--|--|--|
118
+
| Region | AI integration | Semantic ranker | Availability zones | Capacity constrained |
119
+
|--|--|--|--|--|
131
120
| China East ||||
132
-
| China East 2 <sup>1</sup> | ✅ |||
133
-
| China East 3 ||||
134
-
| China North ||||
135
-
| China North 2 <sup>1</sup> ||||
136
-
| China North 3 || ✅ | ✅ |
121
+
| China East 2 <sup>1</sup> | ✅ ||||
122
+
| China East 3 |||||
123
+
| China North |||||
124
+
| China North 2 <sup>1</sup> |||||
125
+
| China North 3 || ✅ | ✅ ||
137
126
138
127
<sup>1</sup> This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits).
139
128
@@ -143,4 +132,4 @@ You can create an Azure AI Search resource in any of the following Azure public
143
132
-[Azure OpenAI model region availability](/azure/ai-services/openai/concepts/models#model-summary-table-and-region-availability)
144
133
-[Azure AI Vision region list](/azure/ai-services/computer-vision/overview-image-analysis#region-availability)
145
134
-[Availability zone region availability](/azure/reliability/availability-zones-service-support#azure-regions-with-availability-zone-support)
146
-
-[Azure product by region page](https://azure.microsoft.com/explore/global-infrastructure/products-by-region/?products=search)
135
+
-[Azure product by region page](https://azure.microsoft.com/explore/global-infrastructure/products-by-region/?products=search)
Copy file name to clipboardExpand all lines: articles/search/search-sku-tier.md
+8-12Lines changed: 8 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -57,18 +57,14 @@ The supported [regions list](search-region-support.md) provides the locations wh
57
57
58
58
Currently, several regions are at capacity for specific tiers and can't be used for new search services. If you use the Azure portal to create a search service, the portal excludes any region-tier combinations that aren't available.
59
59
60
-
| Region | Disabled tier (SKU) due to over-capacity |
0 commit comments