You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/search-how-to-index-power-query-data-sources.md
+11-10Lines changed: 11 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ manager: nitinme
9
9
10
10
ms.service: cognitive-search
11
11
ms.topic: conceptual
12
-
ms.date: 05/25/2021
12
+
ms.date: 12/17/2021
13
13
ms.custom: references_regions
14
14
---
15
15
@@ -66,8 +66,8 @@ After you're approved for the preview, the Azure Cognitive Search team will prov
66
66
### Step 3 – Select your data source
67
67
There are a few data sources that you can pull data from using this preview. All data sources that use Power Query will include a "Powered By Power Query" on their tile.
68
68
Select your data source.
69
-
70
-

69
+
70
+
:::image type="content" source="media/search-power-query-connectors/power-query-import-data.png" alt-text="Screenshot of the Select a data source page." border="true":::
71
71
72
72
Once you've selected your data source, select **Next: Configure your data** to move to the next section.
73
73
@@ -82,8 +82,8 @@ Once you've provided your connection credentials, select **Next**.
82
82
83
83
### Step 5 – Select your data
84
84
The import wizard will preview various tables that are available in your data source. In this step you'll check one table that contains the data you want to import into your index.
85
-
86
-

85
+
86
+
:::image type="content" source="media/search-power-query-connectors/power-query-preview-data.png" alt-text="Screenshot of data preview." border="true":::
87
87
88
88
Once you've selected your table, select **Next**.
89
89
@@ -92,7 +92,7 @@ Power Query connectors provide you with a rich UI experience that allows you to
92
92
93
93
It's not required that you transform your data before importing it into Azure Cognitive Search.
94
94
95
-

95
+
:::image type="content" source="media/search-power-query-connectors/power-query-transform-your-data.png" alt-text="Screenshot of Transform your data page." border="true":::
96
96
97
97
For more information about transforming data with Power Query, look at [Using Power Query in Power BI Desktop](/power-query/power-query-quickstart-using-power-bi).
98
98
@@ -101,8 +101,9 @@ Once you're done transforming your data, select **Next**.
101
101
### Step 7 – Add Azure Blob storage
102
102
The Power Query connector preview currently requires you to provide a blob storage account. This step only exists with the initial gated preview. This blob storage account will serve as temporary storage for data that moves from your data source to an Azure Cognitive Search index.
103
103
104
-
We recommend providing a full access storage account connection string:
105
-
```
104
+
We recommend providing a full access storage account connection string:
@@ -124,7 +125,7 @@ Review the description of index attributes and language analyzers for more infor
124
125
125
126
Take a moment to review your selections. Once you run the wizard, physical data structures are created and you won't be able to edit most of the properties for these fields without dropping and recreating all objects.
126
127
127
-

128
+
:::image type="content" source="media/search-power-query-connectors/power-query-index.png" alt-text="Screenshot of Create your index page." border="true":::
128
129
129
130
When complete, select **Next: Create an Indexer**.
130
131
@@ -135,7 +136,7 @@ The output of the Import data wizard is an indexer that crawls your data source
135
136
136
137
When creating the indexer, you can optionally choose to run the indexer on a schedule and add change detection. To add change detection, designate a 'high water mark' column.
137
138
138
-

139
+
:::image type="content" source="media/search-power-query-connectors/power-query-indexer-configuration.png" alt-text="Screenshot of Create your indexer page." border="true":::
139
140
140
141
Once you've finished filling out this page select **Submit**.
Copy file name to clipboardExpand all lines: articles/search/search-indexer-overview.md
+8-6Lines changed: 8 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,18 +8,18 @@ author: HeidiSteen
8
8
ms.author: heidist
9
9
ms.service: cognitive-search
10
10
ms.topic: conceptual
11
-
ms.date: 01/29/2021
11
+
ms.date: 12/17/2021
12
12
---
13
13
14
14
# Indexers in Azure Cognitive Search
15
15
16
-
An *indexer* in Azure Cognitive Search is a crawler that extracts searchable text and metadata from an external Azure data source and populates a search index using field-to-field mappings between source data and your index. This approach is sometimes referred to as a 'pull model' because the service pulls data in without you having to write any code that adds data to an index. Indexers also drive the [AI enrichment](cognitive-search-concept-intro.md) capabilities of Cognitive Search, integrating external processing of content en route to an index.
16
+
An *indexer* in Azure Cognitive Search is a crawler that extracts searchable content from cloud data sources and populates a search index using field-to-field mappings between source data and a search index. This approach is sometimes referred to as a 'pull model' because the search service pulls data in without you having to write any code that adds data to an index. Indexers also drive the [AI enrichment](cognitive-search-concept-intro.md) capabilities of Cognitive Search, integrating external processing of content en route to an index.
17
17
18
-
Indexers are Azure-only, with individual indexers for [Azure SQL](search-howto-connecting-azure-sql-database-to-azure-search-using-indexers.md), [Azure Cosmos DB](search-howto-index-cosmosdb.md), [Azure Table Storage](search-howto-indexing-azure-tables.md) and [Blob Storage](search-howto-indexing-azure-blob-storage.md). When configuring an indexer, you'll specify a data source (origin), as well as an index (destination). Several sources, such as Blob storage, have additional configuration properties specific to that content type.
18
+
Indexers are cloud-only, with individual indexers for supported data sources. When configuring an indexer, you'll specify a data source (origin) and a search index (destination). Several sources, such as Azure Blob storage, have additional configuration properties specific to that content type.
19
19
20
20
You can run indexers on demand or on a recurring data refresh schedule that runs as often as every five minutes. More frequent updates require a ['push model'](search-what-is-data-import.md) that simultaneously updates data in both Azure Cognitive Search and your external data source.
21
21
22
-
## Usage scenarios
22
+
## How to use indexers
23
23
24
24
You can use an indexer as the sole means for data ingestion, or as part of a combination of techniques that load and optionally transform or enrich content along the way. The following table summarizes the main scenarios.
25
25
@@ -49,10 +49,12 @@ Indexers crawl data stores on Azure and outside of Azure.
49
49
+[Salesforce Reports](search-how-to-index-power-query-data-sources.md) (in preview)
50
50
+[Smartsheet](search-how-to-index-power-query-data-sources.md) (in preview)
51
51
+[Snowflake](search-how-to-index-power-query-data-sources.md) (in preview)
+[SQL Server on Azure Virtual Machines](search-howto-connecting-azure-sql-iaas-to-azure-search-using-indexers.md)
54
54
55
-
Indexer connections to remote data sources can be made using standard Internet connections (public) or encrypted private connections when you use Azure virtual networks for client apps. You can also set up connections to authenticate using a trusted service identity. For more information about secure connections, see [Granting access via private endpoints](search-indexer-securing-resources.md#granting-access-via-private-endpoints) and [Connect to a data source using a managed identity](search-howto-managed-identities-data-sources.md).
55
+
Indexers accept flattened row sets, such as a table or view, or items in a container or folder. In most cases, it creates one search document per row, record, or item.
56
+
57
+
Indexer connections to remote data sources can be made using standard Internet connections (public) or encrypted private connections when you use Azure virtual networks for client apps. You can also set up connections to authenticate using a managed identity. For more information about secure connections, see [Granting access via private endpoints](search-indexer-securing-resources.md#granting-access-via-private-endpoints) and [Connect to a data source using a managed identity](search-howto-managed-identities-data-sources.md).
0 commit comments