Skip to content

Commit 0f50431

Browse files
committed
added enableReprocessing
1 parent ae9379a commit 0f50431

File tree

3 files changed

+28
-6
lines changed

3 files changed

+28
-6
lines changed

articles/search/cognitive-search-incremental-indexing-conceptual.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,11 @@ The lifecycle of the cache is managed by the indexer. If the cache property in t
5555
},
5656
"fieldMappings" : [],
5757
"outputFieldMappings": [],
58-
"parameters":{}
58+
"parameters": {
59+
"configuration": {
60+
"enableAnnotationCache": true
61+
}
62+
}
5963
}
6064

6165
```

articles/search/knowledge-store-projection-overview.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ The knowledge store supports three types of projections:
2828

2929
+ **Objects**: When you need a JSON representation of your data and enrichments, object projections are saved as blobs.
3030

31-
+ **Files**: When you need to save the images extracted from the documents, file projections allow you to save the normalized images.
31+
+ **Files**: When you need to save the images extracted from the documents, file projections allow you to save the normalized images to blob storage.
3232

3333
To see projections defined in context, step through [How to get started with knowledge store](knowledge-store-howto.md).
3434

@@ -43,7 +43,7 @@ This implies that you can have the same data shaped differently, yet repeated in
4343

4444
### Relatedness
4545

46-
Projection groups now allow you to project your documents across projection types while preserving the relationships across projection types. All content projected within a single projection group preserves relationships within the data across projection types. Within tables, relationships are based on a generated key and each child node retains a reference to the parent node. Across types (tables, objects and files), relationships are preserved when a single node is projected across different types. For example, consider a scenario where you have a document containing images and text. You could project the text to tables or objects and the images to files where the tables or objects have a property containing the file URL.
46+
Projection groups now allow you to project your documents across projection types while preserving the relationships across projection types. All content projected within a single projection group preserves relationships within the data across projection types. Within tables, relationships are based on a generated key and each child node retains a reference to the parent node. Across types (tables, objects and files), relationships are preserved when a single node is projected across different types. For example, consider a scenario where you have a document containing images and text. You could project the text to tables or objects and the images to files where the tables or objects have a column/property containing the file URL.
4747

4848
## Input shaping
4949
Getting your data in the right shape or structure is key to effective use, be it tables or objects. The ability to shape or structure your data based on how you plan to access and use it is a key capability exposed as the **Shaper** skill within the skillset.

articles/search/search-howto-incremental-index.md

Lines changed: 21 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -40,13 +40,31 @@ Using a API client construct a GET request to get the current configuration of t
4040

4141
### Step 2: Update the indexer definition
4242

43-
Edit the response from the GET request to add the `cache` property to the indexer. The cache object requires only a single property, `storageConnectionString` which is the connection string to the storage account.
43+
Edit the response from the GET request to add the `cache` property to the indexer. The cache object requires only a single property, `storageConnectionString` which is the connection string to the storage account.
4444

4545
```json
46-
"cache": {
47-
"storageConnectionString": "[your storage connection string]"
46+
{
47+
"name": "myIndexerName",
48+
"targetIndexName": "myIndex",
49+
"dataSourceName": "myDatasource",
50+
"skillsetName": "mySkillset",
51+
"cache" : {
52+
"storageConnectionString" : "Your storage account connection string",
53+
"enableReprocessing": true,
54+
"id" : "Auto generated Id you do not need to set"
55+
},
56+
"fieldMappings" : [],
57+
"outputFieldMappings": [],
58+
"parameters": {
59+
"configuration": {
60+
"enableAnnotationCache": true
61+
}
4862
}
63+
}
4964
```
65+
#### Enable reporocessing
66+
67+
You can optionally set the `enableReprocessing` boolean property within the cache which is by default set to true. The `enableReprocessing` flag allows you to control the behavior of your indexer. In scenarios where you want the indexer to prioritize adding new documents to the index, you would set the flag to false. Once your indexer is caught up with the new documents, flipping the flag to true would then allow the indexer to start driving existing documents to eventual consistency. During the period when the `enableReprocessing` flag is set to false, the indexer only writes to the cache but will not process any existing documents based on identified changes to the enrichment pipeline.
5068

5169
### Step 3: Reset the indexer
5270

0 commit comments

Comments
 (0)