Skip to content

Commit 1308ebc

Browse files
committed
update template worker counts to 3
1 parent 219cd1c commit 1308ebc

File tree

4 files changed

+4
-4
lines changed

4 files changed

+4
-4
lines changed

config_generation/xmls/indexing_template.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,7 +144,7 @@
144144
<CurationIdPattern></CurationIdPattern>
145145
<RunIndexMiningInIndexer>false</RunIndexMiningInIndexer>
146146
<Namespace></Namespace>
147-
<WorkerCount>8</WorkerCount>
147+
<WorkerCount>3</WorkerCount>
148148
<MaxWorkerPerHost></MaxWorkerPerHost>
149149
<Url>your_url_here</Url>
150150
<UrlList></UrlList>

config_generation/xmls/scraper_template.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -145,7 +145,7 @@
145145
<CurationIdPattern></CurationIdPattern>
146146
<RunIndexMiningInIndexer>false</RunIndexMiningInIndexer>
147147
<Namespace></Namespace>
148-
<WorkerCount>8</WorkerCount>
148+
<WorkerCount>3</WorkerCount>
149149
<MaxWorkerPerHost></MaxWorkerPerHost>
150150
<UrlList></UrlList>
151151
<DynamicUrlList></DynamicUrlList>

config_generation/xmls/webcrawler_initial_crawl.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -227,7 +227,7 @@
227227
<BrowserForWebRequestsViewportWidth></BrowserForWebRequestsViewportWidth>
228228
<BrowserForWebRequestsViewportHeight></BrowserForWebRequestsViewportHeight>
229229
</UrlAccess>
230-
<WorkerCount>8</WorkerCount>
230+
<WorkerCount>3</WorkerCount>
231231
<MaxWorkerPerHost></MaxWorkerPerHost>
232232
<UrlList></UrlList>
233233
<DynamicUrlList></DynamicUrlList>

scraper/sinequa_webcrawler_base_template.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -227,7 +227,7 @@
227227
<BrowserForWebRequestsViewportWidth></BrowserForWebRequestsViewportWidth>
228228
<BrowserForWebRequestsViewportHeight></BrowserForWebRequestsViewportHeight>
229229
</UrlAccess>
230-
<WorkerCount>8</WorkerCount>
230+
<WorkerCount>3</WorkerCount>
231231
<MaxWorkerPerHost></MaxWorkerPerHost>
232232
<UrlList></UrlList>
233233
<DynamicUrlList></DynamicUrlList>

0 commit comments

Comments
 (0)