You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -94,9 +98,13 @@ The environmental variables for the clearlydefined-api-dev App Service include:
94
98
* HARVEST_QUEUE_PREFIX
95
99
* HARVEST_QUEUE_PROVIDER
96
100
* HARVESTER_PROVIDER
101
+
* LOG_NODE_HEAPSTATS
102
+
* LOG_NODE_HEAPSTATS_INTERVAL_MS
97
103
* NODE_ENV
98
104
* RATE_LIMIT_MAX
99
105
* RATE_LIMIT_WINDOW
106
+
* BATCH_RATE_LIMIT_MAX
107
+
* BATCH_RATE_LIMIT_WINDOW
100
108
* SEARCH_AZURE_API_KEY
101
109
* SEARCH_AZURE_SERVICE
102
110
* SEARCH_PROVIDER
@@ -312,6 +320,28 @@ Important to ensure that any other instances of production crawlers that use the
312
320
313
321
This indicates what type of service we use for harvesting, in this case it's **crawlerQueue**, which corresponds with the [crawlerQueue harvest provider](https://github.com/clearlydefined/service/blob/master/providers/harvest/crawlerQueue.js)
314
322
323
+
### LOG_NODE_HEAPSTATS
324
+
325
+
This is an optional flag to `enable` logging of Node's `v8` module's memory usage data using the `getHeapSpaceStatistics` and `getHeapStatistics()` functions.
326
+
327
+
Value is either `true` or `false`
328
+
> Note: if this env var is not present, it equates to `false`
This is an optional environment variable that sets the interval to log heap statistics (When enabled).
339
+
340
+
Value is a number in `ms` (`milliseconds`).
341
+
> NOTE: The default value is `30000` ms (`30` seconds)
342
+
> example:
343
+
> `LOG_NODE_HEAPSTATS_INTERVAL_MS` = `10000`
344
+
315
345
### MULTIVERSION_CURATION_FF
316
346
317
347
This is a feature flag that indicates whether the [Multi-version curation feature](https://github.com/clearlydefined/service/pull/810) is active.
@@ -334,6 +364,14 @@ When we [use this value in the code](https://github.com/clearlydefined/service/b
334
364
335
365
So, one IP address can only call the ClearlyDefined API 500 times every 300 seconds.
336
366
367
+
### BATCH_RATE_LIMIT_MAX
368
+
369
+
Defines the maximum number of requests allowed from a single IP to the batch endpoints within the batch rate limit window.
370
+
371
+
### BATCH_RATE_LIMIT_WINDOW
372
+
373
+
Defines the time window (in seconds) used to apply `BATCH_RATE_LIMIT_MAX` for batch endpoints. This value is multiplied by 1000 internally to convert to milliseconds (same as `RATE_LIMIT_WINDOW`)
374
+
337
375
### SEARCH_PROVIDER
338
376
339
377
We use [Azure Cognitive Search](https://docs.microsoft.com/en-us/azure/search/search-what-is-azure-search) to power ClearlyDefined's Search functionality, in this case this is indicated with the string "azure".
0 commit comments