Merge pull request #303 from grafana/enable-lazy-loading-index-header

Enable index-header lazy loading in store-gateway

Author: pracucci

CHANGELOG.md

@@ -4,6 +4,7 @@
 
 * [CHANGE] Replace use of removed Cortex CLI flag `-querier.compress-http-responses` for query frontend with `-api.response-compression-enabled`. #299
 * [CHANGE] The default dashboards config now display panels for the Cortex blocks storage only. If you're running Cortex chunks storage, please change `storage_engine` config to `['chunks']` or `['chunks', 'blocks']` if running both. #302
+* [CHANGE] Enabled index-header lazy loading in store-gateways. #303
 * [FEATURE] Added "Cortex / Rollout progress" dashboard. #289 #290
 * [FEATURE] Added support for using query-scheduler component, which moves the queue out of query-frontend, and allows scaling up of query-frontend component. #295
 * [ENHANCEMENT] Added `newCompactorStatefulSet()` function to create a custom statefulset for the compactor. #287

cortex/tsdb.libsonnet

@@ -212,6 +212,10 @@
       // Persist ring tokens so that when the store-gateway will be restarted
       // it will pick the same tokens
       'store-gateway.sharding-ring.tokens-file-path': '/data/tokens',
+
+      // Block index-headers are pre-downloaded but lazy mmaped and loaded at query time.
+      'blocks-storage.bucket-store.index-header-lazy-loading-enabled': 'true',
+      'blocks-storage.bucket-store.index-header-lazy-loading-idle-timeout': '60m',
     } +
     $.blocks_chunks_caching_config +
     $.blocks_metadata_caching_config +