feat: support dynamic configuration of RocksDB options via replica_envs #2388
Description
Feature Request
Is your feature request related to a problem? Please describe:
Currently, tuning RocksDB performance parameters (e.g., blob files, memtable settings, compaction settings) requires server restart or is not supported at all. This limits the ability to optimize storage performance dynamically based on workload characteristics.
Describe the feature you'd like:
Add support for dynamically configuring RocksDB options through replica_envs. This enables runtime adjustment of key RocksDB parameters without service restart.
Supported option categories:
| Category | Options |
|---|---|
| Blob File | rocksdb.enable_blob_files, rocksdb.blob_file_starting_level, rocksdb.min_blob_size, rocksdb.blob_file_size, rocksdb.blob_garbage_collection_force_threshold, rocksdb.blob_garbage_collection_age_cutoff, rocksdb.blob_compression_type, rocksdb.enable_blob_garbage_collection, rocksdb.blob_compaction_readahead_size, rocksdb.prepopulate_blob_cache |
| Memtable | rocksdb.inplace_update_num_locks, rocksdb.memtable_prefix_bloom_size_ratio, rocksdb.memtable_whole_key_filtering, rocksdb.memtable_huge_page_size |
| Compaction | rocksdb.target_file_size_multiplier, rocksdb.max_compaction_bytes, rocksdb.ignore_max_compaction_bytes_for_input, rocksdb.soft_pending_compaction_bytes_limit, rocksdb.hard_pending_compaction_bytes_limit |
| Level Compaction | rocksdb.level0_file_num_compaction_trigger, rocksdb.level0_slowdown_writes_trigger, rocksdb.level0_stop_writes_trigger, rocksdb.max_bytes_for_level_multiplier, rocksdb.max_bytes_for_level_base, rocksdb.target_file_size_base, rocksdb.max_write_buffer_number, rocksdb.arena_block_size |
| Other | rocksdb.periodic_compaction_seconds, rocksdb.bottommost_temperature, rocksdb.last_level_temperature |