Skip to content

Commit 3a78aec

Browse files
Simran-Bnerpaula
andauthored
RocksDB upgrade to 9.5.0 release notes (#710)
* WIP: RocksDB upgrade to 9.5.0 release notes * Throttling wasn't changed * Apply to 3.13 * Clarify units * Some RocksDB startup option defaults have been reverted * Fix merge error * Fix merge mistake --------- Co-authored-by: Paula Mihu <[email protected]>
1 parent d596f51 commit 3a78aec

File tree

5 files changed

+96
-2
lines changed

5 files changed

+96
-2
lines changed

site/content/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -900,6 +900,20 @@ the following steps.
900900
4. Restore the dump to the new deployment. You can directly move from any
901901
3.11 or 3.12 version to 3.12.4 (or later) this way.
902902

903+
## RocksDB upgrade
904+
905+
<small>Introduced in: v3.12.6</small>
906+
907+
The RocksDB library has been upgraded from version 7.2.0 to 9.5.0.
908+
909+
As part of this storage engine upgrade, the default values of the following
910+
RocksDB-related startup options have been changed:
911+
912+
- `--rocksdb.pending-compactions-slowdown-trigger` has been changed from 128 KiB to 1 GiB.
913+
- `--rocksdb.pending-compactions-stop-trigger` has been changed from 16 GiB to 32 GiB.
914+
- `--rocksdb.partition-files-for-documents` has been changed from false to true.
915+
- `--rocksdb.throttle-slow-down-writes-trigger` has been obsoleted.
916+
903917
## Optional elevation for GeoJSON Points
904918

905919
<small>Introduced in: v3.11.14-2, v3.12.6</small>

site/content/3.12/release-notes/version-3.12/whats-new-in-3-12.md

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2243,6 +2243,40 @@ DB-Servers in a cluster has been added:
22432243
|:------|:------------|
22442244
| `arangodb_vocbase_transactions_lost_subordinates_total` | Counts the number of lost subordinate transactions on database servers. |
22452245

2246+
### RocksDB upgrade
2247+
2248+
<small>Introduced in: v3.12.6</small>
2249+
2250+
The RocksDB library has been upgraded from version 7.2.0 to 9.5.0.
2251+
2252+
As a result, you may see performance improvements while using slightly less
2253+
resources especially for mixed workloads.
2254+
2255+
The following new RocksDB functionality is exposed in ArangoDB:
2256+
2257+
- Different types of block caches, LRU and HyperClockCache (HCC), selectable via
2258+
the new `--rocksdb.block-cache-type` startup option
2259+
- A `--rocksdb.block-cache-estimated-entry-charge` startup option to configure the HCC.
2260+
- RocksDB table format version 6 (not downwards-compatible to older versions of RocksDB).
2261+
- RocksDB blob caching (if blobs are enabled for the documents column family),
2262+
which you can enable via `--rocksdb.enable-blob-cache`.
2263+
- Using blob files only from a certain level onwards (if blobs are enabled for
2264+
the documents column family), which you can enable via
2265+
`--rocksdb.blob-file-starting-level`.
2266+
- Blob cache prepopulation, which you can enable via `--rocksdb.prepopulate-blob-cache`.
2267+
- An option to generate Bloom/Ribbon filters that minimize memory internal
2268+
fragmentation, which you can enable with `--rocksdb.optimize-filters-for-memory`.
2269+
2270+
The following RocksDB metrics have been added:
2271+
2272+
| Label | Description |
2273+
|:------|:------------|
2274+
| `rocksdb_block_cache_charge_per_entry` | Average size of entries in RocksDB block cache.
2275+
| `rocksdb_block_cache_entries` | Number of entries in the RocksDB block cache.
2276+
| `rocksdb_live_blob_file_garbage_size` | Size of garbage in live RocksDB .blob files.
2277+
| `rocksdb_live_blob_file_size` | Size of live RocksDB .blob files.
2278+
| `rocksdb_num_blob_files` | Number of live RocksDB .blob files.
2279+
22462280
### API call recording
22472281

22482282
<small>Introduced in: v3.12.5</small>

site/content/3.13/release-notes/version-3.12/api-changes-in-3-12.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -309,7 +309,6 @@ is for debugging purposes.
309309
See [HTTP interface for server logs](../../develop/http-api/monitoring/logs.md#get-recent-api-calls)
310310
for details.
311311

312-
313312
#### AQL query recording
314313

315314
<small>Introduced in: v3.12.6</small>

site/content/3.13/release-notes/version-3.12/incompatible-changes-in-3-12.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -900,6 +900,20 @@ the following steps.
900900
4. Restore the dump to the new deployment. You can directly move from any
901901
3.11 or 3.12 version to 3.12.4 (or later) this way.
902902

903+
## RocksDB upgrade
904+
905+
<small>Introduced in: v3.12.6</small>
906+
907+
The RocksDB library has been upgraded from version 7.2.0 to 9.5.0.
908+
909+
As part of this storage engine upgrade, the default values of the following
910+
RocksDB-related startup options have been changed:
911+
912+
- `--rocksdb.pending-compactions-slowdown-trigger` has been changed from 128 KiB to 1 GiB.
913+
- `--rocksdb.pending-compactions-stop-trigger` has been changed from 16 GiB to 32 GiB.
914+
- `--rocksdb.partition-files-for-documents` has been changed from false to true.
915+
- `--rocksdb.throttle-slow-down-writes-trigger` has been obsoleted.
916+
903917
## Optional elevation for GeoJSON Points
904918

905919
<small>Introduced in: v3.11.14-2, v3.12.6</small>

site/content/3.13/release-notes/version-3.12/whats-new-in-3-12.md

Lines changed: 34 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2243,6 +2243,40 @@ DB-Servers in a cluster has been added:
22432243
|:------|:------------|
22442244
| `arangodb_vocbase_transactions_lost_subordinates_total` | Counts the number of lost subordinate transactions on database servers. |
22452245

2246+
### RocksDB upgrade
2247+
2248+
<small>Introduced in: v3.12.6</small>
2249+
2250+
The RocksDB library has been upgraded from version 7.2.0 to 9.5.0.
2251+
2252+
As a result, you may see performance improvements while using slightly less
2253+
resources especially for mixed workloads.
2254+
2255+
The following new RocksDB functionality is exposed in ArangoDB:
2256+
2257+
- Different types of block caches, LRU and HyperClockCache (HCC), selectable via
2258+
the new `--rocksdb.block-cache-type` startup option
2259+
- A `--rocksdb.block-cache-estimated-entry-charge` startup option to configure the HCC.
2260+
- RocksDB table format version 6 (not downwards-compatible to older versions of RocksDB).
2261+
- RocksDB blob caching (if blobs are enabled for the documents column family),
2262+
which you can enable via `--rocksdb.enable-blob-cache`.
2263+
- Using blob files only from a certain level onwards (if blobs are enabled for
2264+
the documents column family), which you can enable via
2265+
`--rocksdb.blob-file-starting-level`.
2266+
- Blob cache prepopulation, which you can enable via `--rocksdb.prepopulate-blob-cache`.
2267+
- An option to generate Bloom/Ribbon filters that minimize memory internal
2268+
fragmentation, which you can enable with `--rocksdb.optimize-filters-for-memory`.
2269+
2270+
The following RocksDB metrics have been added:
2271+
2272+
| Label | Description |
2273+
|:------|:------------|
2274+
| `rocksdb_block_cache_charge_per_entry` | Average size of entries in RocksDB block cache.
2275+
| `rocksdb_block_cache_entries` | Number of entries in the RocksDB block cache.
2276+
| `rocksdb_live_blob_file_garbage_size` | Size of garbage in live RocksDB .blob files.
2277+
| `rocksdb_live_blob_file_size` | Size of live RocksDB .blob files.
2278+
| `rocksdb_num_blob_files` | Number of live RocksDB .blob files.
2279+
22462280
### API call recording
22472281

22482282
<small>Introduced in: v3.12.5</small>
@@ -2275,7 +2309,6 @@ impact of this feature:
22752309
See [HTTP interface for server logs](../../develop/http-api/monitoring/logs.md#get-recent-api-calls)
22762310
for details.
22772311

2278-
22792312
### AQL query recording
22802313

22812314
<small>Introduced in: v3.12.6</small>

0 commit comments

Comments
 (0)