Home

Non-default settings

On Linux we set swappiness to 0 and disable transparent huge pages (THP). ext4 with no tuning is the most common file system.

We make no changes to Windows settings apart from disabling scheduled disk defragmentation (also called "Disk optimization").

We also enable parallel bucket and views compaction. Fragmentation threshold differs from default settings and depends on test case and workload.

Bucket compaction

0. Disable auto-compaction.
1. Create initial dataset, wait for persistence and TAP replication.
2. Mutate (update) all items in dataset. Wait for persistence and TAP replication.
3. Trigger bucket compaction, report total compaction throughput (MBytes/sec) measured as:

(data_disk_size_before_compaction - data_disk_size_after_compaction) / total_compaction_time

Index compaction

0. Disable auto-compaction, disable automatic index updates.
1. Create initial dataset, wait for persistence and TAP replication.
2. Define design documents.
3. Trigger index build, wait for indexing to finish.
4. Mutate all items in dataset. Wait for persistence and TAP replication.
5. Trigger index build, wait for indexing to finish.
6. Trigger index compaction, report total compaction throughput (MBytes/sec) measured as:

(views_disk_size_before_compaction - views_disk_size_after_compaction) / total_compaction_time

Initial indexing

0. Disable auto-compaction.
1. Create initial dataset, wait for persistence and TAP replication.
2. Compact bucket.
3. Define design documents.
4. Trigger index build, report total indexing time in minutes.

Incremental indexing

0. Disable auto-compaction, disable automatic index updates.
1. Create initial dataset, wait for persistence and TAP replication.
2. Compact bucket.
3. Define design documents.
4. Trigger index build, wait for indexing to finish.
5. Double dataset. Wait for persistence and TAP replication.
6. Compact bucket.
7. Trigger index build, report total indexing time in minutes.

BgFetcher disk reads/sec

0. Disable auto-compaction.
1. Create initial dataset, wait for persistence and TAP replication.
2. Create working set via update or read operations, wait for persistence and TAP replication.
3. Compact bucket.
4. Start read-heavy front-end workload with high cache miss ratio (~40%).
5. Wait for predefined time (e.g., 1 hour), report average ep_bg_fetched per node.

Flusher drain rate

0. Disable auto-compaction.
1. Disable persistence.
2. Create initial dataset in memory.
3. Start background read-only workload.
4. Enable persistence, wait for persistence. Report average drain rate per node.

Static Rebalance

0. Disable auto-compaction.
1. Create initial dataset, wait for persistence and TAP replication.
2. Compact bucket.
3. Trigger cluster rebalance (IN/OUT), report total rebalance time.

Static Rebalance with Index

0. Disable auto-compaction.
1. Create initial dataset, wait for persistence and TAP replication.
2. Compact bucket.
3. Define design documents.
4. Trigger index build, wait for indexing to finish.
5. Trigger cluster rebalance (IN/OUT), report total rebalance time.

Rebalance

1. Create initial dataset, wait for persistence and TAP replication.
2. Create working set via update or read operations, wait for persistence and TAP replication.
3. Compact bucket.
4. Start front-end workload.
5. Trigger cluster rebalance (IN/OUT), report total rebalance time. Notice that there is a delay before and after rebalance.

Rebalance with Queries

1. Create initial dataset, wait for persistence and TAP replication.
2. Create working set via update or read operations, wait for persistence and TAP replication.
3. Compact bucket.
4. Define design documents.
5. Trigger index build, wait for indexing to finish.
6. Start front-end workload with view queries.
7. Trigger cluster rebalance (IN/OUT), report total rebalance time. Notice that there is a delay before and after rebalance.

Initial XDC replication

0. Disable auto-compaction.
1. Create initial dataset (source cluster), wait for persistence and TAP replication.
2. Compact bucket.
3. Initialize remote replication, report average replication rate.

XDCR

1. Create initial dataset (source cluster), wait for persistence and TAP replication.
2. Initialize remote replication, wait for initial replication, wait for persistence and TAP replication.
3. Compact bucket.
4. Run front-end workload, report maximum XDCR lag and maximum XDCR queue length.