Skip to content

Commit cb3709f

Browse files
committed
Arranged to fix headings
1 parent d8f5f81 commit cb3709f

File tree

1 file changed

+11
-9
lines changed

1 file changed

+11
-9
lines changed

docs/reference/how-to/size-your-shards.asciidoc

Lines changed: 11 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,14 @@
1+
[[size-your-shards]]
2+
== Size your shards
3+
4+
Proper shard sizing is crucial for maintaining the performance and stability of an {es} cluster. _Oversharding_ occurs when data is distributed across an excessive number of shards, which can degrade search performance and make the cluster unstable. Conversely, very large shards may slow down search operations and prolong recovery times after failures.
5+
6+
To strike the right balance, the <<shard-size-recommendation,general guidelines>> are to aim for shard sizes between 10GB and 50GB, keeping the per-shard document count below 200 million. To ensure that each node is working optimally, it's important to distribute shards evenly across nodes. Having uneven shard distribution will make some nodes work harder than others leading to performance degradation and potential instability.
7+
8+
If you are using <<data-streams>>, each data stream consists of multiple backing indices, each with its own set of shards. Proper shard planning for these indices is essential to maintaining performance and stability.
9+
10+
Despite these general guidelines, it is good to develop a tailored <<create-a-sharding-strategy, sharding strategy>> that considers your specific infrastructure, use case, and performance expectations.
11+
112
[discrete]
213
[[what-is-a-shard]]
314
=== What is a shard?
@@ -10,15 +21,6 @@ A shard is a basic unit of storage in {es}. Every index is divided into one or m
1021

1122
By effectively using shards, {es} can scale horizontally and provide fault tolerance, ensuring your data is distributed and queries are processed efficiently.
1223

13-
[[size-your-shards]]
14-
=== Size your shards
15-
16-
Proper shard sizing is crucial for maintaining the performance and stability of an {es} cluster. _Oversharding_ occurs when data is distributed across an excessive number of shards, which can degrade search performance and make the cluster unstable. Conversely, very large shards may slow down search operations and prolong recovery times after failures. To strike the right balance, the <<shard-size-recommendation,general guidelines>> are to aim for shard sizes between 10GB and 50GB, keeping the per-shard document count below 200 million. To ensure that each node is working optimally, it's important to distribute shards evenly across nodes. Having uneven shard distribution will make some nodes work harder than others leading to performance degradation and potential instability.
17-
18-
If you are using <<data-streams>> then each data stream is backed by a sequence of indices which are all broken into their own shards. Proper allocation of shards for each backing index is crucial to maintain performance and stability.
19-
20-
Despite these general guidelines, it is good to develop a tailored <<create-a-sharding-strategy, sharding strategy>> that considers your specific infrastructure, use case, and performance expectations.
21-
2224
[discrete]
2325
[[create-a-sharding-strategy]]
2426
=== Create a sharding strategy

0 commit comments

Comments
 (0)