Skip to content

Conversation

idegtiarenko
Copy link
Contributor

Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.
@idegtiarenko idegtiarenko added >docs General docs changes :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. labels Oct 28, 2024
Copy link
Contributor

Documentation preview:

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

@elasticsearchmachine elasticsearchmachine added Team:Docs Meta label for docs team v9.0.0 labels Oct 28, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

IMPORTANT: {es} generally expects nodes within a data tier to share the same
hardware profile. Variations not following this recommendation should be
carefully architected to avoid <<hotspotting,hot spotting>>.
IMPORTANT: {es} generally expects nodes within a data tier to share the same hardware profile (such as CPU, RAM, disk capacity)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
IMPORTANT: {es} generally expects nodes within a data tier to share the same hardware profile (such as CPU, RAM, disk capacity)
IMPORTANT: By default, {es} assumes nodes within a data tier share the same hardware profile (such as CPU, RAM, disk capacity)

Should we potentially take out "generally" and/or add "by default" in order to firm this as baseline expectation? Or go as far to say ES "assumes" this is true so if you want to do different you need to "carefully architect" (I like that phrasing)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd just say "Elasticsearch expects"

carefully architected to avoid <<hotspotting,hot spotting>>.
IMPORTANT: {es} generally expects nodes within a data tier to share the same hardware profile (such as CPU, RAM, disk capacity)
as it spreads the load equally across all nodes within the data tier.
Variations not following this recommendation should be carefully architected to avoid <<hotspotting,hot spotting>>.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This construction is a little confusing. What steps could someone take to "carefully architect" a node to avoid hot spotting? if we can't provide recommendations, I'd change this to "Data tiers with unequally resourced nodes are at risk of hot spotting."

@elasticsearchmachine elasticsearchmachine removed the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Nov 6, 2024
Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM2

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination)

@elasticsearchmachine elasticsearchmachine added the Team:Distributed Coordination Meta label for Distributed Coordination team label Nov 11, 2024
@idegtiarenko idegtiarenko merged commit 3ebc1f4 into elastic:main Nov 11, 2024
5 checks passed
@idegtiarenko idegtiarenko deleted the doc_clarify_tier_node_disk branch November 11, 2024 14:59
jozala pushed a commit that referenced this pull request Nov 13, 2024
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.
afoucret pushed a commit to afoucret/elasticsearch that referenced this pull request Nov 14, 2024
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.
alexey-ivanov-es pushed a commit to alexey-ivanov-es/elasticsearch that referenced this pull request Nov 28, 2024
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.
@ywangd
Copy link
Member

ywangd commented Jan 21, 2025

💚 All backports created successfully

Status Branch Result
8.x
8.17
8.16

Questions ?

Please refer to the Backport tool documentation

ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)
ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)
ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)
elasticsearchmachine pushed a commit that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)

Co-authored-by: Ievgen Degtiarenko <[email protected]>
elasticsearchmachine pushed a commit that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)

Co-authored-by: Ievgen Degtiarenko <[email protected]>
elasticsearchmachine pushed a commit that referenced this pull request Jan 21, 2025
Make it explicit that es expects disks to have the same capacity across all the nodes in the same data tier.

(cherry picked from commit 3ebc1f4)

Co-authored-by: Ievgen Degtiarenko <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) >docs General docs changes Team:Distributed Coordination Meta label for Distributed Coordination team Team:Docs Meta label for docs team v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants