Skip to content
Merged
Show file tree
Hide file tree
Changes from 5 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/reference/monitoring/overview.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,13 @@
<titleabbrev>Overview</titleabbrev>
++++

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

When you monitor a cluster, you collect data from the {es} nodes, {ls} nodes,
{kib} instances, {ents}, APM Server, and Beats in your cluster. You can also
collect logs.
Expand Down
7 changes: 7 additions & 0 deletions docs/reference/troubleshooting.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,13 @@
This section provides a series of troubleshooting solutions aimed at helping users
fix problems that an {es} deployment might encounter.

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

[discrete]
[[troubleshooting-general]]
=== General
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[circuit-breaker-errors]]
=== Circuit breaker errors

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

{es} uses <<circuit-breaker,circuit breakers>> to prevent nodes from running out
of JVM heap memory. If Elasticsearch estimates an operation would exceed a
circuit breaker, it stops the operation and returns an error.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[diagnose-unassigned-shards]]
== Diagnose unassigned shards

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

There are multiple reasons why shards might get unassigned, ranging from misconfigured
allocation settings to lack of disk space.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[fix-watermark-errors]]
=== Fix watermark errors

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

++++
<titleabbrev>Watermark errors</titleabbrev>
++++
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[high-cpu-usage]]
=== High CPU usage

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

{es} uses <<modules-threadpool,thread pools>> to manage CPU resources for
concurrent operations. High CPU usage typically means one or more thread pools
are running low.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,13 @@ High JVM memory usage can degrade cluster performance and trigger
taking steps to reduce memory pressure if a node's JVM memory usage consistently
exceeds 85%.

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

[discrete]
[[diagnose-high-jvm-memory-pressure]]
==== Diagnose high JVM memory pressure
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,13 @@
++++
:keywords: hot-spotting, hotspot, hot-spot, hot spot, hotspots, hotspotting

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Computer link:{wikipedia}/Hot_spot_(computer_programming)[hot spotting]
may occur in {es} when resource utilizations are unevenly distributed across
<<modules-node,nodes>>. Temporary spikes are not usually considered problematic, but
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[red-yellow-cluster-status]]
=== Red or yellow cluster health status

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

A red or yellow cluster health status indicates one or more shards are not assigned to
a node.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[rejected-requests]]
=== Rejected requests

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

When {es} rejects a request, it stops the operation and returns an error with a
`429` response code. Rejected requests are commonly caused by:

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[increase-cluster-shard-limit]]
== Total number of shards per node has been reached

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Elasticsearch tries to take advantage of all the available resources by
distributing data (index shards) amongst the cluster nodes.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[increase-shard-limit]]
== Total number of shards for an index on a single node exceeded

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Elasticsearch tries to take advantage of all the available resources by
distributing data (index shards) among nodes in the cluster.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[increase-tier-capacity]]
== Not enough nodes to allocate all shard replicas

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Distributing copies of the data (index shard replicas) on different nodes can
parallelize processing requests thus speeding up search queries. This can be
achieved by increasing the number of replica shards up to the maximum value
Expand Down
7 changes: 7 additions & 0 deletions docs/reference/troubleshooting/diagnostic.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,13 @@
++++
:keywords: Elasticsearch diagnostic, diagnostics

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

The {es} https://github.com/elastic/support-diagnostics[Support Diagnostic] tool captures a point-in-time snapshot of cluster statistics and most settings.
It works against all {es} versions.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,13 @@

This guide describes how to fix common errors and problems with {es} clusters.

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

<<fix-watermark-errors,Watermark errors>>::
Fix watermark errors that occur when a data node is critically low on disk space
and has reached the flood-stage disk usage watermark.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[repeated-snapshot-failures]]
== Addressing repeated snapshot policy failures

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Repeated snapshot failures are usually an indicator of a problem with your deployment. Continuous failures of automated
snapshots can leave a deployment without recovery options in cases of data loss or outages.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[troubleshooting-shards-capacity-issues]]
== Troubleshooting shards capacity health issues

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

{es} limits the maximum number of shards to be held per node using the
<<cluster-max-shards-per-node, `cluster.max_shards_per_node`>> and
<<cluster-max-shards-per-node-frozen, `cluster.max_shards_per_node.frozen`>> settings.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[troubleshooting-unbalanced-cluster]]
== Troubleshooting an unbalanced cluster

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Elasticsearch balances shards across data tiers to achieve a good compromise between:

* shard count
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
[[troubleshooting-unstable-cluster]]
== Troubleshooting an unstable cluster

****
AutoOps is now available!

AutoOps for {es} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {es} metrics, your configuration, and usage patterns, AutoOps offers operational and monitoring insights that can substantially reduce administration time and hardware costs. AutoOps is
https://www.elastic.co/guide/en/cloud/current/ec-autoops-regions.html[rolling out] in phases across Elastic Cloud Hosted regions and CSP. It will be automatically activated for your deployment, with no installation required. For more information, check https://www.elastic.co/guide/en/cloud/current/ec-autoops.html[Monitor with AutoOps].
****

Normally, a node will only leave a cluster if deliberately shut down. If a node
leaves the cluster unexpectedly, it's important to address the cause. A cluster
in which nodes leave unexpectedly is unstable and can create several issues.
Expand Down
Loading