Skip to content

Commit 65aab4f

Browse files
authored
Adds AutoOps and Stack Monitoring comparison (#1711)
This PR makes the following changes: - adds the AutoOps and Stack Monitoring comparison ([preview](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/1711/deploy-manage/monitor/autoops/autoops-stack-monitoring-comparison)) to the AutoOps docs - references the article on the following pages: - Stack Monitoring ([preview](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/1711/deploy-manage/monitor/stack-monitoring)) - AutoOps FAQ ([preview](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/1711/deploy-manage/monitor/autoops/ec-autoops-faq)) - makes some clarity edits to the AutoOps FAQ page Closes: [#284](elastic/obs-docs-projects#284)
1 parent 7470ce5 commit 65aab4f

File tree

8 files changed

+183
-15
lines changed

8 files changed

+183
-15
lines changed
195 KB
Loading
199 KB
Loading
138 KB
Loading

deploy-manage/monitor.md

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,15 +23,24 @@ Depending on your deployment type, you can use a variety of solutions for monito
2323

2424
Depending on your deployment type and context, you have several options for monitoring your cluster or deployment.
2525

26+
If you’re using {{ech}}, you can use [AutoOps](/deploy-manage/monitor/autoops.md) to monitor your cluster.
27+
28+
AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection, and resolution paths. AutoOps is [rolling out](/deploy-manage/monitor/autoops/ec-autoops-regions.md) in phases across {{ech}} regions and cloud service providers. It will be automatically activated for your deployment with no installation required.
29+
30+
For other deployment types, use [Stack Monitoring](/deploy-manage/monitor/stack-monitoring.md) to monitor logs and metrics across the {{stack}}.
31+
32+
To help you make your decision, refer to [](/deploy-manage/monitor/autoops-vs-stack-monitoring.md).
33+
2634
### AutoOps (recommended)
2735

2836
```{applies_to}
2937
deployment:
3038
ess:
3139
```
3240

33-
:::{include} /deploy-manage/monitor/_snippets/autoops.md
34-
:::
41+
AutoOps diagnoses issues in {{es}} by analyzing hundreds of metrics, providing root-cause analysis and accurate resolution paths. With AutoOps, customers can prevent and resolve issues, cut down administration time, and optimize resource utilization.
42+
43+
AutoOps is currently only available for Elastic Cloud Hosted deployments.
3544

3645
### Stack monitoring
3746

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,5 @@
1-
If you’re using {{ech}}, then you can use AutoOps to monitor your cluster. AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection and resolution paths. AutoOps is [rolling out](/deploy-manage/monitor/autoops/ec-autoops-regions.md) in phases across {{ech}} regions and cloud service providers. It will be automatically activated for your deployment, with no installation required. For more information, refer to [Monitor with AutoOps](/deploy-manage/monitor/autoops.md).
1+
If you’re using {{ech}}, you can use [AutoOps](/deploy-manage/monitor/autoops.md) to monitor your cluster.
2+
3+
AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection, and resolution paths. AutoOps is [rolling out](/deploy-manage/monitor/autoops/ec-autoops-regions.md) in phases across {{ech}} regions and cloud service providers. It will be automatically activated for your deployment with no installation required.
4+
5+
To help you make your decision, refer to [](/deploy-manage/monitor/autoops-vs-stack-monitoring.md).
Lines changed: 154 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,154 @@
1+
---
2+
applies_to:
3+
deployment:
4+
ess: all
5+
ece: all
6+
eck: all
7+
self: all
8+
navigation_title: AutoOps vs. Stack Monitoring
9+
---
10+
11+
# AutoOps and Stack Monitoring comparison
12+
13+
This page provides a detailed comparison of AutoOps and Stack Monitoring to help you decide which solution is better suited to your needs.
14+
15+
## Review the main differences
16+
Review how these tools differ in their provisioning, set up procedure, method of access, and capabilities.
17+
18+
### Resource provisioning and billing
19+
20+
#### AutoOps [ao-resource]
21+
AutoOps stores and backs up your monitoring data internally on {{ecloud}} infrastructure so you don’t need to think about provisioning, sizing, and availability. The data is retained for four days by default. Using AutoOps is free for {{ecloud}} customers and is offered to [all subscription tiers](https://www.elastic.co/subscriptions/cloud).
22+
23+
#### Stack Monitoring [sm-resource]
24+
With Stack Monitoring, you are responsible for storing your monitoring data. This requires provisioning the necessary resources based on your performance and retention needs as well as paying for the allocated resources. The default retention period is six days.
25+
26+
### Setup
27+
28+
#### AutoOps [ao-setup]
29+
On {{ech}} (ECH), AutoOps is set up and enabled automatically in all supported [regions](/deploy-manage/monitor/autoops/ec-autoops-regions.md), with no action required from you.
30+
31+
:::{note}
32+
AutoOps is planned to be available in self-managed environments in the future.
33+
:::
34+
35+
:::{image} /deploy-manage/images/cloud-autoops-setup.png
36+
:alt: Diagram showing AutoOps setup in Elastic Cloud
37+
:::
38+
39+
#### Stack Monitoring [sm-setup]
40+
Stack Monitoring is a {{kib}} application that can be enabled on self-managed clusters on your premises, ECH deployments, {{eck}} (ECK), and {{ece}} (ECE). Stack Monitoring is not available on {{serverless-full}} since Elastic takes care of monitoring and managing your Serverless projects.
41+
42+
Depending on your deployment model, there is [some setting up](/deploy-manage/monitor/stack-monitoring.md#configure-and-use-stack-monitoring) involved to enable Stack Monitoring. You need to configure an agent, specify which logs and metrics you want to collect from all your {{stack}} components, and where to send them.
43+
44+
You can store your Stack Monitoring logs and metrics in the following ways:
45+
46+
* Within the monitored cluster itself:
47+
48+
:::{image} /deploy-manage/images/stack-monitoring-self-monitoring-cluster-setup.png
49+
:alt: Diagram showing Stack Monitoring setup on a self-monitoring cluster in Elastic Cloud
50+
:::
51+
52+
* Within a dedicated monitoring cluster, if you are concerned about resiliency and availability:
53+
54+
:::{image} /deploy-manage/images/stack-monitoring-dedicated-cluster-setup.png
55+
:alt: Diagram showing Stack Monitoring setup on a dedicated monitoring cluster in Elastic Cloud
56+
:::
57+
58+
### Availability
59+
60+
#### AutoOps [ao-availability]
61+
AutoOps lives in {{ecloud}}, so you need to have an {{ecloud}} account to access it. Once logged in, you can [access](/deploy-manage/monitor/autoops/ec-autoops-how-to-access.md) AutoOps from your hosted deployments.
62+
63+
#### Stack Monitoring [sm-availability]
64+
Once setup is complete, you can access the Stack Monitoring UI inside {{kib}}, where you can monitor all your {{stack}} components.
65+
66+
### Investigations and root cause analysis
67+
68+
#### AutoOps [ao-investigations]
69+
The AutoOps agent captures a pre-defined set of {{es}} metrics, but doesn’t fetch any logs. AutoOps then performs multi-metrics analysis and correlations to identify issues and potential root causes. When issues are detected, AutoOps raises [events](/deploy-manage/monitor/autoops/ec-autoops-events.md) and [notifies](/deploy-manage/monitor/autoops/ec-autoops-notifications-settings.md) you accordingly. When the issue is resolved, AutoOps automatically closes the event.
70+
71+
For each raised event, AutoOps provides insights into the affected resources (cluster, node, index, shard, etc.), background information on the detected problem, and step-by-step guides to help you diagnose and remediate the identified issues. Most detection rules can be [customized](/deploy-manage/monitor/autoops/ec-autoops-event-settings.md) by adjusting thresholds, durations, index patterns, data tiers, and more.
72+
73+
#### Stack Monitoring [sm-investigations]
74+
The Stack Monitoring UI displays the [metrics](/deploy-manage/monitor/monitoring-data/elasticsearch-metrics.md) of your monitored {{stack}} components over time. Logs can be viewed, searched, and filtered in Discover. You can enable a pre-defined set of alerts that are triggered when specific thresholds are crossed. You can also configure your own [alerts](/deploy-manage/monitor/monitoring-data/configure-stack-monitoring-alerts.md) on any collected metrics or log messages. However, Stack Monitoring does not offer any further investigation, correlations, or root cause analyses.
75+
76+
## Compare capabilities
77+
The following tables provide a detailed comparison of AutoOps and Stack Monitoring features.
78+
79+
### AutoOps-only features
80+
The following features are only available in AutoOps.
81+
82+
| Features | AutoOps | Stack Monitoring | Description |
83+
|---|---|---|---|
84+
| **Elasticsearch** | | | |
85+
| Pre-built customizable alerts ||| AutoOps offers hundreds of multi-metric customizable alerts on {{es}} specific issues. Stack Monitoring supports some pre-built alerts, but you can build more if needed. |
86+
| Multi metrics analysis ||| Advanced detection rules built on multiple metrics. |
87+
| Performance tuning insights ||| Insights on tuning configurations and data structures for better {{es}} performance. |
88+
| Root cause analysis ||| Identification of what went wrong including identifying the affected resources (clusters, nodes, indices, shards). |
89+
| Resolution paths ||| Recommendations and suggestions to mitigate detected problems. |
90+
| Knowledge base ||| Embedded knowledge base including links to articles and more information. |
91+
| Multi-cluster dashboard ||| AutoOps dashboard is better equipped to handle a large number of clusters compared to the Clusters listing page in Stack Monitoring. |
92+
| Events timeline ||| Comprehensive timeline of all raised events, organized by severity. |
93+
| Data-tier specific insights ||| Visibility into data-tier resource utilization and performance insights per data tier. |
94+
| Node-to-node comparison ||| Nodes listing and details combined into the same view for easier node-to-node resource and performance comparison. |
95+
| Index-to-index comparison ||| Index listing and details combined into the same view for easier index-to-index resource and performance comparison. |
96+
| Shards load heatmap ||| Node/index matrix showing shard activity on different selectable metrics. |
97+
| Template optimizer ||| Template/mapping analysis. |
98+
| Slow DSL query analysis ||| Identification of reasons for increased latency for DSL queries. |
99+
| Advanced customizations ||| Customization and dismissal of detection rules on specific deployments. |
100+
| Notification history ||| Comprehensive and curated notification history and reports. |
101+
102+
### Common features
103+
The following features are common between AutoOps and Stack Monitoring, sometimes with slight variations.
104+
105+
| Features | AutoOps | Stack Monitoring | Description |
106+
|---|---|---|---|
107+
| **Elasticsearch** | | | |
108+
| Clusters listing ||| Listing of all monitored clusters. |
109+
| Cluster overview ||| Overview of each monitored cluster. |
110+
| ES overview ||| Cluster-level performance metrics. |
111+
| ES nodes list ||| Listing of all Elasticsearch nodes. |
112+
| ES node details ||| Details on a specific node. |
113+
| ES indices list ||| Listing of all {{es}} indices. AutoOps allows sorting indices by search and indexing latency metrics, but Stack Monitoring doesn’t, making it difficult to identify slow indices. |
114+
| ES index details ||| Details on a specific index. |
115+
| Single metric detection ||| Basic single-metric detection rules. |
116+
| Simple alert customization ||| Basic customization of alerts. |
117+
| Alerts and notifications ||| Stack Monitoring provides [27 configurable connectors](kibana://reference/connectors-kibana.md) for alerts and notifications. AutoOps supports [7 of them](/deploy-manage/monitor/autoops/ec-autoops-notifications-settings.md#ec-built-in-connectors) and the email connector doesn’t require setting up an email server. |
118+
119+
### Stack Monitoring-only features (coming soon to AutoOps)
120+
The following features are currently only available in Stack Monitoring. These features will be available in AutoOps over time and any new features will primarily be added to AutoOps.
121+
122+
| Features | AutoOps | Stack Monitoring | Description |
123+
|---|---|---|---|
124+
| **Elasticsearch** | | | |
125+
| Ingest pipeline ||| Stack Monitoring supports ingest pipeline monitoring via a link to ad hoc dashboards. These are provided by the {{agent}} {{es}} integration which needs to be installed. |
126+
| CCR ||| Insights into CCR metrics. |
127+
| Machine Learning jobs ||| Insights into ML job statistics. |
128+
| Raw monitoring data ||| Availability of raw monitoring data. |
129+
| **Other Stack components** | | | |
130+
| Basic {{kib}} monitoring ||| More advanced {{kib}} monitoring is coming soon to AutoOps. |
131+
| Basic Logstash monitoring ||| Logstash monitoring in the Stack Monitoring UI has been [superseded](logstash://reference/monitoring-logstash-with-elastic-agent.md) by the ad hoc dashboards shipped via the {{agent}} Logstash integration. |
132+
| Basic APM server monitoring ||| Standard monitoring of APM servers |
133+
| Basic integration server monitoring ||| Standard monitoring of integration servers |
134+
135+
## Choose between AutoOps and Stack Monitoring
136+
137+
Keep using Stack Monitoring if you:
138+
139+
* are running the {{stack}} on-premise, air-gapped or otherwise
140+
* need to control monitoring data retention
141+
* need monitoring coverage for {{stack}} components other than {{es}}
142+
* have deployments in a region where AutoOps is not available yet
143+
144+
Start using AutoOps if you want:
145+
146+
* easier monitoring of your {{ecloud}} deployments
147+
* clear guidance and troubleshooting advice when issues arise
148+
* to efficiently monitor a large number of deployments
149+
* a comprehensive picture of the historical health of your deployments
150+
* your events and alerts to be highly customizable
151+
* an advanced notification system tailored for specific clusters and alert conditions
152+
* simplified interactions with Elastic Support
153+
154+

deploy-manage/monitor/autoops/ec-autoops-faq.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -10,35 +10,35 @@ products:
1010

1111
# AutoOps FAQ [ec-autoops-faq]
1212

13-
This frequently-asked-questions list answers some of your more common questions about AutoOps.
13+
Here are answers to some common questions about AutoOps.
1414

15-
$$$faq-what-is-autoops$$$What is AutoOps? What does it do?
15+
$$$faq-what-is-autoops$$$What does AutoOps do?
1616
: AutoOps for {{es}} significantly simplifies cluster management with performance recommendations, resource utilization and cost insights, real-time issue detection and resolution paths. By analyzing hundreds of {{es}} metrics, your configuration, and usage patterns, AutoOps recommends operational and monitoring insights that deliver savings in administration time and hardware costs.
1717

18-
$$$faq-autoops-availability$$$When will AutoOps be available for Self-hosted and Serverless users?
19-
: AutoOps will be available for Self-hosted and Serverless customers with a different set of capabilities in the future.
18+
$$$faq-autoops-availability$$$Will AutoOps be available for {{serverless-full}} and self-hosted users?
19+
: AutoOps will be available for {{serverless-full}} and self-hosted customers with a different set of capabilities in the future.
2020

2121
$$$faq-autoops-monitoring$$$Does AutoOps monitor the entire {{stack}}?
22-
: AutoOps is currently limited to {{es}} (not {{kib}}, Logstash and Beats).
22+
: AutoOps is currently limited to {{es}} (not {{kib}}, Logstash, and Beats).
2323

2424
$$$faq-autoops-supported-versions$$$What versions of {{es}} are supported for {{ech}}?
2525
: AutoOps supports {{es}} versions according to the [supported {{stack}} versions](https://www.elastic.co/support/eol).
2626

2727
$$$faq-autoops-license$$$How is AutoOps currently licensed?
28-
: AutoOps current feature set is available to {{ech}} customers at all subscription tiers. For more information refer to the [subscription page](https://www.elastic.co/subscriptions/cloud).
28+
: AutoOps' current feature set is available to {{ech}} customers at all subscription tiers. For more information, refer to the [subscription page](https://www.elastic.co/subscriptions/cloud).
2929

3030
$$$faq-autoops-installation$$$How does AutoOps get installed and why may I not see AutoOps available on specific deployments?
31-
: AutoOps is automatically applied to {{es}} clusters on {{ecloud}}, rolling out in phases across CSPs and regions. Read more about AutoOps [roll out](ec-autoops-regions.md) status.
31+
: AutoOps is automatically applied to {{es}} clusters on {{ecloud}}, rolling out in phases across CSPs and regions. Read more about AutoOps [regions](ec-autoops-regions.md).
3232

3333
$$$faq-autoops-issue-resolution$$$Can AutoOps currently automatically resolve issues?
34-
: AutoOps only analyzes metrics, and is a read-only solution.
34+
: AutoOps only analyzes metrics, and is a read-only solution.
3535

3636
$$$faq-autoops-data-retention$$$How long does Elastic retain AutoOps data?
37-
: Currently, AutoOps has a four-day retention period for all Hosted customers.
37+
: Currently, AutoOps has a four-day retention period for all {{ech}} customers.
3838

3939
$$$faq-autoops-metrics-storage$$$Where are AutoOps metrics stored, and does AutoOps affect customer ECU usage?
40-
: AutoOps metrics are stored internally within the Elastic infrastructure, not on customer deployments. Therefore, using AutoOps does not consume customer ECU).
40+
: AutoOps metrics are stored internally within the Elastic infrastructure, not on customer deployments. So using AutoOps does not consume customer ECU.
4141

42-
$$$faq-autoops-vs-stack-monitoring$$$Does AutoOps replace Stack Monitoring now?
43-
: As of now, AutoOps provides insights on {{es}} (not {{kib}}, Logstash and Beats) and analyzes metrics, but not logs. Stack Monitoring covers the entire stack and with it you can analyze logs.
42+
$$$faq-autoops-vs-stack-monitoring$$$Has AutoOps replaced Stack Monitoring?
43+
: Currently, AutoOps has many of the same features as Stack Monitoring as well as several new ones. However, it only provides insights on {{es}} and analyzes metrics, but not logs. Read more in [](/deploy-manage/monitor/autoops-vs-stack-monitoring.md).
4444

deploy-manage/toc.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -698,6 +698,7 @@ toc:
698698
- file: monitor/monitoring-data/config-monitoring-data-streams-elastic-agent.md
699699
- file: monitor/monitoring-data/config-monitoring-data-streams-metricbeat-8.md
700700
- file: monitor/monitoring-data/config-monitoring-indices-metricbeat-7-internal-collection.md
701+
- file: monitor/autoops-vs-stack-monitoring.md
701702
- file: monitor/cloud-health-perf.md
702703
children:
703704
- file: monitor/access-performance-metrics-on-elastic-cloud.md

0 commit comments

Comments
 (0)