You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: deploy-manage/monitor/autoops.md
+13-12Lines changed: 13 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,6 +10,8 @@ applies_to:
10
10
11
11
AutoOps diagnoses issues in Elasticsearch by analyzing hundreds of metrics, providing root-cause analysis and accurate resolution paths. With AutoOps, customers can prevent and resolve issues, cut down administration time, and optimize resource utilization.
12
12
13
+
AutoOps is currently only available for [{{ech}} deployments](/deploy-manage/deploy/elastic-cloud/cloud-hosted.md).
@@ -41,23 +43,22 @@ AutoOps diagnoses issues in Elasticsearch by analyzing hundreds of metrics, prov
41
43
42
44
## AutoOps retention period [ec_autoops_retention_period]
43
45
44
-
AutoOps currently has a four-day retention period for all Cloud Hosted customers.
46
+
AutoOps currently has a four-day retention period for all {{ech}} customers.
45
47
46
48
47
49
## AutoOps scope [ec_autoops_scope]
48
50
49
-
AutoOps currently monitors only {{es}}, not the entire {{stack}}. Any deployment information pertains solely to {{es}}. AutoOps supports {{es}} version according to the [supported Elastic Stack versions](https://www.elastic.co/support/eol). There are plans to expand AutoOps monitoring to the entire stack.
50
-
51
-
52
-
53
-
54
-
55
-
56
-
57
-
58
-
59
-
51
+
AutoOps currently monitors only {{es}}, not the entire {{stack}}. Any deployment information pertains solely to {{es}}. AutoOps supports {{es}} versions according to the [supported {{es}} versions](https://www.elastic.co/support/eol). There are plans to expand AutoOps monitoring to the entire stack.
60
52
61
53
54
+
## Section overview
62
55
56
+
In this section, you'll find the following information:
63
57
58
+
* How to [open AutoOps](/deploy-manage/monitor/autoops/ec-autoops-how-to-access.md) for your deployment.
59
+
* The contents of [AutoOps events](/deploy-manage/monitor/autoops/ec-autoops-events.md).
60
+
* The [views](/deploy-manage/monitor/autoops/views.md) AutoOps offers to gain insight into facets of your deployment.
61
+
* [Notification settings](/deploy-manage/monitor/autoops/ec-autoops-notifications-settings.md) that allow you to specify when and how to be notified.
62
+
* [Event settings](/deploy-manage/monitor/autoops/ec-autoops-event-settings.md) that allow you to fine-tune when events are triggered, and a method to [dismiss](/deploy-manage/monitor/autoops/ec-autoops-dismiss-event.md) certain categories of events.
63
+
* The [regions](/deploy-manage/monitor/autoops/ec-autoops-regions.md) where AutoOps is available.
Copy file name to clipboardExpand all lines: deploy-manage/monitor/autoops/ec-autoops-event-settings.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,12 +6,12 @@ applies_to:
6
6
ess: all
7
7
---
8
8
9
-
# Events Settings [ec-autoops-event-settings]
9
+
# Event Settings [ec-autoops-event-settings]
10
10
11
11
AutoOps events are triggered when specific conditions are met and are closed when those conditions are no longer satisfied. An event can be triggered by multiple conditions, and each event comes with a default setting that can be adjusted differently for each connected deployment.
12
12
13
13
::::{note}
14
-
Only a user with Cloud Organization Owner role can set up notifications.
14
+
Only **Organization owners** can set up notifications.
Copy file name to clipboardExpand all lines: deploy-manage/monitor/autoops/ec-autoops-events.md
+10-33Lines changed: 10 additions & 33 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,45 +8,22 @@ applies_to:
8
8
9
9
# AutoOps events [ec-autoops-events]
10
10
11
-
An AutoOps event provides a detailed analysis of a specific issue, including why it was triggered and the steps needed to resolve it. The following sections provide you with comprehensive insights and context around issues, the reasons why the event was created, as well as the affected nodes and indices with high indexing activity.
11
+
An AutoOps event provides a detailed analysis of a specific issue, including why it was triggered and the steps needed to resolve it.
The following sections provide you with comprehensive insights and context around issues, the reasons why the event was created, as well as the affected nodes and indices with high indexing activity.
17
18
18
-
## What was detected [ec-autoops-what-was-detected]
19
-
20
-
This section describes the reasons for which the event was created, as well as links to drill down into the issue.
21
-
22
-
23
-
## Recommendations [ec-autoops-recommendations]
24
-
25
-
AutoOps provides a set of recommendations. The sequence of their appearance indicates the suggested order of steps to address the issue.
26
-
27
-
28
-
## Event duration [ec-autoops-event-duration]
29
-
30
-
The time the event was detected (opened at) and the time AutoOps identified that the issue no longer exists (closed at). The closing of an event does not necessarily indicate that the customer resolved the issue, but rather that AutoOps no longer detects it.
31
-
32
-
33
-
## Background and impact [ec-autoops-background-impact]
34
-
35
-
Provides background and context as to why an event is important, and the impact it can have on performance and stability.
This chart visually represents metrics related to an issue. It appears only for events with dynamic metrics. For example, load issues will have this section, while settings-related issues will not. The event timeline chart displays just the last 15 minutes.
41
-
42
-
43
-
## Event severity [ec-autoops-event-severity]
44
-
45
-
Events are categorized into three levels of severity - high, medium, and low - based on their potential impact on cluster performance and stability:
46
-
47
-
* **High**: Events can immediately cause significant usability, performance and stability problems.
48
-
* **Medium**: Events may lead to severe problems if not addressed.
49
-
* **Low**: Events have minimal/not urgent impact.
19
+
| Section | Description |
20
+
| --- | --- |
21
+
| What was detected | This section describes the reasons for which the event was created, as well as links to drill down into the issue. |
22
+
| Recommendations | AutoOps provides a set of recommendations. The sequence of their appearance indicates the suggested order of steps to address the issue. |
23
+
| Event duration | The time the event was detected (opened at) and the time AutoOps identified that the issue no longer exists (closed at). The closing of an event does not necessarily indicate that the customer resolved the issue, but rather that AutoOps no longer detects it. |
24
+
| Background and impact | Provides background and context as to why an event is important, and the impact it can have on performance and stability. |
25
+
| Event timeline chart | This chart visually represents metrics related to an issue. It appears only for events with dynamic metrics. For example, load issues will have this section, while settings-related issues will not. The event timeline chart displays just the last 15 minutes. |
26
+
| Event severity | Events are categorized into three levels of severity - high, medium, and low - based on their potential impact on cluster performance and stability: <br><br>- **High**: Events can immediately cause significant usability, performance and stability problems.<br>- **Medium**: Events may lead to severe problems if not addressed.<br>- **Low**: Events have minimal/not urgent impact. |
AutoOps can notify you of new events opened or closed through various methods and operation management tools. With a customizable mechanism, you can specify which events you want to be notified about, how you wish to receive these notifications, and their frequency.
12
12
@@ -60,18 +60,22 @@ The following connectors are available with AutoOps:
60
60
* [Microsoft Teams Configuration](#ec-autoops-ms-configuration)
61
61
* [Webhook](#ec-autoops-webhook)
62
62
63
-
### Email [email]
63
+
:::{dropdown} Email
64
+
$$$email$$$
64
65
65
66
To set up notifications via email, follow these steps:
66
67
67
68
1. Add a new **Email** connector.
68
69
2. Add a list of emails.
69
70
You can add up to 40 emails for a single email connector, and opt in to get alerts also when events close.
70
-
4. To receive notifications, scroll down the **Notification** page and click **Add**.
71
-
5. Fill in the filter details.
72
-
6. Select the events that you want to send to this connector.
71
+
3. To receive notifications, scroll down the **Notification** page and click **Add**.
72
+
4. Fill in the filter details.
73
+
5. Select the events that you want to send to this connector.
74
+
:::
73
75
74
-
### PagerDuty [ec-autoops-pagerduty]
76
+
:::{dropdown} PagerDuty
77
+
78
+
$$$ec-autoops-pagerduty$$$
75
79
76
80
The PagerDuty integration consists of the following parts:
77
81
@@ -86,9 +90,12 @@ The PagerDuty integration consists of the following parts:
86
90
2. To receive Slack notifications, add a notification filter. Scroll down the Notification page and click **Add**.
87
91
3. Fill in the filter details.
88
92
4. Select the events that should be sent to this output.
93
+
:::
89
94
90
95
91
-
### Slack [ec-autoops-slack]
96
+
:::{dropdown} Slack
97
+
98
+
$$$ec-autoops-slack
92
99
93
100
To set up a webhook to send AutoOps notifications to a Slack channel, go through the following steps.
94
101
@@ -103,8 +110,12 @@ To set up a webhook to send AutoOps notifications to a Slack channel, go through
103
110
9. Copy the webhook URL to set up the webhook notification endpoint in AutoOps.
104
111
10. Add the webhook URL when creating the endpoint.
105
112
113
+
:::
114
+
115
+
116
+
:::{dropdown} VictorOps
106
117
107
-
### VictorOps [ec-autoops-victorops]
118
+
$$$ec-autoops-victorops$$$
108
119
109
120
The VictorOps integration consists of the following parts:
110
121
@@ -119,9 +130,12 @@ The VictorOps integration consists of the following parts:
119
130
2. To receive Slack notifications, add a notification filter. Scroll down the Notification page and click Add.
120
131
3. Fill in the filter details.
121
132
4. Select the events that should be sent to this output.
133
+
:::
134
+
122
135
136
+
:::{dropdown} Opsgenie
123
137
124
-
### Opsgenie [ec-autoops-opsgenie]
138
+
$$$ec-autoops-opsgenie$$$
125
139
126
140
The Opsgenie integration consists of the following parts:
127
141
@@ -141,9 +155,11 @@ The Opsgenie integration consists of the following parts:
141
155
4. To receive notifications on Opsgenie, you need to add a notification filter. Scroll down the **Notification** page and click **Add**.
142
156
5. Fill in the filter details.
143
157
6. Select events that should be sent to this output.
158
+
:::
144
159
160
+
:::{dropdown} Microsoft Teams
145
161
146
-
### Microsoft Teams Configuration [ec-autoops-ms-configuration]
162
+
$$$ec-autoops-ms-configuration$$$
147
163
148
164
To create an incoming webhook on your Microsoft Teams, follow [these instructions](https://docs.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/add-incoming-webhook).
149
165
@@ -155,43 +171,47 @@ Save the URL displayed during the creation of the incoming webhook, as you will
155
171
2. To receive notifications into Microsoft Teams, you need to add a notification filter. Scroll down the Notification page and click Add.
156
172
3. Fill in the filter details.
157
173
4. Select events that should be sent to this output.
174
+
:::
158
175
159
176
160
-
### Webhook [ec-autoops-webhook]
177
+
::::{dropdown} Webhook
178
+
179
+
$$$ec-autoops-webhook$$$
161
180
162
181
A webhook enables an application to provide other applications with real-time information. A webhook is a user-defined HTTP callback (HTTP POST), which is triggered by specific events.
163
182
164
183
**How to add a webhook notification**
165
184
166
185
1. Go to **Settings** → **Notifications*** → ***Endpoint settings** and click **Add**.
167
-
2. Select Webhook from the drop-dowon list and enter the following details:
186
+
2. Select Webhook from the drop-down list and enter the following details:
168
187
169
-
* Name: It must be a unique name for this webhook.
170
-
* URL: This is the endpoint to which HTTP POST requests will be sent when events occur.
171
-
* Method: POST
172
-
* Header: Content-Type, application/Json
188
+
* **Name**: It must be a unique name for this webhook.
189
+
* **URL**: This is the endpoint to which HTTP POST requests will be sent when events occur.
190
+
* **Method**: POST
191
+
* **Header**: Content-Type, application/Json
173
192
174
193
3. Review and update the message as it appears in the body section. AutoOps provides a set of optional fields to use in the message. Read your application documentation for the expected message schema.
175
194
176
-
* RESOURCE_ID – Customer Deployment ID
177
-
* RESOURCE_NAME – Customer Deployment name
178
-
* TITLE – The title of the event.
179
-
* DESCRIPTION – The description of the issue that was found.
180
-
* SEVERITY – One of the 3 severity levels (High, Medium and Low).
181
-
* STATUS – Indicate if the event is currently open or close.
182
-
* MESSAGE – The background and impact of the issue
183
-
* START_TIME – The time the event was open.
184
-
* END_TIME – The time the event was closed.
185
-
* ENDPOINT_TYPE – The type of the endpoint (Slack, PagerDuty, Webhook, Opsgenie, VictorOps and MS Teams).
186
-
* AFFECTED_NODES – List of node names.
187
-
* AFFECTED_INDICES – List of indices names.
188
-
* EVENT_LINK – Direct link to the event in AutoOps.
189
-
190
-
4. Click Validate to check your settings and click **Save**.
195
+
* `RESOURCE_ID`: Customer Deployment ID
196
+
* `RESOURCE_NAME`: Customer Deployment name
197
+
* `TITLE`: The title of the event.
198
+
* `DESCRIPTION`: The description of the issue that was found.
199
+
* `SEVERITY`: One of the 3 severity levels (High, Medium and Low).
200
+
* `STATUS`: Indicate if the event is currently open or close.
201
+
* `MESSAGE`: The background and impact of the issue
202
+
* `START_TIME`: The time the event was open.
203
+
* `END_TIME`: The time the event was closed.
204
+
* `ENDPOINT_TYPE`: The type of the endpoint (Slack, PagerDuty, Webhook, Opsgenie, VictorOps and MS Teams).
205
+
* `AFFECTED_NODES`: List of node names.
206
+
* `AFFECTED_INDICES`: List of indices names.
207
+
* `EVENT_LINK`: Direct link to the event in AutoOps.
208
+
209
+
4. Click **Validate** to check your settings, and then click **Save**.
191
210
5. Optionally, you can test the webhook integration by using the [webhook.site](https://webhook.site/#!/view/fe9d630e-2f01-44b7-9e41-ef9520fbe9a7).
192
211
193
-
::::{note}
212
+
:::{note}
194
213
When the Endpoint settings have been completed, continue to set up the notification filter to define which events you’d like to be notified about.
After you’ve enabled log delivery on your deployment, you can [add the Elasticsearch user settings](../../deploy/cloud-enterprise/edit-stack-settings.md) to enable these features.
30
+
31
+
32
+
### For {{kib}} [extra-logging-features-kibana]
33
+
34
+
* [Audit logging](../logging-configuration/enabling-audit-logs.md) - logs security-related events on your deployment
35
+
36
+
After you’ve enabled log delivery on your deployment, you can [add the {{kib}} user settings](../../deploy/cloud-enterprise/edit-stack-settings.md) to enable this feature.
37
+
38
+
39
+
### Other components [extra-logging-features-enterprise-search]
40
+
41
+
Enabling log collection also supports collecting and indexing the following types of logs from other components in your deployments:
42
+
43
+
**APM**
44
+
45
+
* `apm*.log*`
46
+
47
+
**Fleet and Elastic Agent**
48
+
49
+
* `fleet-server-json.log-*`
50
+
* `elastic-agent-json.log-*`
51
+
52
+
The `*` indicates that we also index the archived files of each type of log.
53
+
54
+
Check the respective product documentation for more information about the logging capabilities of each product.
Copy file name to clipboardExpand all lines: deploy-manage/monitor/logging-configuration/update-elasticsearch-logging-levels.md
+4-14Lines changed: 4 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,22 +19,12 @@ You can use {{es}}'s application logs to monitor your cluster and diagnose issue
19
19
On [Docker](../../deploy/self-managed/install-elasticsearch-with-docker.md), log messages go to the console and are handled by the configured Docker logging driver. To access logs, run `docker logs`.
20
20
::::::
21
21
22
-
::::::{tab-item} Debian (APT)
23
-
For [Debian installations](../../deploy/self-managed/install-elasticsearch-with-debian-package.md), {{es}} writes logs to `/var/log/elasticsearch`.
22
+
::::::{tab-item} Debian (APT) and RPM
23
+
For [Debian](../../deploy/self-managed/install-elasticsearch-with-debian-package.md) and [RPM](../../deploy/self-managed/install-elasticsearch-with-rpm.md) installations, {{es}} writes logs to `/var/log/elasticsearch`.
24
24
::::::
25
25
26
-
::::::{tab-item} RPM
27
-
For [RPM installations](../../deploy/self-managed/install-elasticsearch-with-rpm.md), {{es}} writes logs to `/var/log/elasticsearch`.
28
-
::::::
29
-
30
-
::::::{tab-item} macOS
31
-
For [macOS `.tar.gz`](../../deploy/self-managed/install-elasticsearch-from-archive-on-linux-macos.md) installations, {{es}} writes logs to `$ES_HOME/logs`.
32
-
33
-
Files in `$ES_HOME` risk deletion during an upgrade. In production, we strongly recommend you set `path.logs` to a location outside of `$ES_HOME`. See [Path settings](../../deploy/self-managed/important-settings-configuration.md#path-settings).
34
-
::::::
35
-
36
-
::::::{tab-item} Linux
37
-
For [Linux `.tar.gz`](../../deploy/self-managed/install-elasticsearch-from-archive-on-linux-macos.md) installations, {{es}} writes logs to `$ES_HOME/logs`.
26
+
::::::{tab-item} macOS and Linux
27
+
For [macOS and Linux `.tar.gz`](../../deploy/self-managed/install-elasticsearch-from-archive-on-linux-macos.md) installations, {{es}} writes logs to `$ES_HOME/logs`.
38
28
39
29
Files in `$ES_HOME` risk deletion during an upgrade. In production, we strongly recommend you set `path.logs` to a location outside of `$ES_HOME`. See [Path settings](../../deploy/self-managed/important-settings-configuration.md#path-settings).
0 commit comments