Skip to content

Commit c46cb0e

Browse files
[apm/known_issues] Add known issues for ILM to DSL switch (#4192)
* Add known issues for ILM to DSL switch * Apply suggestions from code review Co-authored-by: Colleen McGinnis <[email protected]> * Update ki based on recent changes * update link of fix to the latest one * Update wording for cause * Avoid using abbrev for data stream lifecycle * Apply suggestions from code review Co-authored-by: Colleen McGinnis <[email protected]> --------- Co-authored-by: Colleen McGinnis <[email protected]>
1 parent 68b9632 commit c46cb0e

File tree

1 file changed

+76
-0
lines changed

1 file changed

+76
-0
lines changed

docs/en/observability/apm/known-issues.asciidoc

Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,82 @@ If applicable, exact error messages linked to this issue so users searching for
1919
Link to fix
2020
////
2121

22+
*Upgrading to v8.15.0 may cause APM indices to lose their lifecycle policy* +
23+
_Elastic Stack versions: 8.15.0_ +
24+
_Fixed in Elastic Stack version 8.15.1_
25+
26+
// The conditions in which this issue occurs
27+
The issue only occurs when _upgrading_ the {stack} to 8.15.0.
28+
The issue does _not_ occur when creating a _new_ cluster using 8.15.0.
29+
The issue also does not occur if a custom ILM policy is configured using a custom component template.
30+
31+
// Describe why it happens
32+
In 8.15.0, APM Server switched to use data stream lifecycle to manage data retention
33+
for APM indices for new deployments as well as for upgraded deployments with default lifecycle
34+
configurations. Unfortunately, since any data stream created before 8.15.0 does not have a data
35+
stream lifecycle configuration, such existing data streams become unmanaged for default
36+
lifecycle configurations.
37+
38+
// How to fix it
39+
Upgrading to 8.15.1 should fix any new indices created for the data stream. However,
40+
indices created in version 8.15.0 would remain unmanaged if the default ILM policy is
41+
used. One of the following approaches can be adopted to fix the unmanaged indices:
42+
1. Manually delete the indices when they are no longer needed.
43+
2. Explicitly configure APM data streams with the default data stream lifecycle config.
44+
Using this approach would migrate all data streams to use data stream lifecycles,
45+
which should be equivalent to the default ILM policies:
46+
47+
[source,txt]
48+
----
49+
PUT _data_stream/traces-apm-*/_lifecycle
50+
{
51+
"data_retention": "10d"
52+
}
53+
54+
PUT _data_stream/traces-apm.rum*/_lifecycle
55+
{
56+
"data_retention": "90d"
57+
}
58+
59+
PUT _data_stream/traces-apm.sampled*/_lifecycle
60+
{
61+
"data_retention": "1h"
62+
}
63+
64+
PUT _data_stream/metrics-apm.*.1m-*/_lifecycle
65+
{
66+
"data_retention": "90d"
67+
}
68+
69+
PUT _data_stream/metrics-apm.*.10m-*/_lifecycle
70+
{
71+
"data_retention": "180d"
72+
}
73+
74+
PUT _data_stream/metrics-apm.*.60m-*/_lifecycle
75+
{
76+
"data_retention": "390d"
77+
}
78+
79+
PUT _data_stream/metrics-apm.internal-*/_lifecycle
80+
{
81+
"data_retention": "90d"
82+
}
83+
84+
PUT _data_stream/metrics-apm.app.*/_lifecycle
85+
{
86+
"data_retention": "90d"
87+
}
88+
89+
PUT _data_stream/logs-apm.*/_lifecycle
90+
{
91+
"data_retention": "10d"
92+
}
93+
----
94+
95+
// Link to fix if it exists
96+
This issue is fixed in 8.15.1 (https://github.com/elastic/elasticsearch/pull/112432[elastic/elasticsearch#112432]).
97+
2298
[[broken-apm-anomaly-rule]]
2399
*Upgrading to v8.13.0 to v8.13.2 breaks APM anomaly rules* +
24100
_Elastic Stack versions: 8.13.0, 8.13.1, 8.13.2_ +

0 commit comments

Comments
 (0)