You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/cluster-logging-deploy-storage-considerations.adoc
+6-20Lines changed: 6 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,14 +6,10 @@
6
6
= Storage considerations for OpenShift Logging and {product-title}
7
7
8
8
////
9
-
An Elasticsearch index is a collection of primary shards and its corresponding replica
10
-
shards. This is how Elasticsearch implements high availability internally, so there
11
-
is little requirement to use hardware based mirroring RAID variants. RAID 0 can still
12
-
be used to increase overall disk performance.
9
+
An Elasticsearch index is a collection of primary shards and their corresponding replica shards. This is how Elasticsearch implements high availability internally, so there is little requirement to use hardware based mirroring RAID variants. RAID 0 can still be used to increase overall disk performance.
13
10
////
14
11
15
-
A persistent volume is required for each Elasticsearch deployment configuration. On {product-title} this is achieved using
16
-
persistent volume claims.
12
+
A persistent volume is required for each Elasticsearch deployment configuration. On {product-title} this is achieved using persistent volume claims.
17
13
18
14
The Elasticsearch Operator names the PVCs using the Elasticsearch resource name.
Calculating total logging throughput and disk space required for your {product-title} cluster requires knowledge of your applications. For example, if one of your
60
-
applications on average logs 10 lines-per-second, each 256 bytes-per-line,
61
-
calculate per-application throughput and disk space as follows:
55
+
Calculating the total logging throughput and disk space required for your {product-title} cluster requires knowledge of your applications. For example, if one of your applications on average logs 10 lines-per-second, each 256 bytes-per-line, calculate per-application throughput and disk space as follows:
62
56
63
57
----
64
58
(bytes-per-line * (lines-per-second) = 2560 bytes per app per second
@@ -69,19 +63,11 @@ calculate per-application throughput and disk space as follows:
69
63
70
64
Fluentd ships any logs from *systemd journal* and **/var/log/containers/*.log** to Elasticsearch.
71
65
72
-
Therefore, consider how much data you need in advance and that you are
73
-
aggregating application log data. Some Elasticsearch users have found that it
74
-
is necessary to keep absolute storage consumption around 50% and below 70% at all times. This
75
-
helps to avoid Elasticsearch becoming unresponsive during large merge
76
-
operations.
66
+
Elasticsearch requires sufficient memory to perform large merge operations. If it does not have enough memory, it becomes unresponsive. To avoid this problem, evaluate how much application log data you need, and allocate approximately double that amount of free storage capacity.
77
67
78
-
By default, at 85% Elasticsearch stops allocating new data to the node, at 90% Elasticsearch attempts to relocate
79
-
existing shards from that node to other nodes if possible. But if no nodes have free capacity below 85%, Elasticsearch effectively rejects creating new indices
80
-
and becomes RED.
68
+
By default, when storage capacity is 85% full, Elasticsearch stops allocating new data to the node. At 90%, Elasticsearch attempts to relocate existing shards from that node to other nodes if possible. But if no nodes have a free capacity below 85%, Elasticsearch effectively rejects creating new indices and becomes RED.
81
69
82
70
[NOTE]
83
71
====
84
-
These low and high watermark values are Elasticsearch defaults in the current release. You can modify these values,
85
-
but you also must apply any modifications to the alerts also. The alerts are based
86
-
on these defaults.
72
+
These low and high watermark values are Elasticsearch defaults in the current release. You can modify these default values. Although the alerts use the same default values, you cannot change these values in the alerts.
0 commit comments