Skip to content

Commit 441eb58

Browse files
authored
Merge branch 'main' into mw-tsds-final-countdown
2 parents b9c61cf + c501477 commit 441eb58

File tree

20 files changed

+223
-169
lines changed

20 files changed

+223
-169
lines changed

deploy-manage/deploy/cloud-enterprise/default-system-deployment-versions.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,8 +16,10 @@ Note that since version 2.7.0, system deployments are automatically upgraded whe
1616

1717
| {{ece}} version | Admin cluster | Logging & Metrics cluster | Security cluster |
1818
| --- | --- | --- | --- |
19+
| 4.0.2 | 8.18.8 | 8.18.8 | 8.18.8 |
1920
| 4.0.1 | 8.18.2 | 8.18.2 | 8.18.2 |
2021
| 4.0.0 | 8.18.0 | 8.18.0 | 8.18.0 |
22+
| 3.8.2 | 8.17.10 | 8.17.10 | 8.17.10 |
2123
| 3.8.1 | 8.17.4 | 8.17.4 | 8.17.4 |
2224
| 3.8.0 | 8.17.4 | 8.17.4 | 8.17.4 |
2325
| 3.7.3 | 7.17.24 | 7.17.24 | 8.15.2 |

deploy-manage/deploy/cloud-enterprise/ece-install-offline-images.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -17,13 +17,13 @@ The first table contains the stack versions shipped with the current {{version.e
1717
| Docker images included with {{ece}} {{version.ece}} |
1818
| --- |
1919
| docker.elastic.co/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}} |
20-
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2 |
21-
| docker.elastic.co/cloud-release/kibana-cloud:8.18.2 |
22-
| docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2 |
23-
| docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2 |
24-
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1 |
25-
| docker.elastic.co/cloud-release/kibana-cloud:9.0.1 |
26-
| docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1 |
20+
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.8 |
21+
| docker.elastic.co/cloud-release/kibana-cloud:8.18.8 |
22+
| docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8 |
23+
| docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8 |
24+
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.8 |
25+
| docker.elastic.co/cloud-release/kibana-cloud:9.0.8 |
26+
| docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.8 |
2727

2828
$$$ece-all-stacks$$$Additional {{stack}} versions are available as Docker images that you can use with ECE. For offline installations, you need to download both the {{stack}} pack and the Docker images for the same version.
2929

@@ -173,11 +173,11 @@ Enterprise Search is not available in versions 9.0+.
173173
| docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8 | ECE 3.0.0 |
174174
| docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8 | ECE 3.0.0 |
175175
| | |
176-
| [{{es}}, {{kib}}, APM, and Enterprise Search stack pack: 8.18.7](https://download.elastic.co/cloud-enterprise/versions/8.18.7.zip) | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |
177-
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.7 | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |
178-
| docker.elastic.co/cloud-release/kibana-cloud:8.18.7 | ECE 3.0.0 |
179-
| docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.7 | ECE 3.0.0 |
180-
| docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.7 | ECE 3.0.0 |
176+
| [{{es}}, {{kib}}, APM, and Enterprise Search stack pack: 8.18.8](https://download.elastic.co/cloud-enterprise/versions/8.18.8.zip) | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |
177+
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.8 | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |
178+
| docker.elastic.co/cloud-release/kibana-cloud:8.18.8 | ECE 3.0.0 |
179+
| docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8 | ECE 3.0.0 |
180+
| docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8 | ECE 3.0.0 |
181181
| | |
182182
| [{{es}}, {{kib}}, APM, and Enterprise Search stack pack: 8.18.6](https://download.elastic.co/cloud-enterprise/versions/8.18.6.zip) | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |
183183
| docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.6 | ECE 3.0.0<br>(+ Docker 20.10.10+ required for 8.16+) |

deploy-manage/deploy/cloud-enterprise/ece-install-offline-no-registry.md

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -19,13 +19,13 @@ To perform an offline installation without a private Docker registry, you have t
1919

2020
```sh subs=true
2121
docker pull docker.elastic.co/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}}
22-
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2
23-
docker pull docker.elastic.co/cloud-release/kibana-cloud:8.18.2
24-
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2
25-
docker pull docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2
26-
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1
27-
docker pull docker.elastic.co/cloud-release/kibana-cloud:9.0.1
28-
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1
22+
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.8
23+
docker pull docker.elastic.co/cloud-release/kibana-cloud:8.18.8
24+
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8
25+
docker pull docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8
26+
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.8
27+
docker pull docker.elastic.co/cloud-release/kibana-cloud:9.0.8
28+
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.8
2929
```
3030

3131
::::{note}
@@ -36,27 +36,27 @@ To perform an offline installation without a private Docker registry, you have t
3636

3737
```sh subs=true
3838
docker save -o ece.{{version.ece}}.tar docker.elastic.co/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}}
39-
docker save -o es.8.18.2.tar docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2
40-
docker save -o kibana.8.18.2.tar docker.elastic.co/cloud-release/kibana-cloud:8.18.2
41-
docker save -o apm.8.18.2.tar docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2
42-
docker save -o enterprise-search.8.18.2.tar docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2
43-
docker save -o es.9.0.1.tar docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1
44-
docker save -o kibana.9.0.1.tar docker.elastic.co/cloud-release/kibana-cloud:9.0.1
45-
docker save -o apm.9.0.1.tar docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1
39+
docker save -o es.8.18.2.tar docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.8
40+
docker save -o kibana.8.18.2.tar docker.elastic.co/cloud-release/kibana-cloud:8.18.8
41+
docker save -o apm.8.18.2.tar docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8
42+
docker save -o enterprise-search.8.18.2.tar docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8
43+
docker save -o es.9.0.1.tar docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.8
44+
docker save -o kibana.9.0.1.tar docker.elastic.co/cloud-release/kibana-cloud:9.0.8
45+
docker save -o apm.9.0.1.tar docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.8
4646
```
4747

4848
3. Copy the .tar files to a location on your network where they are available to each host where you plan to install {{ece}}. Alternatively, you can copy the .tar files to each host directly.
4949
4. On each host, load the images into Docker, replacing `FILE_PATH` with the correct path to the .tar files:
5050

5151
```sh subs=true
5252
docker load < FILE_PATH/ece.{{version.ece}}.tar
53-
docker load < FILE_PATH/es.8.18.2.tar
54-
docker load < FILE_PATH/kibana.8.18.2.tar
55-
docker load < FILE_PATH/apm.8.18.2.tar
56-
docker load < FILE_PATH/enterprise-search.8.18.2.tar
57-
docker load < FILE_PATH/es.9.0.1.tar
58-
docker load < FILE_PATH/kibana.9.0.1.tar
59-
docker load < FILE_PATH/apm.9.0.1.tar
53+
docker load < FILE_PATH/es.8.18.8.tar
54+
docker load < FILE_PATH/kibana.8.18.8.tar
55+
docker load < FILE_PATH/apm.8.18.8.tar
56+
docker load < FILE_PATH/enterprise-search.8.18.8.tar
57+
docker load < FILE_PATH/es.9.0.8.tar
58+
docker load < FILE_PATH/kibana.9.0.8.tar
59+
docker load < FILE_PATH/apm.9.0.8.tar
6060
```
6161

6262
5. Optional: Remove the .tar files after installation.

deploy-manage/deploy/cloud-enterprise/ece-install-offline-with-registry.md

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -25,13 +25,13 @@ Installing ECE on multiple hosts with your own registry server is simpler, becau
2525

2626
```sh subs=true
2727
docker pull docker.elastic.co/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}}
28-
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2
29-
docker pull docker.elastic.co/cloud-release/kibana-cloud:8.18.2
30-
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2
31-
docker pull docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2
32-
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1
33-
docker pull docker.elastic.co/cloud-release/kibana-cloud:9.0.1
34-
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1
28+
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.8
29+
docker pull docker.elastic.co/cloud-release/kibana-cloud:8.18.8
30+
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.8
31+
docker pull docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.8
32+
docker pull docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.8
33+
docker pull docker.elastic.co/cloud-release/kibana-cloud:9.0.8
34+
docker pull docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.8
3535
```
3636

3737
::::{note}
@@ -42,26 +42,26 @@ Installing ECE on multiple hosts with your own registry server is simpler, becau
4242

4343
```sh subs=true
4444
docker tag docker.elastic.co/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}} REGISTRY/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}}
45-
docker tag docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2 REGISTRY/cloud-release/elasticsearch-cloud-ess:8.18.2
46-
docker tag docker.elastic.co/cloud-release/kibana-cloud:8.18.2 REGISTRY/cloud-release/kibana-cloud:8.18.2
47-
docker tag docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2 REGISTRY/cloud-release/elastic-agent-cloud:8.18.2
48-
docker tag docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2 REGISTRY/cloud-release/enterprise-search-cloud:8.18.2
49-
docker tag docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1 REGISTRY/cloud-release/elasticsearch-cloud-ess:9.0.1
50-
docker tag docker.elastic.co/cloud-release/kibana-cloud:9.0.1 REGISTRY/cloud-release/kibana-cloud:9.0.1
51-
docker tag docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1 REGISTRY/cloud-release/elastic-agent-cloud:9.0.1
45+
docker tag docker.elastic.co/cloud-release/elasticsearch-cloud-ess:8.18.2 REGISTRY/cloud-release/elasticsearch-cloud-ess:8.18.8
46+
docker tag docker.elastic.co/cloud-release/kibana-cloud:8.18.2 REGISTRY/cloud-release/kibana-cloud:8.18.8
47+
docker tag docker.elastic.co/cloud-release/elastic-agent-cloud:8.18.2 REGISTRY/cloud-release/elastic-agent-cloud:8.18.8
48+
docker tag docker.elastic.co/cloud-release/enterprise-search-cloud:8.18.2 REGISTRY/cloud-release/enterprise-search-cloud:8.18.8
49+
docker tag docker.elastic.co/cloud-release/elasticsearch-cloud-ess:9.0.1 REGISTRY/cloud-release/elasticsearch-cloud-ess:9.0.8
50+
docker tag docker.elastic.co/cloud-release/kibana-cloud:9.0.1 REGISTRY/cloud-release/kibana-cloud:9.0.8
51+
docker tag docker.elastic.co/cloud-release/elastic-agent-cloud:9.0.1 REGISTRY/cloud-release/elastic-agent-cloud:9.0.8
5252
```
5353

5454
4. Push the Docker images to your private Docker registry, using the same tags from the previous step. Replace `REGISTRY` with your actual registry URL, for example `my.private.repo:5000`:
5555

5656
```sh subs=true
5757
docker push REGISTRY/cloud-enterprise/elastic-cloud-enterprise:{{version.ece}}
58-
docker push REGISTRY/cloud-release/elasticsearch-cloud-ess:8.18.2
59-
docker push REGISTRY/cloud-release/kibana-cloud:8.18.2
60-
docker push REGISTRY/cloud-release/elastic-agent-cloud:8.18.2
61-
docker push REGISTRY/cloud-release/enterprise-search-cloud:8.18.2
62-
docker push REGISTRY/cloud-release/elasticsearch-cloud-ess:9.0.1
63-
docker push REGISTRY/cloud-release/kibana-cloud:9.0.1
64-
docker push REGISTRY/cloud-release/elastic-agent-cloud:9.0.1
58+
docker push REGISTRY/cloud-release/elasticsearch-cloud-ess:8.18.8
59+
docker push REGISTRY/cloud-release/kibana-cloud:8.18.8
60+
docker push REGISTRY/cloud-release/elastic-agent-cloud:8.18.8
61+
docker push REGISTRY/cloud-release/enterprise-search-cloud:8.18.8
62+
docker push REGISTRY/cloud-release/elasticsearch-cloud-ess:9.0.8
63+
docker push REGISTRY/cloud-release/kibana-cloud:9.0.8
64+
docker push REGISTRY/cloud-release/elastic-agent-cloud:9.0.8
6565
```
6666

6767
5. On an internet-connected host, download the installation script:

deploy-manage/distributed-architecture/kibana-tasks-management.md

Lines changed: 15 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -11,9 +11,9 @@ products:
1111

1212
{{kib}} Task Manager is used by features such as Alerting, Actions, and Reporting to run mission critical work as persistent background tasks. These background tasks distribute work across multiple {{kib}} instances. This has three major benefits:
1313

14-
* **Persistence**: All task state and scheduling is stored in {{es}}, so if you restart {{kib}}, tasks will pick up where they left off.
15-
* **Scaling**: Multiple {{kib}} instances can read from and update the same task queue in {{es}}, allowing the work load to be distributed across instances. If a {{kib}} instance no longer has capacity to run tasks, you can increase capacity by adding additional {{kib}} instances. For more information on scaling, see [{{kib}} task manager scaling considerations](../../deploy-manage/production-guidance/kibana-task-manager-scaling-considerations.md#task-manager-scaling-guidance).
16-
* **Load Balancing**: Task Manager is equipped with a reactive self-healing mechanism, which allows it to reduce the amount of work it executes in reaction to an increased load related error rate in {{es}}. Additionally, when Task Manager experiences an increase in recurring tasks, it attempts to space out the work to better balance the load.
14+
- **Persistence**: All task state and scheduling is stored in {{es}}, so if you restart {{kib}}, tasks will pick up where they left off.
15+
- **Scaling**: Multiple {{kib}} instances can read from and update the same task queue in {{es}}, allowing the work load to be distributed across instances. If a {{kib}} instance no longer has capacity to run tasks, you can increase capacity by adding additional {{kib}} instances. For more information on scaling, see [{{kib}} task manager scaling considerations](../../deploy-manage/production-guidance/kibana-task-manager-scaling-considerations.md#task-manager-scaling-guidance).
16+
- **Load Balancing**: Task Manager is equipped with a reactive self-healing mechanism, which allows it to reduce the amount of work it executes in reaction to an increased load related error rate in {{es}}. Additionally, when Task Manager experiences an increase in recurring tasks, it attempts to space out the work to better balance the load.
1717

1818
::::{important}
1919
Task definitions for alerts and actions are stored in the index called `.kibana_task_manager`.
@@ -28,16 +28,18 @@ If you lose this index, all scheduled alerts and actions are lost.
2828

2929
{{kib}} background tasks are managed as follows:
3030

31-
* An {{es}} task index is polled for overdue tasks at 3-second intervals. You can change this interval using the [`xpack.task_manager.poll_interval`](kibana://reference/configuration-reference/task-manager-settings.md#task-manager-settings) setting.
32-
* Tasks are claimed by updating them in the {{es}} index, using optimistic concurrency control to prevent conflicts. Each {{kib}} instance can run a maximum of 10 concurrent tasks, so a maximum of 10 tasks are claimed each interval.
33-
* {{es}} and {{kib}} instances use the system clock to determine the current time. To ensure schedules are triggered when expected, synchronize the clocks of all nodes in the cluster using a time service such as [Network Time Protocol](http://www.ntp.org/).
34-
* Tasks are run on the {{kib}} server.
35-
* Task Manager ensures that tasks:
36-
* Are only executed once
37-
* Are retried when they fail (if configured to do so)
38-
* Are rescheduled to run again at a future point in time (if configured to do so)
39-
::::{important}
40-
It is possible for tasks to run late or at an inconsistent schedule.
31+
- An {{es}} task index is polled for overdue tasks at 500-millisecond intervals. You can change this interval using the [`xpack.task_manager.poll_interval`](kibana://reference/configuration-reference/task-manager-settings.md#task-manager-settings) setting.
32+
- Tasks are claimed by updating them in the {{es}} index, using optimistic concurrency control to prevent conflicts. Each {{kib}} instance can run a maximum of 10 concurrent tasks, so a maximum of 10 tasks are claimed each interval.
33+
- {{es}} and {{kib}} instances use the system clock to determine the current time. To ensure schedules are triggered when expected, synchronize the clocks of all nodes in the cluster using a time service such as [Network Time Protocol](http://www.ntp.org/).
34+
- Tasks are run on the {{kib}} server. <br>
35+
It is recommended to use an isolated node for the background task.
36+
You can achieve that by setting `node.roles` to `background_tasks` for on-prem or by scaling Kibana to 8G+ in ECH.
37+
- Task Manager ensures that tasks:
38+
- Are only executed once
39+
- Are retried when they fail (if configured to do so)
40+
- Are rescheduled to run again at a future point in time (if configured to do so)
41+
::::{important}
42+
It is possible for tasks to run late or at an inconsistent schedule.
4143

4244
This is usually a symptom of the specific usage or scaling strategy of the cluster in question.
4345

@@ -48,6 +50,3 @@ For details on the settings that can influence the performance and throughput of
4850
For detailed troubleshooting guidance, see [Troubleshooting](../../troubleshoot/kibana/task-manager.md).
4951

5052
::::
51-
52-
53-

0 commit comments

Comments
 (0)