From b966f4e68a14bcff5a905c189d0ba9f217e8e972 Mon Sep 17 00:00:00 2001 From: shainaraskas Date: Fri, 19 Sep 2025 15:11:24 -0400 Subject: [PATCH 1/2] add refresh interval and bulk indexing response info --- .../differences-from-other-elasticsearch-offerings.md | 5 ++++- .../optimize-performance/indexing-speed.md | 5 ++++- 2 files changed, 8 insertions(+), 2 deletions(-) diff --git a/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md b/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md index 7c115fb066..07d6403afe 100644 --- a/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md +++ b/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md @@ -58,7 +58,7 @@ This table compares the core platform capabilities between {{ech}} deployments a |----------|----------------------|--------------------|--------| | **Audit logging** | ✅ | **Planned** | Anticipated in a future release | | **Authentication realms** | ✅ | ✅ | Managed at organization level in Serverless; deployment level in Hosted | -| **BYO-Key for Encryption at Rest** | ✅ | **Planned** | Anticipated in a future release; data in Serverless is stored on cloud-provider encrypted object storage | +| **BYO-Key for encryption at rest** | ✅ | **Planned** | Anticipated in a future release; data in Serverless is stored on cloud-provider encrypted object storage | | **Cloud provider support** | - AWS
- GCP
- Azure | - AWS
- Azure
- GCP | - [{{ech}} regions](cloud://reference/cloud-hosted/regions.md)
- [Serverless regions](/deploy-manage/deploy/elastic-cloud/regions.md) | | **Cluster scaling** | Manual with autoscaling option | Managed | Automatic scaling eliminates capacity planning - [Learn more](https://www.elastic.co/blog/elastic-serverless-architecture) | | **Custom plugins and bundles** | ✅ | ❌ | Not available in Serverless | @@ -86,6 +86,7 @@ This table compares Elasticsearch capabilities between {{ech}} deployments and S | [**AI Assistant**](/solutions/observability/observability-ai-assistant.md) | ✅ | ✅ | | | **Behavioral analytics** | ❌ (deprecated in 9.0) | ❌ | Not available in Serverless | | [**Clone index API**](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-clone) | ✅ | **Planned** | Anticipated in a future release | +| [**Bulk indexing**](/deploy-manage/production-guidance/optimize-performance/indexing-speed.md#_use_bulk_requests) | ✅ | ✅ | The maximum bulk request response time in {{serverless-short}} is 200ms | | [**Cross-cluster replication**](/deploy-manage/tools/cross-cluster-replication.md) | ✅ | **Planned** | Anticipated in a future release | | [**Cross-cluster search**](/solutions/search/cross-cluster-search.md) | ✅ | **Planned** | Anticipated in a future release | | **Data lifecycle management** | - [ILM](/manage-data/lifecycle/index-lifecycle-management.md)
- [Data stream lifecycle](/manage-data/lifecycle/data-stream.md) | [Data stream lifecycle](/manage-data/lifecycle/data-stream.md) only | - No data tiers in Serverless
- Optimized for common lifecycle management needs | @@ -218,6 +219,8 @@ Available settings * Search/query settings * Indexing settings such as `refresh_interval` + Some settings might have different default values or value constraints in {{serverless-short}}. This information is documented in the settings reference. + Managed settings : **Infrastructure-related settings**: Settings that affect cluster resources or data distribution are not available to end users. These include: diff --git a/deploy-manage/production-guidance/optimize-performance/indexing-speed.md b/deploy-manage/production-guidance/optimize-performance/indexing-speed.md index 719f33729b..f7cc445f51 100644 --- a/deploy-manage/production-guidance/optimize-performance/indexing-speed.md +++ b/deploy-manage/production-guidance/optimize-performance/indexing-speed.md @@ -25,6 +25,9 @@ Make sure to consider also your cluster’s shard count, index layout, and overa Bulk requests will yield much better performance than single-document index requests. In order to know the optimal size of a bulk request, you should run a benchmark on a single node with a single shard. First try to index 100 documents at once, then 200, then 400, etc. doubling the number of documents in a bulk request in every benchmark run. When the indexing speed starts to plateau then you know you reached the optimal size of a bulk request for your data. In case of tie, it is better to err in the direction of too few rather than too many documents. Beware that too large bulk requests might put the cluster under memory pressure when many of them are sent concurrently, so it is advisable to avoid going beyond a couple tens of megabytes per request even if larger requests seem to perform better. +:::{note} +In {{serverless-full}}, the minimum response time for a single bulk indexing request is 200ms. +::: ## Use multiple workers/threads to send data to {{es}} [multiple-workers-threads] @@ -79,7 +82,7 @@ PUT /my-index-000001/_settings 1. For {{serverless-full}} deployments, `refresh_interval` must be either `-1`, or equal to or greater than `5s` -When bulk indexing is complete, consider running a [force merge](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-forcemerge) {applies_to}`serverless: unavailable` to optimize search performance:: +When bulk indexing is complete, consider running a [force merge](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-forcemerge) to optimize search performance. Force merging is not available on {{serverless-full}}. ```console POST /my-index-000001/_forcemerge?max_num_segments=5 From 185db99416828c84eb5b29d574531f64fd87c554 Mon Sep 17 00:00:00 2001 From: shainaraskas <58563081+shainaraskas@users.noreply.github.com> Date: Mon, 22 Sep 2025 12:13:17 -0400 Subject: [PATCH 2/2] Update deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md Co-authored-by: Liam Thompson --- .../differences-from-other-elasticsearch-offerings.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md b/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md index 07d6403afe..3821caa910 100644 --- a/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md +++ b/deploy-manage/deploy/elastic-cloud/differences-from-other-elasticsearch-offerings.md @@ -219,7 +219,7 @@ Available settings * Search/query settings * Indexing settings such as `refresh_interval` - Some settings might have different default values or value constraints in {{serverless-short}}. This information is documented in the settings reference. + Some settings might have different default values or value constraints in {{serverless-short}}. This information is documented in the [settings reference](elasticsearch://reference/elasticsearch/index-settings/index.md). Managed settings : **Infrastructure-related settings**: Settings that affect cluster resources or data distribution are not available to end users. These include: