From ae8962ca2fa490a6f4011fe3a6dfd5f4f5d1d2b9 Mon Sep 17 00:00:00 2001 From: elasticsearchmachine Date: Tue, 29 Jul 2025 11:34:19 +0000 Subject: [PATCH 1/2] Finalize docs for v9.1.0 release --- docs/release-notes/breaking-changes.md | 104 +----------------- .../release-notes/changelog-bundles/9.1.0.yml | 4 +- docs/release-notes/deprecations.md | 5 +- docs/release-notes/index.md | 39 +++---- 4 files changed, 29 insertions(+), 123 deletions(-) diff --git a/docs/release-notes/breaking-changes.md b/docs/release-notes/breaking-changes.md index a0bb440032b06..f7bddb506362b 100644 --- a/docs/release-notes/breaking-changes.md +++ b/docs/release-notes/breaking-changes.md @@ -12,112 +12,20 @@ If you are migrating from a version prior to version 9.0, you must first upgrade % ## Next version [elasticsearch-nextversion-breaking-changes] -```{applies_to} -stack: coming 9.1.0 -``` ## 9.1.0 [elasticsearch-9.1.0-breaking-changes] Discovery-Plugins: -:::{dropdown} Migrates `discovery-ec2` plugin to AWS SDK v2 -The `discovery-ec2` plugin now uses AWS SDK v2 instead of v1, as AWS plans to deprecate SDK v1 before the end of Elasticsearch 8.19’s support period. AWS SDK v2 introduces several behavior changes that affect configuration. - -**Impact:** -If you use the `discovery-ec2` plugin, your existing settings may no longer be compatible. Notable changes include, but may not be limited to: -- AWS SDK v2 does not support the EC2 IMDSv1 protocol. -- AWS SDK v2 does not support the `aws.secretKey` or `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system properties. -- AWS SDK v2 does not permit specifying a choice between HTTP and HTTPS so the `discovery.ec2.protocol` setting is no longer effective. -- AWS SDK v2 does not accept an access key without a secret key or vice versa. - -**Action:** -Test the upgrade in a non-production environment. Adapt your configuration to the new SDK functionality. This includes, but may not be limited to, the following items: -- If you use IMDS to determine the availability zone of a node or to obtain credentials for accessing the EC2 API, ensure that it supports the IMDSv2 protocol. -- If applicable, discontinue use of the `aws.secretKey` and `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system properties. -- If applicable, specify that you wish to use the insecure HTTP protocol to access the EC2 API by setting `discovery.ec2.endpoint` to a URL which starts with `http://`. -- Either supply both an access key and a secret key using the `discovery.ec2.access_key` and `discovery.ec2.secret_key` keystore settings, or configure neither of these settings. - -For more information, view [#122062](https://github.com/elastic/elasticsearch/pull/122062). -::: +* Upgrade `discovery-ec2` to AWS SDK v2 [#122062](https://github.com/elastic/elasticsearch/pull/122062) ES|QL: - -:::{dropdown} ES|QL now returns partial results by default -In previous versions, ES|QL queries failed entirely when any error occurred. As of 8.19.0, ES|QL returns partial results instead. - -**Impact:** -Callers must check the `is_partial` flag in the response to determine whether the result is complete. Relying on full results without checking this flag may lead to incorrect assumptions about the response. - -**Action:** -If partial results are not acceptable for your use case, you can disable this behavior by: -* Setting `allow_partial_results=false` in the query URL per request, or -* Setting the `esql.query.allow_partial_results` cluster setting to `false`. - -For more information, view [#127351](https://github.com/elastic/elasticsearch/pull/127351) (issue: [#122802](https://github.com/elastic/elasticsearch/issues/122802)) -::: - -:::{dropdown} Disallows parentheses in unquoted index patterns in ES|QL -To avoid ambiguity with subquery syntax, ES|QL no longer allows the use of `(` and `)` in unquoted index patterns. - -**Impact:** -Queries that include parentheses in unquoted index names will now result in a parsing exception. - -**Action:** -Update affected queries to quote index names that contain parentheses. For example, use `FROM "("foo")"` instead of `FROM (foo)`. -For more information, view [#130427](https://github.com/elastic/elasticsearch/pull/130427) (issue: [#130378](https://github.com/elastic/elasticsearch/issues/130378)) -::: - -:::{dropdown} Disallows mixing quoted and unquoted components in `FROM` index patterns -ES|QL no longer allows mixing quoted and unquoted parts in `FROM` index patterns (e.g. `FROM remote:"index"`). Previously, such patterns were parsed inconsistently and could result in misleading runtime errors. - -**Impact:** -Queries using partially quoted index patterns—such as quoting only the index or only the remote cluster—will now be rejected at parse time. This change simplifies grammar handling and avoids confusing validation failures. - -**Action:** -Ensure index patterns are either fully quoted or fully unquoted. For example: -* Valid: `FROM "remote:index"` or `FROM remote:index` -* Invalid: `FROM remote:"index"`, `FROM "remote":index` - -For more information, view [#127636](https://github.com/elastic/elasticsearch/pull/127636) (issue: [#122651](https://github.com/elastic/elasticsearch/issues/122651)) -::: - -:::{dropdown} `skip_unavailable` now catches all remote cluster runtime errors in ES|QL -When `skip_unavailable` is set to `true`, ES|QL now treats all runtime errors from that cluster as non-fatal. Previously, this setting only applied to connectivity issues (i.e. when a cluster was unavailable). - -**Impact:** -Errors such as missing indices on a remote cluster will no longer cause the query to fail. Instead, the cluster will appear in the response metadata as `skipped` or `partial`. - -**Action:** -If your workflows rely on detecting remote cluster errors, review your use of `skip_unavailable` and adjust error handling as needed. - -For more information, view [#128163](https://github.com/elastic/elasticsearch/pull/128163) -::: +* Allow partial results by default in ES|QL [#127351](https://github.com/elastic/elasticsearch/pull/127351) (issue: [#122802](https://github.com/elastic/elasticsearch/issues/122802)) +* Disallow brackets in unquoted index patterns [#130427](https://github.com/elastic/elasticsearch/pull/130427) (issue: [#130378](https://github.com/elastic/elasticsearch/issues/130378)) +* Disallow mixed quoted/unquoted patterns in FROM [#127636](https://github.com/elastic/elasticsearch/pull/127636) (issue: [#122651](https://github.com/elastic/elasticsearch/issues/122651)) +* Make `skip_unavailable` catch all errors [#128163](https://github.com/elastic/elasticsearch/pull/128163) Snapshot/Restore: +* Upgrade `repository-s3` to AWS SDK v2 [#126843](https://github.com/elastic/elasticsearch/pull/126843) (issue: [#120993](https://github.com/elastic/elasticsearch/issues/120993)) -:::{dropdown} Upgrades `repository-s3` plugin to AWS SDK v2 -The `repository-s3` plugin now uses AWS SDK v2 instead of v1, as AWS will deprecate SDK v1 before the end of Elasticsearch 8.19’s support period. The two SDKs differ in behavior, which may require updates to your configuration. - -**Impact:** -Existing `repository-s3` configurations may no longer be compatible. Notable differences in AWS SDK v2 include, but may not be limited to: -- AWS SDK v2 requires users to specify the region to use for signing requests, or else to run in an environment in which it can determine the correct region automatically. The older SDK used to determine the region based on the endpoint URL as specified with the `s3.client.${CLIENT_NAME}.endpoint` setting, together with other data drawn from the operating environment, and fell back to `us-east-1` if no better value was found. -- AWS SDK v2 does not support the EC2 IMDSv1 protocol. -- AWS SDK v2 does not support the `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system property. -- AWS SDK v2 does not permit specifying a choice between HTTP and HTTPS so the `s3.client.${CLIENT_NAME}.protocol` setting is deprecated and no longer has any effect. -- AWS SDK v2 does not permit control over throttling for retries, so the `s3.client.${CLIENT_NAME}.use_throttle_retries` setting is deprecated and no longer has any effect. -- AWS SDK v2 requires the use of the V4 signature algorithm, therefore, the `s3.client.${CLIENT_NAME}.signer_override` setting is deprecated and no longer has any effect. -- AWS SDK v2 does not support the `log-delivery-write` canned ACL. -- AWS SDK v2 counts 4xx responses differently in its metrics reporting. -- AWS SDK v2 always uses the regional STS endpoint, whereas AWS SDK v2 could use either a regional endpoint or the global `https://sts.amazonaws.com` one. - -**Action:** -Test the upgrade in a non-production environment. Adapt your configuration to the new SDK functionality. This includes, but may not be limited to, the following items: -- Specify the correct signing region using the `s3.client.${CLIENT_NAME}.region` setting on each node. {es} will try to determine the correct region based on the endpoint URL and other data drawn from the operating environment, but might not do so correctly in all cases. -- If you use IMDS to determine the availability zone of a node or to obtain credentials for accessing the EC2 API, ensure that it supports the IMDSv2 protocol. -- If applicable, discontinue use of the `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system property. -- If applicable, specify that you wish to use the insecure HTTP protocol to access the S3 API by setting `s3.client.${CLIENT_NAME}.endpoint` to a URL which starts with `http://`. -- If applicable, discontinue use of the `log-delivery-write` canned ACL. - -For more information, view [#126843](https://github.com/elastic/elasticsearch/pull/126843) (issue: [#120993](https://github.com/elastic/elasticsearch/issues/120993)) -::: ## 9.0.4 [elasticsearch-9.0.4-breaking-changes] diff --git a/docs/release-notes/changelog-bundles/9.1.0.yml b/docs/release-notes/changelog-bundles/9.1.0.yml index 6673bcce32a76..20d8e950c7564 100644 --- a/docs/release-notes/changelog-bundles/9.1.0.yml +++ b/docs/release-notes/changelog-bundles/9.1.0.yml @@ -1,6 +1,6 @@ version: 9.1.0 -released: false -generated: 2025-07-26T00:06:59.671585841Z +released: true +generated: 2025-07-29T11:34:08.731686399Z changelogs: - pr: 105773 summary: Inject an unfollow action before executing a downsample action in ILM diff --git a/docs/release-notes/deprecations.md b/docs/release-notes/deprecations.md index dadf81ae9a331..2f72b46d84c64 100644 --- a/docs/release-notes/deprecations.md +++ b/docs/release-notes/deprecations.md @@ -16,12 +16,9 @@ To give you insight into what deprecated features you’re using, {{es}}: % ## Next version [elasticsearch-nextversion-deprecations] -```{applies_to} -stack: coming 9.1.0 -``` ## 9.1.0 [elasticsearch-9.1.0-deprecations] -There are no deprecations associated with this release. +No deprecations in this version. ## 9.0.4 [elasticsearch-9.0.4-deprecations] diff --git a/docs/release-notes/index.md b/docs/release-notes/index.md index a64d30ca23285..c8e94dfce1966 100644 --- a/docs/release-notes/index.md +++ b/docs/release-notes/index.md @@ -21,14 +21,11 @@ To check for security updates, go to [Security announcements for the Elastic sta % * ## 9.1.0 [elasticsearch-9.1.0-release-notes] -```{applies_to} -stack: coming 9.1.0 -``` ### Highlights [elasticsearch-9.1.0-highlights] ::::{dropdown} Upgrade `repository-s3` to AWS SDK v2 -In earlier versions of {{es}} the `repository-s3` plugin was based on the AWS SDK v1. AWS will withdraw support for this SDK before the end of the life of {{es}} 9.1 so we have migrated this plugin to the newer AWS SDK v2. +In earlier versions of {es} the `repository-s3` plugin was based on the AWS SDK v1. AWS will withdraw support for this SDK before the end of the life of {es} {minor-version} so we have migrated this plugin to the newer AWS SDK v2. The two SDKs are not quite compatible, so please check the breaking changes documentation and test the new version thoroughly before upgrading any production workloads. :::: @@ -54,7 +51,8 @@ Users can enable redirection of ingest failures to the failure store on new data streams by specifying it in the new `data_stream_options` field inside of a component or index template: -```yaml +[source,yaml] +---- PUT _index_template/my-template { "index_patterns": ["logs-test-*"], @@ -66,20 +64,21 @@ PUT _index_template/my-template } } } -} -``` +}' +---- Existing data streams can be configured with the new data stream `_options` endpoint: -```yaml +[source,yaml] +---- PUT _data_stream/logs-test-apache/_options { "failure_store": { "enabled": "true" } } -``` +---- When redirection is enabled, any ingestion related failures will be captured in the failure store if the cluster is able to, along with the @@ -91,16 +90,18 @@ default as they are stored in different indices than the normal data stream data. In order to retrieve the failures, we use the `_search` API along with a new bit of index pattern syntax, the `::` selector. -```yaml +[source,yaml] +---- POST logs-test-apache::failures/_search -``` +---- This index syntax informs the search operation to target the indices in its failure store instead of its backing indices. It can be mixed in a number of ways with other index patterns to include their failure store indices in the search operation: -```yaml +[source,yaml] +---- POST logs-*::failures/_search POST logs-*,logs-*::failures/_search POST *::failures/_search @@ -108,7 +109,7 @@ POST _query { "query": "FROM my_data_stream*::failures" } -``` +---- :::: ::::{dropdown} Mark Token Pruning for Sparse Vector as GA @@ -131,23 +132,24 @@ Conceptually, fork is: Example: -```yaml +[source,yaml] +---------------------------- FROM test | FORK ( WHERE content:"fox" ) ( WHERE content:"dog" ) | SORT _fork -``` +---------------------------- The FORK command add a discriminator column called `_fork`: -```yaml +[source,yaml] +---------------------------- | id | content | _fork | |-----|-----------|-------| | 3 | brown fox | fork1 | | 4 | white dog | fork2 | -``` - +---------------------------- :::: ::::{dropdown} ES|QL cross-cluster querying is now generally available @@ -364,7 +366,6 @@ Machine Learning: * Mark token pruning for sparse vector as GA [#128854](https://github.com/elastic/elasticsearch/pull/128854) * Move to the Cohere V2 API for new inference endpoints [#129884](https://github.com/elastic/elasticsearch/pull/129884) * Semantic Text Chunking Indexing Pressure [#125517](https://github.com/elastic/elasticsearch/pull/125517) -* Track memory used in the hierarchical results normalizer [#2831](https://github.com/elastic/ml-cpp/pull/2831) * Upgrade AWS v2 SDK to 2.30.38 [#124738](https://github.com/elastic/elasticsearch/pull/124738) * [Inference API] Propagate product use case http header to EIS [#124025](https://github.com/elastic/elasticsearch/pull/124025) * [ML] Add HuggingFace Chat Completion support to the Inference Plugin [#127254](https://github.com/elastic/elasticsearch/pull/127254) From a8f08cbed02714d84595f4e58e95e1c452f3f7bf Mon Sep 17 00:00:00 2001 From: Charlotte Hoblik Date: Thu, 31 Jul 2025 11:27:56 +0200 Subject: [PATCH 2/2] Editorial changes --- docs/release-notes/breaking-changes.md | 102 +++++++++++++++++++++++-- docs/release-notes/deprecations.md | 2 +- docs/release-notes/index.md | 35 ++++----- 3 files changed, 111 insertions(+), 28 deletions(-) diff --git a/docs/release-notes/breaking-changes.md b/docs/release-notes/breaking-changes.md index f7bddb506362b..52fe492efa2cc 100644 --- a/docs/release-notes/breaking-changes.md +++ b/docs/release-notes/breaking-changes.md @@ -15,18 +15,106 @@ If you are migrating from a version prior to version 9.0, you must first upgrade ## 9.1.0 [elasticsearch-9.1.0-breaking-changes] Discovery-Plugins: -* Upgrade `discovery-ec2` to AWS SDK v2 [#122062](https://github.com/elastic/elasticsearch/pull/122062) +:::{dropdown} Migrates `discovery-ec2` plugin to AWS SDK v2 +The `discovery-ec2` plugin now uses AWS SDK v2 instead of v1, as AWS plans to deprecate SDK v1 before the end of Elasticsearch 8.19’s support period. AWS SDK v2 introduces several behavior changes that affect configuration. + +**Impact:** +If you use the `discovery-ec2` plugin, your existing settings may no longer be compatible. Notable changes include, but may not be limited to: +- AWS SDK v2 does not support the EC2 IMDSv1 protocol. +- AWS SDK v2 does not support the `aws.secretKey` or `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system properties. +- AWS SDK v2 does not permit specifying a choice between HTTP and HTTPS so the `discovery.ec2.protocol` setting is no longer effective. +- AWS SDK v2 does not accept an access key without a secret key or vice versa. + +**Action:** +Test the upgrade in a non-production environment. Adapt your configuration to the new SDK functionality. This includes, but may not be limited to, the following items: +- If you use IMDS to determine the availability zone of a node or to obtain credentials for accessing the EC2 API, ensure that it supports the IMDSv2 protocol. +- If applicable, discontinue use of the `aws.secretKey` and `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system properties. +- If applicable, specify that you wish to use the insecure HTTP protocol to access the EC2 API by setting `discovery.ec2.endpoint` to a URL which starts with `http://`. +- Either supply both an access key and a secret key using the `discovery.ec2.access_key` and `discovery.ec2.secret_key` keystore settings, or configure neither of these settings. + +For more information, view [#122062](https://github.com/elastic/elasticsearch/pull/122062). +::: ES|QL: -* Allow partial results by default in ES|QL [#127351](https://github.com/elastic/elasticsearch/pull/127351) (issue: [#122802](https://github.com/elastic/elasticsearch/issues/122802)) -* Disallow brackets in unquoted index patterns [#130427](https://github.com/elastic/elasticsearch/pull/130427) (issue: [#130378](https://github.com/elastic/elasticsearch/issues/130378)) -* Disallow mixed quoted/unquoted patterns in FROM [#127636](https://github.com/elastic/elasticsearch/pull/127636) (issue: [#122651](https://github.com/elastic/elasticsearch/issues/122651)) -* Make `skip_unavailable` catch all errors [#128163](https://github.com/elastic/elasticsearch/pull/128163) -Snapshot/Restore: -* Upgrade `repository-s3` to AWS SDK v2 [#126843](https://github.com/elastic/elasticsearch/pull/126843) (issue: [#120993](https://github.com/elastic/elasticsearch/issues/120993)) +:::{dropdown} ES|QL now returns partial results by default +In previous versions, ES|QL queries failed entirely when any error occurred. As of 8.19.0, ES|QL returns partial results instead. + +**Impact:** +Callers must check the `is_partial` flag in the response to determine whether the result is complete. Relying on full results without checking this flag may lead to incorrect assumptions about the response. + +**Action:** +If partial results are not acceptable for your use case, you can disable this behavior by: +* Setting `allow_partial_results=false` in the query URL per request, or +* Setting the `esql.query.allow_partial_results` cluster setting to `false`. + +For more information, view [#127351](https://github.com/elastic/elasticsearch/pull/127351) (issue: [#122802](https://github.com/elastic/elasticsearch/issues/122802)) +::: + +:::{dropdown} Disallows parentheses in unquoted index patterns in ES|QL +To avoid ambiguity with subquery syntax, ES|QL no longer allows the use of `(` and `)` in unquoted index patterns. + +**Impact:** +Queries that include parentheses in unquoted index names will now result in a parsing exception. + +**Action:** +Update affected queries to quote index names that contain parentheses. For example, use `FROM "("foo")"` instead of `FROM (foo)`. +For more information, view [#130427](https://github.com/elastic/elasticsearch/pull/130427) (issue: [#130378](https://github.com/elastic/elasticsearch/issues/130378)) +::: + +:::{dropdown} Disallows mixing quoted and unquoted components in `FROM` index patterns +ES|QL no longer allows mixing quoted and unquoted parts in `FROM` index patterns (e.g. `FROM remote:"index"`). Previously, such patterns were parsed inconsistently and could result in misleading runtime errors. +**Impact:** +Queries using partially quoted index patterns—such as quoting only the index or only the remote cluster—will now be rejected at parse time. This change simplifies grammar handling and avoids confusing validation failures. + +**Action:** +Ensure index patterns are either fully quoted or fully unquoted. For example: +* Valid: `FROM "remote:index"` or `FROM remote:index` +* Invalid: `FROM remote:"index"`, `FROM "remote":index` + +For more information, view [#127636](https://github.com/elastic/elasticsearch/pull/127636) (issue: [#122651](https://github.com/elastic/elasticsearch/issues/122651)) +::: + +:::{dropdown} `skip_unavailable` now catches all remote cluster runtime errors in ES|QL +When `skip_unavailable` is set to `true`, ES|QL now treats all runtime errors from that cluster as non-fatal. Previously, this setting only applied to connectivity issues (i.e. when a cluster was unavailable). + +**Impact:** +Errors such as missing indices on a remote cluster will no longer cause the query to fail. Instead, the cluster will appear in the response metadata as `skipped` or `partial`. + +**Action:** +If your workflows rely on detecting remote cluster errors, review your use of `skip_unavailable` and adjust error handling as needed. + +For more information, view [#128163](https://github.com/elastic/elasticsearch/pull/128163) +::: + +Snapshot/Restore: +:::{dropdown} Upgrades `repository-s3` plugin to AWS SDK v2 +The `repository-s3` plugin now uses AWS SDK v2 instead of v1, as AWS will deprecate SDK v1 before the end of Elasticsearch 8.19’s support period. The two SDKs differ in behavior, which may require updates to your configuration. + +**Impact:** +Existing `repository-s3` configurations may no longer be compatible. Notable differences in AWS SDK v2 include, but may not be limited to: +- AWS SDK v2 requires users to specify the region to use for signing requests, or else to run in an environment in which it can determine the correct region automatically. The older SDK used to determine the region based on the endpoint URL as specified with the `s3.client.${CLIENT_NAME}.endpoint` setting, together with other data drawn from the operating environment, and fell back to `us-east-1` if no better value was found. +- AWS SDK v2 does not support the EC2 IMDSv1 protocol. +- AWS SDK v2 does not support the `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system property. +- AWS SDK v2 does not permit specifying a choice between HTTP and HTTPS so the `s3.client.${CLIENT_NAME}.protocol` setting is deprecated and no longer has any effect. +- AWS SDK v2 does not permit control over throttling for retries, so the `s3.client.${CLIENT_NAME}.use_throttle_retries` setting is deprecated and no longer has any effect. +- AWS SDK v2 requires the use of the V4 signature algorithm, therefore, the `s3.client.${CLIENT_NAME}.signer_override` setting is deprecated and no longer has any effect. +- AWS SDK v2 does not support the `log-delivery-write` canned ACL. +- AWS SDK v2 counts 4xx responses differently in its metrics reporting. +- AWS SDK v2 always uses the regional STS endpoint, whereas AWS SDK v2 could use either a regional endpoint or the global `https://sts.amazonaws.com` one. + +**Action:** +Test the upgrade in a non-production environment. Adapt your configuration to the new SDK functionality. This includes, but may not be limited to, the following items: +- Specify the correct signing region using the `s3.client.${CLIENT_NAME}.region` setting on each node. {es} will try to determine the correct region based on the endpoint URL and other data drawn from the operating environment, but might not do so correctly in all cases. +- If you use IMDS to determine the availability zone of a node or to obtain credentials for accessing the EC2 API, ensure that it supports the IMDSv2 protocol. +- If applicable, discontinue use of the `com.amazonaws.sdk.ec2MetadataServiceEndpointOverride` system property. +- If applicable, specify that you wish to use the insecure HTTP protocol to access the S3 API by setting `s3.client.${CLIENT_NAME}.endpoint` to a URL which starts with `http://`. +- If applicable, discontinue use of the `log-delivery-write` canned ACL. + +For more information, view [#126843](https://github.com/elastic/elasticsearch/pull/126843) (issue: [#120993](https://github.com/elastic/elasticsearch/issues/120993)) +::: ## 9.0.4 [elasticsearch-9.0.4-breaking-changes] diff --git a/docs/release-notes/deprecations.md b/docs/release-notes/deprecations.md index 2f72b46d84c64..2f213be0a1ac3 100644 --- a/docs/release-notes/deprecations.md +++ b/docs/release-notes/deprecations.md @@ -18,7 +18,7 @@ To give you insight into what deprecated features you’re using, {{es}}: ## 9.1.0 [elasticsearch-9.1.0-deprecations] -No deprecations in this version. +There are no deprecations associated with this release. ## 9.0.4 [elasticsearch-9.0.4-deprecations] diff --git a/docs/release-notes/index.md b/docs/release-notes/index.md index c8e94dfce1966..f3bad3d40ae5e 100644 --- a/docs/release-notes/index.md +++ b/docs/release-notes/index.md @@ -25,7 +25,7 @@ To check for security updates, go to [Security announcements for the Elastic sta ### Highlights [elasticsearch-9.1.0-highlights] ::::{dropdown} Upgrade `repository-s3` to AWS SDK v2 -In earlier versions of {es} the `repository-s3` plugin was based on the AWS SDK v1. AWS will withdraw support for this SDK before the end of the life of {es} {minor-version} so we have migrated this plugin to the newer AWS SDK v2. +In earlier versions of {{es}} the `repository-s3` plugin was based on the AWS SDK v1. AWS will withdraw support for this SDK before the end of the life of {{es}} 9.1 so we have migrated this plugin to the newer AWS SDK v2. The two SDKs are not quite compatible, so please check the breaking changes documentation and test the new version thoroughly before upgrading any production workloads. :::: @@ -51,8 +51,7 @@ Users can enable redirection of ingest failures to the failure store on new data streams by specifying it in the new `data_stream_options` field inside of a component or index template: -[source,yaml] ----- +```yaml PUT _index_template/my-template { "index_patterns": ["logs-test-*"], @@ -64,21 +63,20 @@ PUT _index_template/my-template } } } -}' ----- +} +``` Existing data streams can be configured with the new data stream `_options` endpoint: -[source,yaml] ----- +```yaml PUT _data_stream/logs-test-apache/_options { "failure_store": { "enabled": "true" } } ----- +``` When redirection is enabled, any ingestion related failures will be captured in the failure store if the cluster is able to, along with the @@ -90,18 +88,16 @@ default as they are stored in different indices than the normal data stream data. In order to retrieve the failures, we use the `_search` API along with a new bit of index pattern syntax, the `::` selector. -[source,yaml] ----- +```yaml POST logs-test-apache::failures/_search ----- +``` This index syntax informs the search operation to target the indices in its failure store instead of its backing indices. It can be mixed in a number of ways with other index patterns to include their failure store indices in the search operation: -[source,yaml] ----- +```yaml POST logs-*::failures/_search POST logs-*,logs-*::failures/_search POST *::failures/_search @@ -109,7 +105,7 @@ POST _query { "query": "FROM my_data_stream*::failures" } ----- +``` :::: ::::{dropdown} Mark Token Pruning for Sparse Vector as GA @@ -132,24 +128,23 @@ Conceptually, fork is: Example: -[source,yaml] ----------------------------- +```yaml FROM test | FORK ( WHERE content:"fox" ) ( WHERE content:"dog" ) | SORT _fork ----------------------------- +``` The FORK command add a discriminator column called `_fork`: -[source,yaml] ----------------------------- +```yaml | id | content | _fork | |-----|-----------|-------| | 3 | brown fox | fork1 | | 4 | white dog | fork2 | ----------------------------- +``` + :::: ::::{dropdown} ES|QL cross-cluster querying is now generally available