diff --git a/docs/release-notes/breaking-changes.md b/docs/release-notes/breaking-changes.md index 7309c76c5e450..b1651728012ef 100644 --- a/docs/release-notes/breaking-changes.md +++ b/docs/release-notes/breaking-changes.md @@ -12,6 +12,13 @@ If you are migrating from a version prior to version 9.0, you must first upgrade % ## Next version [elasticsearch-nextversion-breaking-changes] +```{applies_to} +stack: coming 9.0.3 +``` +## 9.0.3 [elasticsearch-9.0.3-breaking-changes] + +No breaking changes in this version. + ```{applies_to} stack: coming 9.0.2 ``` @@ -49,9 +56,6 @@ will prevent node from starting [#118366](https://github.com/elastic/elasticsear Cluster Coordination: * Remove unsupported legacy value for `discovery.type` [#112903](https://github.com/elastic/elasticsearch/pull/112903) -ES|QL -* Limit the scope of the skip_unavailable setting for remote clusters [#120236](https://github.com/elastic/elasticsearch/pull/120236) - EQL: * Set allow_partial_search_results=true by default [#120267](https://github.com/elastic/elasticsearch/pull/120267) diff --git a/docs/release-notes/changelog-bundles/9.0.3.yml b/docs/release-notes/changelog-bundles/9.0.3.yml new file mode 100644 index 0000000000000..1ed8fa4052e37 --- /dev/null +++ b/docs/release-notes/changelog-bundles/9.0.3.yml @@ -0,0 +1,162 @@ +version: 9.0.3 +released: false +generated: 2025-06-21T00:06:16.346021604Z +changelogs: + - pr: 120869 + summary: Threadpool merge scheduler + area: Engine + type: feature + issues: [] + - pr: 125408 + summary: Prevent ML data retention logic from failing when deleting documents in read-only indices + area: Machine Learning + type: bug + issues: [] + - pr: 127532 + summary: Fix case insensitive comparisons to "" + area: ES|QL + type: bug + issues: + - 127431 + - pr: 127613 + summary: Threadpool merge executor is aware of available disk space + area: Engine + type: feature + issues: [] + - pr: 127621 + summary: Fix error message when changing the password for a user in the file realm + area: Security + type: bug + issues: [] + - pr: 127651 + summary: Add complete attribute to .fleet-agents docs + area: Infra/Plugins + type: bug + issues: [] + - pr: 127962 + summary: Support DATE_NANOS in LOOKUP JOIN + area: ES|QL + type: bug + issues: + - 127249 + - pr: 128036 + summary: Fix inner hits + aggregations concurrency bug + area: Search + type: bug + issues: + - 122419 + - pr: 128362 + summary: Avoid unnecessary determinization in index pattern conflict checks + area: Indices APIs + type: bug + issues: [] + - pr: 128472 + summary: "Aggs: Fix significant terms not finding background docuemnts for nested fields" + area: Aggregations + type: bug + issues: + - 101163 + - pr: 128532 + summary: Prevent invalid privileges in manage roles privilege + area: Authorization + type: bug + issues: + - 127496 + - pr: 128610 + summary: "Handle the indices pattern `[\"*\", \"-*\"]` when grouping indices by cluster name" + area: CCS + type: bug + issues: [] + - pr: 128650 + summary: Update shardGenerations for all indices on snapshot finalization + area: Snapshot/Restore + type: enhancement + issues: + - 108907 + - pr: 128689 + summary: Fix minmax normalizer handling of single-doc result sets + area: Search + type: bug + issues: [] + - pr: 128702 + summary: Fix missing highlighting in `match_all` queries for `semantic_text` fields + area: Search + type: bug + issues: [] + - pr: 128740 + summary: Optimize sparse vector stats collection + area: Stats + type: enhancement + issues: [] + - pr: 128742 + summary: Account for Java direct memory on machine learning nodes to prevent out-of-memory crashes. + area: Machine Learning + type: bug + issues: [] + - pr: 128890 + summary: Improve cache invalidation in IdP SP cache + area: IdentityProvider + type: bug + issues: [] + - pr: 128910 + summary: Fix `FieldAttribute` name usage in `InferNonNullAggConstraint` + area: ES|QL + type: bug + issues: [] + - pr: 128960 + summary: Throw ISE instead of IAE for illegal block in page + area: ES|QL + type: bug + issues: [] + - pr: 128989 + summary: Fix NPE in semantic highlighter + area: Search + type: bug + issues: + - 128975 + - pr: 129005 + summary: Update AbstractXContentParser to support parsers that don't provide text characters + area: Infra/Core + type: bug + issues: [] + - pr: 129158 + summary: Fix unsupported privileges error message during role and API key creation + area: Authorization + type: enhancement + issues: + - 128132 + - pr: 129176 + summary: Adjust unpromotable shard refresh request validation to allow `RefreshResult.NO_REFRESH` + area: Searchable Snapshots + type: bug + issues: + - 129036 + - pr: 129391 + summary: Ensure that anomaly detection job state update retries if master node is temoporarily unavailable + area: Machine Learning + type: bug + issues: + - 126148 + - pr: 129418 + summary: Update traces duration mappings with appropriate unit type + area: Ingest Node + type: enhancement + issues: [] + - pr: 129464 + summary: Deprecate `indices.merge.scheduler.use_thread_pool` setting + area: Engine + type: deprecation + issues: [] + deprecation: + area: Ingest + title: Deprecate `indices.merge.scheduler.use_thread_pool` setting + details: This deprecates the `indices.merge.scheduler.use_thread_pool` node setting that was introduced in + impact: There should be no impact to users since the setting was not released before its deprecation here (and is not documented). + notable: false + essSettingChange: false + - pr: 129580 + summary: Check prefixes when constructing synthetic source for flattened fields + area: Mapping + type: bug + issues: + - 129508 diff --git a/docs/release-notes/deprecations.md b/docs/release-notes/deprecations.md index 978066708c5c6..d9273321ed05e 100644 --- a/docs/release-notes/deprecations.md +++ b/docs/release-notes/deprecations.md @@ -16,6 +16,16 @@ To give you insight into what deprecated features you’re using, {{es}}: % ## Next version [elasticsearch-nextversion-deprecations] +```{applies_to} +stack: coming 9.0.3 +``` +## 9.0.3 [elasticsearch-9.0.3-deprecations] + +Engine: +* Deprecate `indices.merge.scheduler.use_thread_pool` setting [#129464](https://github.com/elastic/elasticsearch/pull/129464) + + + ```{applies_to} stack: coming 9.0.2 ``` diff --git a/docs/release-notes/index.md b/docs/release-notes/index.md index f8405fdf0b00c..5663c5cca5e15 100644 --- a/docs/release-notes/index.md +++ b/docs/release-notes/index.md @@ -20,6 +20,79 @@ To check for security updates, go to [Security announcements for the Elastic sta % ### Fixes [elasticsearch-next-fixes] % * +## 9.0.3 [elasticsearch-9.0.3-release-notes] +```{applies_to} +stack: coming 9.0.3 +``` + +### Features and enhancements [elasticsearch-9.0.3-features-enhancements] + +Authorization: +* Fix unsupported privileges error message during role and API key creation [#129158](https://github.com/elastic/elasticsearch/pull/129158) (issue: [#128132](https://github.com/elastic/elasticsearch/issues/128132)) + +Engine: +* Threadpool merge executor is aware of available disk space [#127613](https://github.com/elastic/elasticsearch/pull/127613) +* Threadpool merge scheduler [#120869](https://github.com/elastic/elasticsearch/pull/120869) + +Ingest Node: +* Update traces duration mappings with appropriate unit type [#129418](https://github.com/elastic/elasticsearch/pull/129418) + +Snapshot/Restore: +* Update shardGenerations for all indices on snapshot finalization [#128650](https://github.com/elastic/elasticsearch/pull/128650) (issue: [#108907](https://github.com/elastic/elasticsearch/issues/108907)) + +Stats: +* Optimize sparse vector stats collection [#128740](https://github.com/elastic/elasticsearch/pull/128740) + +### Fixes [elasticsearch-9.0.3-fixes] + +Aggregations: +* Aggs: Fix significant terms not finding background docuemnts for nested fields [#128472](https://github.com/elastic/elasticsearch/pull/128472) (issue: [#101163](https://github.com/elastic/elasticsearch/issues/101163)) + +Authorization: +* Prevent invalid privileges in manage roles privilege [#128532](https://github.com/elastic/elasticsearch/pull/128532) (issue: [#127496](https://github.com/elastic/elasticsearch/issues/127496)) + +CCS: +* Handle the indices pattern `["*", "-*"]` when grouping indices by cluster name [#128610](https://github.com/elastic/elasticsearch/pull/128610) + +ES|QL: +* Fix `FieldAttribute` name usage in `InferNonNullAggConstraint` [#128910](https://github.com/elastic/elasticsearch/pull/128910) +* Fix case insensitive comparisons to "" [#127532](https://github.com/elastic/elasticsearch/pull/127532) (issue: [#127431](https://github.com/elastic/elasticsearch/issues/127431)) +* Support DATE_NANOS in LOOKUP JOIN [#127962](https://github.com/elastic/elasticsearch/pull/127962) (issue: [#127249](https://github.com/elastic/elasticsearch/issues/127249)) +* Throw ISE instead of IAE for illegal block in page [#128960](https://github.com/elastic/elasticsearch/pull/128960) + +IdentityProvider: +* Improve cache invalidation in IdP SP cache [#128890](https://github.com/elastic/elasticsearch/pull/128890) + +Indices APIs: +* Avoid unnecessary determinization in index pattern conflict checks [#128362](https://github.com/elastic/elasticsearch/pull/128362) + +Infra/Core: +* Update AbstractXContentParser to support parsers that don't provide text characters [#129005](https://github.com/elastic/elasticsearch/pull/129005) + +Infra/Plugins: +* Add complete attribute to .fleet-agents docs [#127651](https://github.com/elastic/elasticsearch/pull/127651) + +Machine Learning: +* Account for Java direct memory on machine learning nodes to prevent out-of-memory crashes. [#128742](https://github.com/elastic/elasticsearch/pull/128742) +* Ensure that anomaly detection job state update retries if master node is temoporarily unavailable [#129391](https://github.com/elastic/elasticsearch/pull/129391) (issue: [#126148](https://github.com/elastic/elasticsearch/issues/126148)) +* Prevent ML data retention logic from failing when deleting documents in read-only indices [#125408](https://github.com/elastic/elasticsearch/pull/125408) + +Mapping: +* Check prefixes when constructing synthetic source for flattened fields [#129580](https://github.com/elastic/elasticsearch/pull/129580) (issue: [#129508](https://github.com/elastic/elasticsearch/issues/129508)) + +Search: +* Fix NPE in semantic highlighter [#128989](https://github.com/elastic/elasticsearch/pull/128989) (issue: [#128975](https://github.com/elastic/elasticsearch/issues/128975)) +* Fix inner hits + aggregations concurrency bug [#128036](https://github.com/elastic/elasticsearch/pull/128036) (issue: [#122419](https://github.com/elastic/elasticsearch/issues/122419)) +* Fix minmax normalizer handling of single-doc result sets [#128689](https://github.com/elastic/elasticsearch/pull/128689) +* Fix missing highlighting in `match_all` queries for `semantic_text` fields [#128702](https://github.com/elastic/elasticsearch/pull/128702) + +Searchable Snapshots: +* Adjust unpromotable shard refresh request validation to allow `RefreshResult.NO_REFRESH` [#129176](https://github.com/elastic/elasticsearch/pull/129176) (issue: [#129036](https://github.com/elastic/elasticsearch/issues/129036)) + +Security: +* Fix error message when changing the password for a user in the file realm [#127621](https://github.com/elastic/elasticsearch/pull/127621) + + ## 9.0.2 [elasticsearch-9.0.2-release-notes] ```{applies_to} stack: coming 9.0.2 @@ -409,8 +482,6 @@ Machine Learning: * Support mTLS for the Elastic Inference Service integration inside the inference API [#119679](https://github.com/elastic/elasticsearch/pull/119679) * [Inference API] Add node-local rate limiting for the inference API [#120400](https://github.com/elastic/elasticsearch/pull/120400) * [Inference API] fix spell words: covertToString to convertToString [#119922](https://github.com/elastic/elasticsearch/pull/119922) -* Update Linux build images to Rocky Linux 8 with gcc 13.3 [#2773](https://github.com/elastic/ml-cpp/pull/2773) - Mapping: * Add Optional Source Filtering to Source Loaders [#113827](https://github.com/elastic/elasticsearch/pull/113827) diff --git a/docs/release-notes/known-issues.md b/docs/release-notes/known-issues.md index c95f2a353bd06..a20cff68c225c 100644 --- a/docs/release-notes/known-issues.md +++ b/docs/release-notes/known-issues.md @@ -7,6 +7,12 @@ mapped_pages: # Elasticsearch known issues [elasticsearch-known-issues] Known issues are significant defects or limitations that may impact your implementation. These issues are actively being worked on and will be addressed in a future release. Review the Elasticsearch known issues to help you make informed decisions, such as upgrading to a new version. +## 9.0.3 [elasticsearch-9.0.3-known-issues] +A bug in the merge scheduler in Elasticsearch 9.0.3 may prevent shards from closing when there isn’t enough disk space to complete a merge. As a result, operations such as closing or relocating an index may hang until sufficient disk space becomes available. +To mitigate this issue, the disk space checker is disabled by default in 9.0.3 by setting `indices.merge.disk.check_interval` to `0` seconds. Manually enabling this setting is not recommended. + +This issue is planned to be fixed in future patch release [#129613](https://github.com/elastic/elasticsearch/pull/129613) + ## 9.0.0 [elasticsearch-9.0.0-known-issues] * Elasticsearch on Windows might fail to start, or might forbid some file-related operations, when referencing paths with a case different from the one stored by the filesystem. Windows treats paths as case-insensitive, but the filesystem stores them with case. Entitlements, the new security system used by Elasticsearch, treat all paths as case-sensitive, and can therefore prevent access to a path that should be accessible.