Forward port release notes for v8.15.3

Author: elasticsearchmachine

docs/reference/migration/index.asciidoc

@@ -1,40 +1,6 @@
 include::migration_intro.asciidoc[]
 
-* <<migrating-8.17,Migrating to 8.17>>
-* <<migrating-8.16,Migrating to 8.16>>
-* <<migrating-8.15,Migrating to 8.15>>
-* <<migrating-8.14,Migrating to 8.14>>
-* <<migrating-8.13,Migrating to 8.13>>
-* <<migrating-8.12,Migrating to 8.12>>
-* <<migrating-8.11,Migrating to 8.11>>
-* <<migrating-8.10,Migrating to 8.10>>
-* <<migrating-8.9,Migrating to 8.9>>
-* <<migrating-8.8,Migrating to 8.8>>
-* <<migrating-8.7,Migrating to 8.7>>
-* <<migrating-8.6,Migrating to 8.6>>
-* <<migrating-8.5,Migrating to 8.5>>
-* <<migrating-8.4,Migrating to 8.4>>
-* <<migrating-8.3,Migrating to 8.3>>
-* <<migrating-8.2,Migrating to 8.2>>
-* <<migrating-8.1,Migrating to 8.1>>
-* <<migrating-8.0,Migrating to 8.0>>
+* <<migrating-9.0,Migrating to 9.0>>
 
-include::migrate_8_17.asciidoc[]
-include::migrate_8_16.asciidoc[]
-include::migrate_8_15.asciidoc[]
-include::migrate_8_14.asciidoc[]
-include::migrate_8_13.asciidoc[]
-include::migrate_8_12.asciidoc[]
-include::migrate_8_11.asciidoc[]
-include::migrate_8_10.asciidoc[]
-include::migrate_8_9.asciidoc[]
-include::migrate_8_8.asciidoc[]
-include::migrate_8_7.asciidoc[]
-include::migrate_8_6.asciidoc[]
-include::migrate_8_5.asciidoc[]
-include::migrate_8_4.asciidoc[]
-include::migrate_8_3.asciidoc[]
-include::migrate_8_2.asciidoc[]
-include::migrate_8_1.asciidoc[]
-include::migrate_8_0.asciidoc[]
+include::migrate_9_0.asciidoc[]
 

docs/reference/release-notes.asciidoc

@@ -6,135 +6,9 @@
 
 This section summarizes the changes in each release.
 
-* <<release-notes-8.17.0>>
-* <<release-notes-8.16.0>>
-* <<release-notes-8.15.1>>
-* <<release-notes-8.15.0>>
-* <<release-notes-8.14.3>>
-* <<release-notes-8.14.2>>
-* <<release-notes-8.14.1>>
-* <<release-notes-8.14.0>>
-* <<release-notes-8.13.4>>
-* <<release-notes-8.13.3>>
-* <<release-notes-8.13.2>>
-* <<release-notes-8.13.1>>
-* <<release-notes-8.13.0>>
-* <<release-notes-8.12.2>>
-* <<release-notes-8.12.1>>
-* <<release-notes-8.12.0>>
-* <<release-notes-8.11.4>>
-* <<release-notes-8.11.3>>
-* <<release-notes-8.11.2>>
-* <<release-notes-8.11.1>>
-* <<release-notes-8.11.0>>
-* <<release-notes-8.10.4>>
-* <<release-notes-8.10.3>>
-* <<release-notes-8.10.2>>
-* <<release-notes-8.10.1>>
-* <<release-notes-8.10.0>>
-* <<release-notes-8.9.2>>
-* <<release-notes-8.9.1>>
-* <<release-notes-8.9.0>>
-* <<release-notes-8.8.2>>
-* <<release-notes-8.8.1>>
-* <<release-notes-8.8.0>>
-* <<release-notes-8.7.1>>
-* <<release-notes-8.7.0>>
-* <<release-notes-8.6.2>>
-* <<release-notes-8.6.1>>
-* <<release-notes-8.6.0>>
-* <<release-notes-8.5.3>>
-* <<release-notes-8.5.2>>
-* <<release-notes-8.5.1>>
-* <<release-notes-8.5.0>>
-* <<release-notes-8.4.3>>
-* <<release-notes-8.4.2>>
-* <<release-notes-8.4.1>>
-* <<release-notes-8.4.0>>
-* <<release-notes-8.3.3>>
-* <<release-notes-8.3.2>>
-* <<release-notes-8.3.1>>
-* <<release-notes-8.3.0>>
-* <<release-notes-8.2.3>>
-* <<release-notes-8.2.2>>
-* <<release-notes-8.2.1>>
-* <<release-notes-8.2.0>>
-* <<release-notes-8.1.3>>
-* <<release-notes-8.1.2>>
-* <<release-notes-8.1.1>>
-* <<release-notes-8.1.0>>
-* <<release-notes-8.0.1>>
-* <<release-notes-8.0.0>>
-* <<release-notes-8.0.0-rc2>>
-* <<release-notes-8.0.0-rc1>>
-* <<release-notes-8.0.0-beta1>>
-* <<release-notes-8.0.0-alpha2>>
-* <<release-notes-8.0.0-alpha1>>
+* <<release-notes-9.0.0>>
 
 --
 
-include::release-notes/8.17.0.asciidoc[]
-include::release-notes/8.16.0.asciidoc[]
-include::release-notes/8.15.1.asciidoc[]
-include::release-notes/8.15.0.asciidoc[]
-include::release-notes/8.14.3.asciidoc[]
-include::release-notes/8.14.2.asciidoc[]
-include::release-notes/8.14.1.asciidoc[]
-include::release-notes/8.14.0.asciidoc[]
-include::release-notes/8.13.4.asciidoc[]
-include::release-notes/8.13.3.asciidoc[]
-include::release-notes/8.13.2.asciidoc[]
-include::release-notes/8.13.1.asciidoc[]
-include::release-notes/8.13.0.asciidoc[]
-include::release-notes/8.12.2.asciidoc[]
-include::release-notes/8.12.1.asciidoc[]
-include::release-notes/8.12.0.asciidoc[]
-include::release-notes/8.11.4.asciidoc[]
-include::release-notes/8.11.3.asciidoc[]
-include::release-notes/8.11.2.asciidoc[]
-include::release-notes/8.11.1.asciidoc[]
-include::release-notes/8.11.0.asciidoc[]
-include::release-notes/8.10.4.asciidoc[]
-include::release-notes/8.10.3.asciidoc[]
-include::release-notes/8.10.2.asciidoc[]
-include::release-notes/8.10.1.asciidoc[]
-include::release-notes/8.10.0.asciidoc[]
-include::release-notes/8.9.2.asciidoc[]
-include::release-notes/8.9.1.asciidoc[]
-include::release-notes/8.9.0.asciidoc[]
-include::release-notes/8.8.2.asciidoc[]
-include::release-notes/8.8.1.asciidoc[]
-include::release-notes/8.8.0.asciidoc[]
-include::release-notes/8.7.1.asciidoc[]
-include::release-notes/8.7.0.asciidoc[]
-include::release-notes/8.6.2.asciidoc[]
-include::release-notes/8.6.1.asciidoc[]
-include::release-notes/8.6.0.asciidoc[]
-include::release-notes/8.5.3.asciidoc[]
-include::release-notes/8.5.2.asciidoc[]
-include::release-notes/8.5.1.asciidoc[]
-include::release-notes/8.5.0.asciidoc[]
-include::release-notes/8.4.3.asciidoc[]
-include::release-notes/8.4.2.asciidoc[]
-include::release-notes/8.4.1.asciidoc[]
-include::release-notes/8.4.0.asciidoc[]
-include::release-notes/8.3.3.asciidoc[]
-include::release-notes/8.3.2.asciidoc[]
-include::release-notes/8.3.1.asciidoc[]
-include::release-notes/8.3.0.asciidoc[]
-include::release-notes/8.2.3.asciidoc[]
-include::release-notes/8.2.2.asciidoc[]
-include::release-notes/8.2.1.asciidoc[]
-include::release-notes/8.2.0.asciidoc[]
-include::release-notes/8.1.3.asciidoc[]
-include::release-notes/8.1.2.asciidoc[]
-include::release-notes/8.1.1.asciidoc[]
-include::release-notes/8.1.0.asciidoc[]
-include::release-notes/8.0.1.asciidoc[]
-include::release-notes/8.0.0.asciidoc[]
-include::release-notes/8.0.0-rc2.asciidoc[]
-include::release-notes/8.0.0-rc1.asciidoc[]
-include::release-notes/8.0.0-beta1.asciidoc[]
-include::release-notes/8.0.0-alpha2.asciidoc[]
-include::release-notes/8.0.0-alpha1.asciidoc[]
+include::release-notes/9.0.0.asciidoc[]
 

docs/reference/release-notes/8.15.3.asciidoc

@@ -0,0 +1,47 @@
+[[release-notes-8.15.3]]
+== {es} version 8.15.3
+
+Also see <<breaking-changes-8.15,Breaking changes in 8.15>>.
+
+[[bug-8.15.3]]
+[float]
+=== Bug fixes
+
+Aggregations::
+* Don't validate internal stats if they are empty {es-pull}113846[#113846] (issue: {es-issue}113811[#113811])
+* Fix `needsScore` computation in `GlobalOrdCardinalityAggregator` {es-pull}113129[#113129] (issue: {es-issue}112975[#112975])
+
+Authentication::
+* Enables cluster state role mapper, to include ECK operator-defined role mappings in role resolution {es-pull}114337[#114337]
+
+ES|QL::
+* ES|QL: Ensure minimum capacity for `PlanStreamInput` caches {es-pull}114116[#114116]
+* ES|QL: Skip CASE function from `InferIsNotNull` rule checks {es-pull}113123[#113123] (issue: {es-issue}112704[#112704])
+* [ESQL] Fix init value in max float aggregation {es-pull}113699[#113699]
+* [ESQL] Support datetime data type in Least and Greatest functions {es-pull}113961[#113961]
+
+Machine Learning::
+* Fix check on E5 model platform compatibility {es-pull}113437[#113437] (issue: {es-issue}113577[#113577])
+* Handle parsing ingest processors where definition is not a object {es-pull}113697[#113697] (issue: {es-issue}113615[#113615])
+* [ML][backport] Warn for model load failures if they have a status code <500 {es-pull}113410[#113410]
+* [M] Fix error message formatting {es-pull}113266[#113266]
+
+Search::
+* Fix analyzed wildcard query in simple_query_string when disjunctions is empty {es-pull}114264[#114264] (issue: {es-issue}114185[#114185])
+* Fix collapse interaction with stored fields {es-pull}112761[#112761] (issue: {es-issue}112646[#112646])
+
+[[enhancement-8.15.3]]
+[float]
+=== Enhancements
+
+Machine Learning::
+* Write downloaded model parts async {es-pull}111684[#111684]
+
+[[upgrade-8.15.3]]
+[float]
+=== Upgrades
+
+Snapshot/Restore::
+* Upgrade protobufer to 3.25.5 {es-pull}113869[#113869]
+
+

docs/reference/release-notes/highlights.asciidoc

@@ -8,31 +8,8 @@ ifeval::["{release-state}"!="unreleased"]
 For detailed information about this release, see the <<es-release-notes>> and
 <<breaking-changes>>.
 
-// Add previous release to the list
-Other versions:
-
-{ref-bare}/8.16/release-highlights.html[8.16]
-| {ref-bare}/8.15/release-highlights.html[8.15]
-| {ref-bare}/8.14/release-highlights.html[8.14]
-| {ref-bare}/8.13/release-highlights.html[8.13]
-| {ref-bare}/8.12/release-highlights.html[8.12]
-| {ref-bare}/8.11/release-highlights.html[8.11]
-| {ref-bare}/8.10/release-highlights.html[8.10]
-| {ref-bare}/8.9/release-highlights.html[8.9]
-| {ref-bare}/8.8/release-highlights.html[8.8]
-| {ref-bare}/8.7/release-highlights.html[8.7]
-| {ref-bare}/8.6/release-highlights.html[8.6]
-| {ref-bare}/8.5/release-highlights.html[8.5]
-| {ref-bare}/8.4/release-highlights.html[8.4]
-| {ref-bare}/8.3/release-highlights.html[8.3]
-| {ref-bare}/8.2/release-highlights.html[8.2]
-| {ref-bare}/8.1/release-highlights.html[8.1]
-| {ref-bare}/8.0/release-highlights.html[8.0]
-
 endif::[]
 
-// The notable-highlights tag marks entries that
-// should be featured in the Stack Installation and Upgrade Guide:
 // tag::notable-highlights[]
 
 [discrete]
@@ -97,6 +74,98 @@ ZStandard offers ~12% lower storage usage and a ~14% higher indexing throughput
 
 {es-pull}112665[#112665]
 
+[discrete]
+[[esql_introduce_per_agg_filter]]
+=== ESQL: Introduce per agg filter
+Add support for aggregation scoped filters that work dynamically on the
+data in each group.
+
+[source,esql]
+----
+| STATS success = COUNT(*) WHERE 200 <= code AND code < 300,
+        redirect = COUNT(*) WHERE 300 <= code AND code < 400,
+        client_err = COUNT(*) WHERE 400 <= code AND code < 500,
+        server_err = COUNT(*) WHERE 500 <= code AND code < 600,
+        total_count = COUNT(*)
+----
+
+Implementation wise, the base AggregateFunction has been extended to 
+allow a filter to be passed on. This is required to incorporate the
+filter as part of the aggregate equality/identity which would fail with 
+the filter as an external component.
+As part of the process, the serialization for the existing aggregations
+had to be fixed so AggregateFunction implementations so that it
+delegates to their parent first.
+
+{es-pull}113735[#113735]
+
 // end::notable-highlights[]
 
 
+[discrete]
+[[esql_multi_value_fields_supported_in_geospatial_predicates]]
+=== ESQL: Multi-value fields supported in Geospatial predicates
+Supporting multi-value fields in `WHERE` predicates is a challenge due to not knowing whether `ALL` or `ANY`
+of the values in the field should pass the predicate.
+For example, should the field `age:[10,30]` pass the predicate `WHERE age>20` or not?
+This ambiguity does not exist with the spatial predicates
+`ST_INTERSECTS` and `ST_DISJOINT`, because the choice between `ANY` or `ALL`
+is implied by the predicate itself.
+Consider a predicate checking a field named `location` against a test geometry named `shape`:
+
+* `ST_INTERSECTS(field, shape)` - true if `ANY` value can intersect the shape
+* `ST_DISJOINT(field, shape)` - true only if `ALL` values are disjoint from the shape
+
+This works even if the shape argument is itself a complex or compound geometry.
+
+Similar logic exists for `ST_CONTAINS` and `ST_WITHIN` predicates, but these are not as easily solved
+with `ANY` or `ALL`, because a collection of geometries contains another collection if each of the contained
+geometries is within at least one of the containing geometries. Evaluating this requires that the multi-value
+field is first combined into a single geometry before performing the predicate check.
+
+* `ST_CONTAINS(field, shape)` - true if the combined geometry contains the shape
+* `ST_WITHIN(field, shape)` - true if the combined geometry is within the shape
+
+{es-pull}112063[#112063]
+
+[discrete]
+[[enhance_sort_push_down_to_lucene_to_cover_references_to_fields_st_distance_function]]
+=== Enhance SORT push-down to Lucene to cover references to fields and ST_DISTANCE function
+The most used and likely most valuable geospatial search query in Elasticsearch is the sorted proximity search,
+finding items within a certain distance of a point of interest and sorting the results by distance.
+This has been possible in ES|QL since 8.15.0, but the sorting was done in-memory, not pushed down to Lucene.
+Now the sorting is pushed down to Lucene, which results in a significant performance improvement.
+
+Queries that perform both filtering and sorting on distance are supported. For example:
+
+[source,esql]
+----
+FROM test
+| EVAL distance = ST_DISTANCE(location, TO_GEOPOINT("POINT(37.7749, -122.4194)"))
+| WHERE distance < 1000000
+| SORT distance ASC, name DESC
+| LIMIT 10
+----
+
+In addition, the support for sorting on EVAL expressions has been extended to cover references to fields:
+
+[source,esql]
+----
+FROM test
+| EVAL ref = field
+| SORT ref ASC
+| LIMIT 10
+----
+
+{es-pull}112938[#112938]
+
+[discrete]
+[[cross_cluster_search_telemetry]]
+=== Cross-cluster search telemetry
+The cross-cluster search telemetry is collected when cross-cluster searches
+are performed, and is returned as "ccs" field in `_cluster/stats` output.
+It also add a new parameter `include_remotes=true` to the `_cluster/stats` API
+which will collect data from connected remote clusters.
+
+{es-pull}113825[#113825]
+