From a8583a86b511a0a4c693bb52381d1fbfa291f5a5 Mon Sep 17 00:00:00 2001 From: Nik Everett Date: Sun, 23 Feb 2025 12:29:37 -0500 Subject: [PATCH 1/3] ESQL: Add known issue for slow VALUES They are so so so slow that this is effectively a bad bug. --- docs/reference/release-notes/8.16.4.asciidoc | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/docs/reference/release-notes/8.16.4.asciidoc b/docs/reference/release-notes/8.16.4.asciidoc index 47fff79f1c3ec..db3c45013b2b6 100644 --- a/docs/reference/release-notes/8.16.4.asciidoc +++ b/docs/reference/release-notes/8.16.4.asciidoc @@ -39,4 +39,10 @@ Snapshot/Restore:: Ingest Node:: * Improve memory aspects of enrich cache {es-pull}120256[#120256] (issues: {es-issue}96050[#96050], {es-issue}120021[#120021]) +[discrete] +[[known-issues-8.16.4]] +=== Known issues +ES|QL:: + +* `VALUES` aggregate function can run for a long, long time when collecting many, many groups. This can consume a thread for days at the worst case. Fixed by {es-pull}#123073[#123073] and available in 8.16.5, 8.17.3, 8.18.0, and all releases after that. From d3a1b7becd5cd91138656a5481a7c17564c88683 Mon Sep 17 00:00:00 2001 From: Nik Everett Date: Mon, 24 Feb 2025 09:35:51 -0500 Subject: [PATCH 2/3] More --- docs/reference/release-notes/8.16.4.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reference/release-notes/8.16.4.asciidoc b/docs/reference/release-notes/8.16.4.asciidoc index db3c45013b2b6..f4551408c9fd4 100644 --- a/docs/reference/release-notes/8.16.4.asciidoc +++ b/docs/reference/release-notes/8.16.4.asciidoc @@ -45,4 +45,4 @@ Ingest Node:: ES|QL:: -* `VALUES` aggregate function can run for a long, long time when collecting many, many groups. This can consume a thread for days at the worst case. Fixed by {es-pull}#123073[#123073] and available in 8.16.5, 8.17.3, 8.18.0, and all releases after that. +* `VALUES` aggregate function can run for a long, long time when collecting many, many groups. Hundreds of thousands of groups can run on one thread for many minutes and millions of groups run for days. It is O(n^2^) with the number of groups. These will not respond to the tasks cancellation API the whole time. Fixed by {es-pull}#123073[#123073] and available in 8.16.5, 8.17.3, 8.18.0, and all releases after that. From 1964edbd4520cc1000bee9fbfa1487d750d55734 Mon Sep 17 00:00:00 2001 From: Nik Everett Date: Mon, 24 Feb 2025 11:16:05 -0500 Subject: [PATCH 3/3] Update docs/reference/release-notes/8.16.4.asciidoc Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com> --- docs/reference/release-notes/8.16.4.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reference/release-notes/8.16.4.asciidoc b/docs/reference/release-notes/8.16.4.asciidoc index f4551408c9fd4..795665a68a911 100644 --- a/docs/reference/release-notes/8.16.4.asciidoc +++ b/docs/reference/release-notes/8.16.4.asciidoc @@ -45,4 +45,4 @@ Ingest Node:: ES|QL:: -* `VALUES` aggregate function can run for a long, long time when collecting many, many groups. Hundreds of thousands of groups can run on one thread for many minutes and millions of groups run for days. It is O(n^2^) with the number of groups. These will not respond to the tasks cancellation API the whole time. Fixed by {es-pull}#123073[#123073] and available in 8.16.5, 8.17.3, 8.18.0, and all releases after that. +* The `VALUES` aggregate function can run for an extremely long time when collecting many groups. Processing hundreds of thousands of groups may take several minutes on a single thread, while processing millions of groups can take days. The function has O(n^2) complexity with respect to the number of groups. During execution, these operations will not respond to the tasks cancellation API. This issue has been fixed by {es-pull}#123073[#123073] and the fix is available in versions 8.16.5, 8.17.3, 8.18.0, and all releases after that.