Skip to content

Commit 4bcf3c8

Browse files
authored
Merge branch 'main' into put-settings-better-err-message
2 parents 3f747d7 + 59f9837 commit 4bcf3c8

File tree

194 files changed

+5820
-2363
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

194 files changed

+5820
-2363
lines changed

docs/changelog/138029.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
pr: 138029
2+
summary: Fuse MV_MIN and MV_MAX and document process
3+
area: ES|QL
4+
type: feature
5+
issues: []

docs/changelog/138051.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
pr: 138051
2+
summary: Support for parameters in LIKE and RLIKE
3+
area: ES|QL
4+
type: enhancement
5+
issues: []

docs/changelog/138524.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
pr: 138524
2+
summary: Remove feature flag to enable binary doc value compression
3+
area: Mapping
4+
type: feature
5+
issues: []
6+
highlight:
7+
title: Remove feature flag to enable binary doc value compression
8+
body: |-
9+
Add compression for binary doc values using Zstd and blocks with a variable number of values.
10+
11+
Block-wise LZ4 compression was previously added to Lucene in LUCENE-9211 and removed in LUCENE-9378 due to query performance issues. This approach stored a constant number of values per block (specifically 32 values). This made it easy to map a given value index (e.g., docId) to the block containing it by doing blockId = docId / 32.
12+
Unfortunately, if values are very large, we must still have exactly 32 values per block, and (de)compressing a block could cause very high memory usage. As a result, we had to keep the number of values small, meaning that in the average case, a block was much smaller than ideal.
13+
To overcome the issues of blocks with a constant number of values, this PR adds block-wise compression with a variable number of values per block. It stores a minimum of 1 document per block and stops adding values when the size of a block exceeds a threshold or the number of values exceeds a threshold.
14+
Like the previous version, it stores an array of addresses for the start of each block. Additionally, it stores a parallel array with the docId at the start of each block. When looking up a given docId, if it is not in the current block, we binary search the array of docId starts to find the blockId containing the value. We then look up the address of the block. After this, decompression works very similarly to the code from LUCENE-9211; the main difference being that Zstd(1) is used instead of LZ4.
15+
16+
notable: true

docs/changelog/138541.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
pr: 138541
2+
summary: Simple bulk loading of compressed binary doc values
3+
area: Codec
4+
type: enhancement
5+
issues: []

docs/changelog/138589.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
pr: 138589
2+
summary: Upgrading commons-lang3 version for repository-hdfs plugin
3+
area: Snapshot/Restore
4+
type: upgrade
5+
issues: []

docs/changelog/138644.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
pr: 138644
2+
summary: "Fix: add missing `vector_similarity_support` in InferenceFeatures"
3+
area: Search
4+
type: bug
5+
issues: []

docs/reference/query-languages/esql/_snippets/operators/detailedDescription/like.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,3 +31,15 @@ ROW message = "foobar"
3131
```
3232

3333

34+
Patterns may be specified with REST query placeholders as well
35+
36+
```esql
37+
FROM employees
38+
| WHERE first_name LIKE ?pattern
39+
| KEEP first_name, last_name
40+
```
41+
42+
```{applies_to}
43+
stack: ga 9.3
44+
```
45+

docs/reference/query-languages/esql/_snippets/operators/detailedDescription/rlike.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,3 +31,15 @@ ROW message = "foobar"
3131
```
3232

3333

34+
Patterns may be specified with REST query placeholders as well
35+
36+
```esql
37+
FROM employees
38+
| WHERE first_name RLIKE ?pattern
39+
| KEEP first_name, last_name
40+
```
41+
42+
```{applies_to}
43+
stack: ga 9.3
44+
```
45+

gradle/verification-metadata.xml

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2287,11 +2287,6 @@
22872287
<sha256 value="ef368c9fa003963da78399b8f5a41ddfbef6b206f505f52293005730d87e7295" origin="Generated by Gradle"/>
22882288
</artifact>
22892289
</component>
2290-
<component group="org.apache.commons" name="commons-lang3" version="3.11">
2291-
<artifact name="commons-lang3-3.11.jar">
2292-
<sha256 value="4ee380259c068d1dbe9e84ab52186f2acd65de067ec09beff731fca1697fdb16" origin="Generated by Gradle"/>
2293-
</artifact>
2294-
</component>
22952290
<component group="org.apache.commons" name="commons-lang3" version="3.14.0">
22962291
<artifact name="commons-lang3-3.14.0.jar">
22972292
<sha256 value="7b96bf3ee68949abb5bc465559ac270e0551596fa34523fddf890ec418dde13c" origin="Generated by Gradle"/>
@@ -2302,6 +2297,11 @@
23022297
<sha256 value="4eeeae8d20c078abb64b015ec158add383ac581571cddc45c68f0c9ae0230720" origin="Generated by Gradle"/>
23032298
</artifact>
23042299
</component>
2300+
<component group="org.apache.commons" name="commons-lang3" version="3.20.0">
2301+
<artifact name="commons-lang3-3.20.0.jar">
2302+
<sha256 value="69e5c9fa35da7a51a5fd2099dfe56a2d8d32cf233e2f6d770e796146440263f4" origin="Generated by Gradle"/>
2303+
</artifact>
2304+
</component>
23052305
<component group="org.apache.commons" name="commons-lang3" version="3.7">
23062306
<artifact name="commons-lang3-3.7.jar">
23072307
<sha256 value="6e8dc31e046508d9953c96534edf0c2e0bfe6f468966b5b842b3f87e43b6a847" origin="Generated by Gradle"/>

modules/ingest-geoip/src/yamlRestTest/java/org/elasticsearch/ingest/geoip/IngestGeoIpClientYamlTestSuiteIT.java

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@
3838
import java.util.List;
3939
import java.util.Map;
4040
import java.util.Objects;
41+
import java.util.concurrent.TimeUnit;
4142

4243
import static org.hamcrest.Matchers.containsInAnyOrder;
4344
import static org.hamcrest.Matchers.equalTo;
@@ -158,7 +159,9 @@ static void assertDatabasesLoaded() throws Exception {
158159

159160
// ensure that the extra config database has been set up, too:
160161
assertThat(node.get("config_databases"), equalTo(List.of("asn.mmdb")));
161-
});
162+
// Downloading all four databases may take some time, so we set a longer timeout here.
163+
// If 20 seconds prove insufficient, we should first investigate whether we can speed up the database downloader.
164+
}, 20, TimeUnit.SECONDS);
162165
}
163166

164167
@SuppressForbidden(reason = "fixtures use java.io.File based APIs")

0 commit comments

Comments
 (0)