Skip to content

Conversation

@avb-is-me
Copy link

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

andrross and others added 30 commits September 15, 2025 15:49
Use the drop-in replacement for the deprecated AccessController where
appropriate. Also remove tests that were assuming a security manager was
present as that can never be true post JDK 21.

Signed-off-by: Andrew Ross <[email protected]>
…/test/framework (#19294)

* Bump com.github.spotbugs:spotbugs-annotations in /test/framework

Bumps [com.github.spotbugs:spotbugs-annotations](https://github.com/spotbugs/spotbugs) from 4.9.4 to 4.9.5.
- [Release notes](https://github.com/spotbugs/spotbugs/releases)
- [Changelog](https://github.com/spotbugs/spotbugs/blob/master/CHANGELOG.md)
- [Commits](spotbugs/spotbugs@4.9.4...4.9.5)

---
updated-dependencies:
- dependency-name: com.github.spotbugs:spotbugs-annotations
  dependency-version: 4.9.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…sitory-hdfs (#19290)

* Bump com.google.code.gson:gson in /plugins/repository-hdfs

Bumps [com.google.code.gson:gson](https://github.com/google/gson) from 2.13.1 to 2.13.2.
- [Release notes](https://github.com/google/gson/releases)
- [Changelog](https://github.com/google/gson/blob/main/CHANGELOG.md)
- [Commits](google/gson@gson-parent-2.13.1...gson-parent-2.13.2)

---
updated-dependencies:
- dependency-name: com.google.code.gson:gson
  dependency-version: 2.13.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Craig Perkins <[email protected]>
…ository-azure (#19291)

* Bump com.nimbusds:oauth2-oidc-sdk in /plugins/repository-azure

Bumps [com.nimbusds:oauth2-oidc-sdk](https://bitbucket.org/connect2id/oauth-2.0-sdk-with-openid-connect-extensions) from 11.25 to 11.28.
- [Changelog](https://bitbucket.org/connect2id/oauth-2.0-sdk-with-openid-connect-extensions/src/master/CHANGELOG.txt)
- [Commits](https://bitbucket.org/connect2id/oauth-2.0-sdk-with-openid-connect-extensions/branches/compare/11.28..11.25)

---
updated-dependencies:
- dependency-name: com.nimbusds:oauth2-oidc-sdk
  dependency-version: '11.28'
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Craig Perkins <[email protected]>
* Support system generated search pipeline.

Signed-off-by: Bo Zhang <[email protected]>

* Add an example plugin for system generated search processors.

Signed-off-by: Bo Zhang <[email protected]>

---------

Signed-off-by: Bo Zhang <[email protected]>
* Upgrade opensearch-protobufs dependency to 0.7.0 and update transport-grpc module compatibility

- Upgrade protobufs dependency from 0.6.0 to 0.7.0 in transport-grpc module
- Update all protobuf utility classes to handle API changes in 0.7.0
- Fix enum structure changes (simple enums to message with oneof fields)
- Update field name changes (setIndex -> setUnderscoreIndex, etc.)
- Handle new OperationContainer pattern for bulk operations
- Update all corresponding unit and integration tests
- Add new SHA for protobufs-0.7.0.jar and remove old 0.6.0 SHA

Signed-off-by: sakrah <[email protected]>

* Use 0.8.0 protos and fix transport-grpc compilation errors

Signed-off-by: Karen Xu <[email protected]>

* Add unit tests to improve transport-grpc module coverage

Signed-off-by: sakrah <[email protected]>

* Improve test coverage for search query utilities

Signed-off-by: sakrah <[email protected]>

* Improve unit test coverage for search query utilities

Signed-off-by: sakrah <[email protected]>

* transport-grpc: update to opensearch-protobufs 0.9.0 and improve FieldValue handling

Signed-off-by: sakrah <[email protected]>

* Update transport-grpc to opensearch-protobufs 0.10.0-SNAPSHOT

Signed-off-by: sakrah <[email protected]>

* use 0.10.0

Signed-off-by: Karen Xu <[email protected]>

* remove map and refactor fieldvalueprotoutils.fromproto
fix InnerHitBuilderProtoUtils
tests

Signed-off-by: Karen Xu <[email protected]>

* forgot to commit spotlessApply changes

Signed-off-by: Karen Xu <[email protected]>

* update to 0.12.0 protos

Signed-off-by: Karen Xu <[email protected]>

* fix compilation

Signed-off-by: Karen Xu <[email protected]>

* use 0.13.0

Signed-off-by: karenx <[email protected]>

---------

Signed-off-by: sakrah <[email protected]>
Signed-off-by: Karen Xu <[email protected]>
Signed-off-by: Karen X <[email protected]>
Signed-off-by: karenx <[email protected]>
Co-authored-by: sakrah <[email protected]>
Co-authored-by: karenx <[email protected]>
One test method had a race condition when getting an index after
closing. This change extracts the common pattern of polling until the
index is available and uses it everywhere.

Signed-off-by: Andrew Ross <[email protected]>
* Add new extensible method to DocRequest to specify type

Signed-off-by: Craig Perkins <[email protected]>

* Add CHANGELOG entry

Signed-off-by: Craig Perkins <[email protected]>

* Add CHANGELOG entry

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
* Field collapsing supports search_after

Signed-off-by: Binlong Gao <[email protected]>

* Modify change log

Signed-off-by: Binlong Gao <[email protected]>

* Avoid changing public APIs

Signed-off-by: Binlong Gao <[email protected]>

* Revert change for the existing method

Signed-off-by: Binlong Gao <[email protected]>

* Format change log

Signed-off-by: Binlong Gao <[email protected]>

* Fix some issues

Signed-off-by: Binlong Gao <[email protected]>

* Remove duplicate code

Signed-off-by: Binlong Gao <[email protected]>

* Fix format issue

Signed-off-by: Binlong Gao <[email protected]>

---------

Signed-off-by: Binlong Gao <[email protected]>
…19303)

* Fix for Bug in DerivedFieldScript should support emitting Float type object: #19271

Signed-off-by: ishag4 <[email protected]>

* Fix for Bug in DerivedFieldScript should support emitting Float type object: #19271

Signed-off-by: ishag4 <[email protected]>

* Fix for bug in DerivedFieldScript: support emitting Float type object #19271

Signed-off-by: Isha Gupta <[email protected]>

---------

Signed-off-by: ishag4 <[email protected]>
Signed-off-by: Isha Gupta <[email protected]>
Co-authored-by: Isha Gupta <[email protected]>
… BytesRef (#19280)

* [GRPC] Optimize source conversion in gRPC search hits using zero-copy BytesRef

Signed-off-by: karenx <[email protected]>

* code cov

Signed-off-by: karenx <[email protected]>

* resolve merge conflicts

Signed-off-by: karenx <[email protected]>

---------

Signed-off-by: karenx <[email protected]>
Signed-off-by: Karen X <[email protected]>
Co-authored-by: karenx <[email protected]>
)

* Fix regression: preserve not(not X) in BooleanFlatteningRewriter Resolve #19266 by fixing double-negation under MUST_NOT introduced by #19060 When parent is must_not and nested bool has only must_not clauses, rewrite to a positive OR:

   not(bool(must_not:[X1..Xn])) => filter(bool(should:[X1..Xn], minimum_should_match=1))
   Use FILTER (not MUST) to preserve non-scoring semantics of must_not
   Leave other flattenings unchanged; only trigger on pure must_not nested bool
   Add unit test: testDoubleNegationConvertedToPositiveMustShould

Signed-off-by: Atri Sharma <[email protected]>

* spotless output

Signed-off-by: Atri Sharma <[email protected]>

* Remove must_not rewrite

Signed-off-by: Atri Sharma <[email protected]>

* Query rewriting tests: expand coverage; enforce idempotence and non-flattening invariants

This change broadens the test suite for query rewriting to codify semantics, guard against regressions, and address maintainer feedback around non‑idempotent must_not handling.
BooleanFlatteningRewriterTests:
	Add explicit “don’t flatten” cases when nested bool has non-default boost, has queryName, or nested should has minimum_should_match.
	Add idempotence check (second rewrite is a no-op in structure/serialization).
MatchAllRemovalRewriterTests:
	Remove match_all from must when a non-scoring context (filter) is present.
	Remove deeply nested match_all under filter-in-filter.
MustToFilterRewriterTests:
	Move boosted numeric term/range queries to filter; ensure text queries remain scoring.
	With null QueryShardContext, move ranges but do not move numeric term/terms.
MustNotToShouldRewriterTests:
	Add idempotence check.
	Ensure no rewrite for multi-valued numeric fields (complements must_not disabled).
TermsMergingRewriterTests:
	Should-clause merging above threshold.
	Per-field merging: only coalesce within the same field; mixed fields remain separate.
QueryRewriterRegistryTests:
	Dynamic setting update for terms merging threshold (e.g., 16 → 32) changes behavior as expected.
	Registry idempotence: applying rewrite twice yields identical structure.

Signed-off-by: Atri Sharma <[email protected]>

---------

Signed-off-by: Atri Sharma <[email protected]>
Fix flaky LeafSorterOptimizationTests by improving segment creation reliability

---------

Signed-off-by: Sriram Ganesh <[email protected]>
---------

Signed-off-by: Harsha Vamsi Kalluri <[email protected]>
)

---------

Signed-off-by: Lingxi Chen <[email protected]>
Signed-off-by: Lindsay-00 <[email protected]>
Co-authored-by: Lingxi Chen <[email protected]>
#19316)

Support docrep equivalent in pull-based ingestion

---------

Signed-off-by: Varun Bharadwaj <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>
---------

Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
* Add com.google.code.gson:gson to the gradle version catalog

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
…itory-azure (#19361)

* Bump com.azure:azure-identity in /plugins/repository-azure

Bumps [com.azure:azure-identity](https://github.com/Azure/azure-sdk-for-java) from 1.14.2 to 1.18.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-java/releases)
- [Commits](Azure/azure-sdk-for-java@azure-identity_1.14.2...azure-core_1.18.0)

---
updated-dependencies:
- dependency-name: com.azure:azure-identity
  dependency-version: 1.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
The evil tests had a dependency on jimfs but did not use it anywhere, so
I removed the dependency. The TranslogPolicyIT file had no corresponding
build.gradle file and therefore was just dead code. The test is no
longer relevant as it is related to pre-OpenSearch compatibility.

Signed-off-by: Andrew Ross <[email protected]>
* Bump aws-actions/configure-aws-credentials from 4 to 5

Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 4 to 5.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](aws-actions/configure-aws-credentials@v4...v5)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Craig Perkins <[email protected]>
lucy66hw and others added 30 commits October 31, 2025 14:57
…rors (#19831)

* [GRPC] Compile with protobuf 0.23.0

Signed-off-by: xil <[email protected]>

* Add changelog

Signed-off-by: xil <[email protected]>

---------

Signed-off-by: xil <[email protected]>
…covery-azure-classic (#19472)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandesh Kumar <[email protected]>
…org.opensearch.index package (#19859)

* Replace explicit type conversion with instanceof pattern variable in org.opensearch.index package

Signed-off-by: Binlong Gao <[email protected]>

* Optimize some code

Signed-off-by: Binlong Gao <[email protected]>

---------

Signed-off-by: Binlong Gao <[email protected]>
* Add Builder in DocStats and refactor usage

Signed-off-by: Jean Kim <[email protected]>

* Add Builder in StoreStats and refactor usage

Signed-off-by: Jean Kim <[email protected]>

* Add Change Log

Signed-off-by: Jean Kim <[email protected]>

---------

Signed-off-by: Jean Kim <[email protected]>
… /plugins/repository-gcs (#19872)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandesh Kumar <[email protected]>
…ixtures/hdfs-fixture (#19871)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandesh Kumar <[email protected]>
…ugin.getRestHandlerWrapper (#19875)

* Pass registry of headers from ActionPlugin.getRestHeaders to ActionPlugin.getRestHandlerWrapper

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
…Query, MatchPhrasePrefix, PrefixQuery, MatchQuery (#19854)

* [GRPC] Implement GRPC ConstantScoreQuerym, FuzzyQuery, MatchBoolPrefixQuery, MatchPhrasePrefix, PrefixQuery, MatchQuery

Signed-off-by: lucy66hw <[email protected]>
Signed-off-by: xil <[email protected]>

* Add changelog

Signed-off-by: xil <[email protected]>

* remove unused log

Signed-off-by: xil <[email protected]>

* Add missing javadoc

Signed-off-by: xil <[email protected]>

* Add UT

Signed-off-by: xil <[email protected]>

* spotlessApply

Signed-off-by: xil <[email protected]>

* Add UT

Signed-off-by: xil <[email protected]>

* update ut

Signed-off-by: xil <[email protected]>

---------

Signed-off-by: lucy66hw <[email protected]>
Signed-off-by: xil <[email protected]>
* S1144: Unused "private" methods should be removed

Signed-off-by: Vincent Potucek <[email protected]>

* Revert Accidental Missing import

Signed-off-by: Sandesh Kumar <[email protected]>

---------

Signed-off-by: Vincent Potucek <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Co-authored-by: Vincent Potucek <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
…ests. (#19849)

The analyze action has one special property that distinguishes it from all other actions extending TransportSingleShardAction: it can be executed without an index. This is a bit surprising, as we do not have a shard, while being in a class called "SingleShardAction". For this, the TransportAnalyzeAction does use a number of special cases. Thus, we also need to add a special case for the index resolution here.

Signed-off-by: Nils Bandener <[email protected]>
Co-authored-by: Vincent Potucek <[email protected]>
…recation by 2025/11 (#18772)

* Switch macos13(intel) and macos14(arm) to macos-15-intel and macos-15

Signed-off-by: Peter Zhu <[email protected]>

* Remove macos-15-intel from assemble to be in sync with original setup as it takes long time

Signed-off-by: Peter Zhu <[email protected]>

---------

Signed-off-by: Peter Zhu <[email protected]>
* Exclude group com.microsoft.sqlserver from hadoop-minicluster

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
* [GRPC] Support Sort and Highlight

Signed-off-by: lucy66hw <[email protected]>
Signed-off-by: xil <[email protected]>

* update changelog

Signed-off-by: xil <[email protected]>

* spotlessApply

Signed-off-by: xil <[email protected]>

* Add ut

Signed-off-by: xil <[email protected]>

* spotlessApply

Signed-off-by: xil <[email protected]>

* address comment

Signed-off-by: xil <[email protected]>

* Add UT

Signed-off-by: xil <[email protected]>

* revert back Highlight

Signed-off-by: xil <[email protected]>

---------

Signed-off-by: lucy66hw <[email protected]>
Signed-off-by: xil <[email protected]>
Signed-off-by: Xi Lu <[email protected]>
…ll scorer (#19650)

* fix issue 18446 NPE by making sure scoreSupplier.get() returns non-null scorer

Signed-off-by: Yao Zou <[email protected]>

* add tests and changelog

Signed-off-by: Yao Zou <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>

---------

Signed-off-by: Yao Zou <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: Haruki <[email protected]>
* Implement GRPC FunctionScoreQuery

Signed-off-by: xil <[email protected]>

* update changelog

Signed-off-by: xil <[email protected]>

* spotlessApply

Signed-off-by: xil <[email protected]>

* remove unused change

Signed-off-by: xil <[email protected]>

* remove unused

Signed-off-by: xil <[email protected]>

* Address comment

Signed-off-by: xil <[email protected]>

* rebase

Signed-off-by: xil <[email protected]>

* revert

Signed-off-by: xil <[email protected]>

* update changelog

Signed-off-by: xil <[email protected]>

* rename converter to utils

Signed-off-by: xil <[email protected]>

* revert removed tests

Signed-off-by: xil <[email protected]>

* spotlessApply

Signed-off-by: xil <[email protected]>

---------

Signed-off-by: xil <[email protected]>
Signed-off-by: xil <[email protected]>
Signed-off-by: Karen X <[email protected]>
Co-authored-by: xil <[email protected]>
Co-authored-by: Karen X <[email protected]>
…AccessController in discovery plugins (#19802)

* Replace java.security.AccessController with org.opensearch.secure_sm.AccessController in discovery plugins

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Fix test

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.