Skip to content

Porting Scripted Upsert#760

Open
Nicholas Cole (NicholasDCole) wants to merge 2 commits intoconfluentinc:11.1.xfrom
NicholasDCole:feature/scripted_upsert_backport
Open

Porting Scripted Upsert#760
Nicholas Cole (NicholasDCole) wants to merge 2 commits intoconfluentinc:11.1.xfrom
NicholasDCole:feature/scripted_upsert_backport

Conversation

@NicholasDCole
Copy link

@NicholasDCole Nicholas Cole (NicholasDCole) commented Mar 11, 2024

Add scripted upsert functionality to ES Sink Connector

Problem

Need scripted upsert functionality to support older Elastic Search client/server version

Also, need ability to inject Kafka payload as Params object

Solution

Add SCRIPTED_UPSERT write.method and custom logic in DataConverter.java to handle parameter injection as well as script injection into ES UpdateRequest

Does this solution apply anywhere else?
  • yes
  • no
If yes, where?

Test Strategy

Testing done:
  • Unit tests
  • Integration tests
  • System tests
  • Manual tests

Release Plan

Merge -> 11.1.x -> Create release

This is a Backport for 11.1.x . I will also merge to master within another PR

N/A

@cla-assistant
Copy link

cla-assistant bot commented Mar 11, 2024

CLA assistant check
All committers have signed the CLA.

@NicholasDCole Nicholas Cole (NicholasDCole) marked this pull request as ready for review March 13, 2024 13:14
@NicholasDCole Nicholas Cole (NicholasDCole) requested a review from a team as a code owner March 13, 2024 13:14
@NicholasDCole
Copy link
Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant