-
Hello folks, I have been reading the documentation and searching on stack overflow and could not find the answer for this question.
Does it work like the batch? https://stackoverflow.com/a/64222124/17932189 Many thanks! |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
I never specifically tried this, but I would expect that it should normally not commit the consumed offset on the source and try it again. |
Beta Was this translation helpful? Give feedback.
-
MirrorMaker2 is built on top of KafkaConnect, which is built on top of KafkaClient APIs. This means that it works like you say, it simply try again. By default, producer's retries are MAX_INT. Note that the semantics is at_least_once, so your consumer on the target cluster should be idempotent if you don't want duplicates. |
Beta Was this translation helpful? Give feedback.
MirrorMaker2 is built on top of KafkaConnect, which is built on top of KafkaClient APIs. This means that it works like you say, it simply try again. By default, producer's retries are MAX_INT. Note that the semantics is at_least_once, so your consumer on the target cluster should be idempotent if you don't want duplicates.