Skip to content

Commit 73532fb

Browse files
committed
🐛 Reduce batch size for upsert_messages
1 parent 23ee82a commit 73532fb

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

lib/sequin/databases_runtime/slot_message_store.ex

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -700,7 +700,9 @@ defmodule Sequin.DatabasesRuntime.SlotMessageStore do
700700

701701
defp upsert_messages(%State{} = state, messages) do
702702
messages
703-
|> Enum.chunk_every(10_000)
703+
# This value is calculated based on the number of parameters in our consumer_events/consumer_records
704+
# upserts and the Postgres limit of 65535 parameters per query.
705+
|> Enum.chunk_every(2_000)
704706
|> Enum.each(fn chunk ->
705707
{:ok, _count} = Consumers.upsert_consumer_messages(state.consumer, chunk)
706708
end)

0 commit comments

Comments
 (0)