Replies: 3 comments 8 replies
-
|
Can you send the entire log output? I suspect that there was an error early on that caused one of the threads to fail.
From: Manju050 ***@***.***>
Date: Tuesday, April 8, 2025 at 3:14 AM
To: CrunchyData/pgCompare ***@***.***>
Cc: Subscribed ***@***.***>
Subject: [CrunchyData/pgCompare] pgcompare getting stuck (Discussion #59)
Any reasons why it is taking so much time?
LOGS:-
[2025-04-08 12:16:09] [INFO ] [ReconcileController ] Creating data compare staging tables
[2025-04-08 12:16:09] [INFO ] [ReconcileController ] Starting compare thread 0
[2025-04-08 12:16:09] [INFO ] [Observer-c460-t0 ] Starting reconcile observer
[2025-04-08 12:16:09] [INFO ] [Observer-c460-t0 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [Reconcile-source-c460-t0] (source) Start database reconcile thread
[2025-04-08 12:16:09] [INFO ] [Reconcile-target-c460-t0] (target) Start database reconcile thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i1 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [Reconcile-source-c460-t0] (source) Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i1 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i7 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i2 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i2 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i3 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i3 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i4 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i4 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [Reconcile-target-c460-t0] (target) Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i5 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i5 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i6 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i6 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i7 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i1 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i8 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i8 ] Start repository loader thread
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i7 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i2 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i2 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [Reconcile-source-c460-t0] (source) Connecting to database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i3 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i3 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [Reconcile-target-c460-t0] (target) Connecting to database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i4 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i4 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i1 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i5 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i5 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i6 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i6 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i7 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-source-t0-i8 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [loader-target-t0-i8 ] Connecting to repository database
[2025-04-08 12:16:09] [INFO ] [Reconcile-target-c460-t0] (target) Complete. Total rows loaded: 0
[2025-04-08 12:16:09] [INFO ] [Reconcile-source-c460-t0] (source) Complete. Total rows loaded: 0
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i1 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i7 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i2 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i2 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i3 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i4 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i3 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i4 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i1 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i5 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i6 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i5 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i8 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i7 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-source-t0-i8 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [loader-target-t0-i6 ] Loader thread complete.
[2025-04-08 12:16:11] [INFO ] [ReconcileController ] Waiting for compare threads to complete
[2025-04-08 12:16:11] [INFO ] [ReconcileController ] Waiting for reconcile threads to complete
—
Reply to this email directly, view it on GitHub<#59>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AHQXQRUG5QYDRPRJ7SYQP7L2YNZLLAVCNFSM6AAAAAB2VOUNICVHI2DSMVQWIX3LMV43ERDJONRXK43TNFXW4OZYGE3TOOBRGE>.
You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
Actuallly, |
Beta Was this translation helpful? Give feedback.
-
|
You can reach me directly at ***@***.******@***.***>. That may be easier to send over logs. Standing by….
From: Manju050 ***@***.***>
Date: Wednesday, April 9, 2025 at 9:15 AM
To: CrunchyData/pgCompare ***@***.***>
Cc: bpace ***@***.***>, Comment ***@***.***>
Subject: Re: [CrunchyData/pgCompare] pgCompare hangs during execution (Discussion #59)
Actuallly,
I have 100 schemas to compare.
i tried to call pgcompare for each schema serially.
Randomly at one point of time it stucks.
will run it again and will share the logs.
Thanks for the reply.
—
Reply to this email directly, view it on GitHub<#59 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AHQXQRU4W44CR54IBKUBXTD2YUMPZAVCNFSM6AAAAAB2VOUNICVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTENZXHA2DAMY>.
You are receiving this because you commented.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
output.txt |
Beta Was this translation helpful? Give feedback.
-
|
@cbrianpace any suggestions from logs? |
Beta Was this translation helpful? Give feedback.
-
|
A couple of suggestions:
Based on the log neither the source or target have any rows. Will have to debug why it is waiting for additional threads to close as all threads did close. I suspect it is a timing thing with 0 rows being returned. Setting loader-threads to 0 will address this. |
Beta Was this translation helpful? Give feedback.
-
|
@cbrianpace thank you.This works without hanging. |
Beta Was this translation helpful? Give feedback.
-
|
What type of performance are you getting? There are a couple of parameters that can improve performance. If you can send the current settings you are using, I may be able to make some suggestions. |
Beta Was this translation helpful? Give feedback.
-
|
Sure @cbrianpace |
Beta Was this translation helpful? Give feedback.
-
|
I just pushed a fix (version 0.3.6.4) that should address that 'hanging' issue when the rows are 0. Make sure you pull down the latest version. With that in. mind, you should now be able to set loader-threads to 2 (would not go higher than 4). Also increase message-queue-size to 1000. This should give you a boost on larger tables (will make small tables a few seconds slower from the overhead of coordinating the threads). For the postgres side, it seems you are using the same postgres host as the repository, source, and target. This will cause things to be slower as well since they are all competing for the same memory, cpu, and io. I know this is for testing, but you may at least want to move the repo to its own postgres cluster. For the repo postgres instance (and only for the repo instance as you would not want these settings for a production postgres or any postgres housing non-pgcompare repo data), I would set the following postgres parameters: It is hte full_page_writes and synchronous_commit settings that you do not want to set in any other postgres instance. Let me know what you are seeing from a performance perspective. On the average platform, you should see about 40,000 rows per second. |
Beta Was this translation helpful? Give feedback.
-
|
@cbrianpace Thank you very much! |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Any reasons why it is stuck at " Waiting for reconcile threads to complete "?
LOGS:-
Beta Was this translation helpful? Give feedback.
All reactions