Skip to content

Commit 6eef0c6

Browse files
committed
Improve docs with default parallelism settings.
Fix #442 by adding the default values of concurrency and workers.
1 parent 7c5396f commit 6eef0c6

File tree

2 files changed

+10
-1
lines changed

2 files changed

+10
-1
lines changed

pgloader.1

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
.\" generated with Ronn/v0.7.3
22
.\" http://github.com/rtomayko/ronn/tree/0.7.3
33
.
4-
.TH "PGLOADER" "1" "August 2016" "ff" ""
4+
.TH "PGLOADER" "1" "December 2016" "ff" ""
55
.
66
.SH "NAME"
77
\fBpgloader\fR \- PostgreSQL data loader
@@ -496,6 +496,9 @@ So with \fBworkers = 4, concurrency = 2\fR, the parallel scheduler will maintain
496496
With \fBworkers = 8, concurrency = 1\fR, we then are able to work on several units of work at the same time\. In the database sources, a unit of work is a table, so those settings allow pgloader to be active on as many as 3 tables at any time in the load process\.
497497
.
498498
.P
499+
The defaults are \fBworkers = 4, concurrency = 1\fR when loading from a database source, and \fBworkers = 8, concurrency = 2\fR when loading from something else (currently, a file)\. Those defaults are arbitrary and waiting for feedback from users, so please consider providing feedback if you play with the settings\.
500+
.
501+
.P
499502
As the \fBCREATE INDEX\fR threads started by pgloader are only waiting until PostgreSQL is done with the real work, those threads are \fINOT\fR counted into the concurrency levels as detailed here\.
500503
.
501504
.P

pgloader.1.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -445,6 +445,12 @@ units of work at the same time. In the database sources, a unit of work is a
445445
table, so those settings allow pgloader to be active on as many as 3 tables
446446
at any time in the load process.
447447

448+
The defaults are `workers = 4, concurrency = 1` when loading from a database
449+
source, and `workers = 8, concurrency = 2` when loading from something else
450+
(currently, a file). Those defaults are arbitrary and waiting for feedback
451+
from users, so please consider providing feedback if you play with the
452+
settings.
453+
448454
As the `CREATE INDEX` threads started by pgloader are only waiting until
449455
PostgreSQL is done with the real work, those threads are *NOT* counted into
450456
the concurrency levels as detailed here.

0 commit comments

Comments
 (0)