File tree Expand file tree Collapse file tree 2 files changed +10
-6
lines changed Expand file tree Collapse file tree 2 files changed +10
-6
lines changed Original file line number Diff line number Diff line change @@ -146,6 +146,9 @@ Documentation
146
146
* A new tutorial section on :ref: `tutorial_pickle ` has been added (:issue: `91 `).
147
147
* A new tutorial section on :ref: `tutorial_datetime ` has been added.
148
148
* A new tutorial section on :ref: `tutorial_diagnostics ` has been added.
149
+ * The tutorial sections on :ref: `tutorial_sync ` and :ref: `tutorial_tips_blosc ` have been
150
+ updated to provide information about how to avoid program hangs when using the Blosc
151
+ compressor with multiple processes (:issue: `199 `, :issue: `201 `).
149
152
150
153
Maintenance
151
154
~~~~~~~~~~~
@@ -161,7 +164,8 @@ Acknowledgments
161
164
Code was contributed to this release by :user: `John Kirkham <jakirkham> ` and
162
165
:user: `Prakhar Goel <newt0311> `.
163
166
164
- Documentation was contributed to this release by :user: `Mamy Ratsimbazafy <mratsim> `.
167
+ Documentation was contributed to this release by :user: `Mamy Ratsimbazafy <mratsim> `
168
+ and :user: `Charles Noyes <CSNoyes> `.
165
169
166
170
Thank you to :user: `John Kirkham <jakirkham> `, :user: `Stephan Hoyer <shoyer> `,
167
171
:user: `Francesc Alted <FrancescAlted> `, and :user: `Matthew Rocklin <mrocklin> ` for code
Original file line number Diff line number Diff line change @@ -981,10 +981,10 @@ some networked file systems). E.g.::
981
981
982
982
This array is safe to read or write from multiple processes.
983
983
984
- When using multiple processes to parallelize reads or writes with the blosc
985
- compression library, it is necessary to set ``zarr .blosc.use_threads = False ``,
986
- as blosc's context manager will share incorrect global state amongst processes.
987
- Disabling will allow the 'contextual' manager to have correct local state .
984
+ When using multiple processes to parallelize reads or writes on arrays using the Blosc
985
+ compression library, it may be necessary to set ``numcodecs .blosc.use_threads = False ``,
986
+ as otherwise Blosc may share incorrect global state amongst processes causing programs
987
+ to hang. See also the section on :ref: ` tutorial_tips_blosc ` below .
988
988
989
989
Please note that support for parallel computing is an area of ongoing research
990
990
and development. If you are using Zarr for parallel computing, we welcome
@@ -1087,7 +1087,7 @@ Configuring Blosc
1087
1087
~~~~~~~~~~~~~~~~~
1088
1088
1089
1089
The Blosc compressor is able to use multiple threads internally to accelerate
1090
- compression and decompression. By default, Zarr allows Blosc to use up to 8
1090
+ compression and decompression. By default, Blosc uses up to 8
1091
1091
internal threads. The number of Blosc threads can be changed to increase or
1092
1092
decrease this number, e.g.::
1093
1093
You can’t perform that action at this time.
0 commit comments