File tree Expand file tree Collapse file tree 2 files changed +19
-2
lines changed
Expand file tree Collapse file tree 2 files changed +19
-2
lines changed Original file line number Diff line number Diff line change @@ -172,6 +172,7 @@ oxidising
172172pathtovalidate
173173plottable
174174posint
175+ posteriori
175176printoptions
176177punx
177178pynxtools
Original file line number Diff line number Diff line change 11# Dataconverter append mode
22
3- !!! info "WIP"
3+ There are cases where users wish to compose a NeXus/HDF5 file with data from multiple sources. Typical examples include:
44
5- Explain assumptions made and limitations of the current implementation. Note skip-verify is skipped hard.
5+ - A file should contain multiple ` NXentry ` instances where each instance applies a different application definition.
6+ - Content under ` NXentry ` instances is composed from running a specific pynxtools parser plugin plus additional content
7+ that is injected via software that might not be written in Python.
8+
9+ Enabling such use cases while minimizing data copying is the idea behind the append mode of the dataconverter. It is activated by
10+ passing the ` --append ` flag during [ command line invocation] ( ../../tutorial/converting-data-to-nexus.md ) .
11+
12+ ** The append mode must not be understood as a functionality that allows overwriting data.** Convinced that data should be immutable,
13+ once generated, the append mode feature works with the following key assumptions:
14+
15+ - Only groups, datasets, or attributes not yet existent can be added when in append mode.
16+ The implementation catches attempts of overwriting existent such type of HDF5 objects,
17+ emitting respective logging messages.
18+ - When in append mode, the internal validation of the ` template ` dictionary is switched off,
19+ irrespective if ` --skip-verify ` is passed or not.
20+ Instead, users should validate [ the HDF5 file a posteriori] ( ../../how-tos/pynxtools/validate-nexus-files.md ) .
21+ - Despite the HDF5 library offers the functionality, a reshaping of HDF5 datasets is not supported.
622
You can’t perform that action at this time.
0 commit comments