Skip to content

Commit 83e7363

Browse files
committed
docs
1 parent 9707672 commit 83e7363

File tree

2 files changed

+19
-2
lines changed

2 files changed

+19
-2
lines changed

.cspell/custom-dictionary.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -172,6 +172,7 @@ oxidising
172172
pathtovalidate
173173
plottable
174174
posint
175+
posteriori
175176
printoptions
176177
punx
177178
pynxtools
Lines changed: 18 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,22 @@
11
# Dataconverter append mode
22

3-
!!! info "WIP"
3+
There are cases where users wish to compose a NeXus/HDF5 file with data from multiple sources. Typical examples include:
44

5-
Explain assumptions made and limitations of the current implementation. Note skip-verify is skipped hard.
5+
- A file should contain multiple `NXentry` instances where each instance applies a different application definition.
6+
- Content under `NXentry` instances is composed from running a specific pynxtools parser plugin plus additional content
7+
that is injected via software that might not be written in Python.
8+
9+
Enabling such use cases while minimizing data copying is the idea behind the append mode of the dataconverter. It is activated by
10+
passing the `--append` flag during [command line invocation](../../tutorial/converting-data-to-nexus.md).
11+
12+
**The append mode must not be understood as a functionality that allows overwriting data.** Convinced that data should be immutable,
13+
once generated, the append mode feature works with the following key assumptions:
14+
15+
- Only groups, datasets, or attributes not yet existent can be added when in append mode.
16+
The implementation catches attempts of overwriting existent such type of HDF5 objects,
17+
emitting respective logging messages.
18+
- When in append mode, the internal validation of the `template` dictionary is switched off,
19+
irrespective if `--skip-verify` is passed or not.
20+
Instead, users should validate [the HDF5 file a posteriori](../../how-tos/pynxtools/validate-nexus-files.md).
21+
- Despite the HDF5 library offers the functionality, a reshaping of HDF5 datasets is not supported.
622

0 commit comments

Comments
 (0)