You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/sphinx/group.rst
+6-5Lines changed: 6 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,15 +6,16 @@ Groups
6
6
7
7
A "group" contains a collection of timestreams with consistent sampling. In other words, each timestream in the group has the same number of samples. Each timestream has a name, a data type, and a string describing the units. This metadata for one timestream is called a "field". The collection of fields used in a group is called the "schema" of the group. A group's schema is fixed at creation time, but the number of samples may be changed as needed. A group is associated with a parent block. Read and write operations on the data in a group is passed off to the "backend" class in use. A group may also have a dictionary of scalar properties associated with it.
Copy file name to clipboardExpand all lines: docs/sphinx/intervals.rst
+10-8Lines changed: 10 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,14 +6,6 @@ Intervals
6
6
7
7
When dealing with time domain data, it is very common to specify ranges of time that have some meaning. These might be spans of good or bad data, or time ranges that enclose some important event or feature. This use case is so common that TIDAS has a built in object for this. An "intervals" object represents a list of time ranges. Each span can also optionally have a range of sample indices, which is useful if the intervals are associated with a particular group.
Copy file name to clipboardExpand all lines: docs/sphinx/volume.rst
+27-20Lines changed: 27 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,15 +6,20 @@ Volumes
6
6
7
7
A volume is the top-level TIDAS object. It defines the "backend" data format and holds a metadata database for fast(er) data selection and query operations. It also contains the root of a hierarchy (a tree) of "blocks".
8
8
9
+
10
+
Planning the Layout of a Volume
11
+
--------------------------------------
12
+
13
+
An important feature of TIDAS volumes is the ability to open / copy / link only a subset of the data. This selection operation is performed with a regular expression match on the tree of block names. This means that it is critical to plan out the organization of blocks to make it possible to do any desired data selections.
14
+
15
+
Most data collected from monitoring systems, experimental apparatuses, etc, have natural ways that the data might be split up into pieces. For example, if the data collection is started fresh each day, you might have a block for each day. If there are different sorts of data within one day which you might want to frequently split up, then you could have sub-blocks in each day for the different data types. Going the other direction up the hierarchy, you might organize the days into blocks for each month, each quarter, each year, etc.
16
+
17
+
9
18
Interface
10
19
---------------
11
20
12
-
C++
13
-
~~~~~~~~~
21
+
Here is a basic reference for the volume interface.
14
22
15
-
.. doxygenclass:: tidas::volume
16
-
:members:
17
-
:no-link:
18
23
19
24
Python
20
25
~~~~~~~~~
@@ -23,17 +28,19 @@ Python
23
28
:members:
24
29
25
30
31
+
C++
32
+
~~~~~~~~~
33
+
34
+
.. doxygenclass:: tidas::volume
35
+
:members:
36
+
:no-link:
37
+
26
38
27
39
Blocks
28
40
----------------
29
41
30
42
A "block" is simply a logical collection of data which has a "name" (a string) associated with it. A block can contain data itself, other blocks, or both. A volume contains a special "root" block, which is the top of the tree / hierarchy of blocks in the volume.
31
43
32
-
C++
33
-
~~~~~~~~~
34
-
35
-
.. doxygenclass:: tidas::block
36
-
:members:
37
44
38
45
Python
39
46
~~~~~~~~~
@@ -42,12 +49,11 @@ Python
42
49
:members:
43
50
44
51
45
-
Planning the Layout of a Volume
46
-
--------------------------------------
47
-
48
-
An important feature of TIDAS volumes is the ability to open / copy / link only a subset of the data. This selection operation is performed with a regular expression match on the tree of block names. This means that it is critical to plan out the organization of blocks to make it possible to do any desired data selections.
52
+
C++
53
+
~~~~~~~~~
49
54
50
-
Most data collected from monitoring systems, experimental apparatuses, etc, have natural ways that the data might be split up into pieces. For example, if the data collection is started fresh each day, you might have a block for each day. If there are different sorts of data within one day which you might want to frequently split up, then you could have sub-blocks in each day for the different data types. Going the other direction up the hierarchy, you might organize the days into blocks for each month, each quarter, each year, etc.
55
+
.. doxygenclass:: tidas::block
56
+
:members:
51
57
52
58
53
59
MPI Volumes
@@ -64,16 +70,17 @@ see those changes until the synchronization method is called.
64
70
Multiple processes writing to the same group or intervals object is not supported, and may corrupt the data files for those objects!
0 commit comments