You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/documentation/testing.md
+16-9Lines changed: 16 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,18 +5,25 @@ To run MFC's test suite, run
5
5
./mfc.sh test -j <thread count>
6
6
```
7
7
8
-
It will generate and run test cases, comparing their output to that of previous runs from versions of MFC considered to be accurate.
9
-
*golden files*, stored in the `tests/` directory contain this data, by aggregating `.dat` files generated when running MFC.
10
-
A test is considered passing when our error tolerances are met, in order to maintain a high level of stability and accuracy.
8
+
It will generate and run test cases, comparing their output to previous runs from versions of MFC considered accurate.
9
+
*golden files*, stored in the `tests/` directory contain this data, aggregating `.dat` files generated when running MFC.
10
+
A test is considered passing when our error tolerances are met in order to maintain a high level of stability and accuracy.
11
11
Run `./mfc.sh test -h` for a full list of accepted arguments.
12
12
13
13
Most notably, you can consult the full list of tests by running
14
-
```
14
+
```shell
15
15
./mfc.sh test -l
16
16
```
17
17
18
18
To restrict to a given range, use the `--from` (`-f`) and `--to` (`-t`) options.
19
19
To run a (non-contiguous) subset of tests, use the `--only` (`-o`) option instead.
20
+
To specify a computer, pass the `-c` flag to `./mfc.sh run` like so:
21
+
```shell
22
+
./mfc.sh test -j <thread count> -- -c <computer name>
23
+
```
24
+
where `<computer name>` could be `phoenix` or any of the others in the [templates](https://github.com/MFlowCode/MFC/tree/master/toolchain/templates)).
25
+
You can create new templates with the appropriate run commands or omit this option.
26
+
The use of `--` in the above command passes options to the `./mfc.sh run` command underlying the `./mfc.sh test`.
20
27
21
28
### Creating Tests
22
29
@@ -74,7 +81,7 @@ for weno_order in [3, 5]:
74
81
stack.pop()
75
82
```
76
83
77
-
When pushing to the stack, or creating a new case with the `define_case_d` function, you must specify:
84
+
When pushing to the stack or creating a new case with the `define_case_d` function, you must specify:
78
85
-`stack`: The current stack.
79
86
-`trace`: A human-readable string describing what you are currently varying.
80
87
-`variations`: A Python dictionary with case parameter variations.
@@ -86,13 +93,13 @@ Finally, the case is appended to the `cases` list, which will be returned by the
86
93
87
94
### Testing Post Process
88
95
89
-
To test updated post process code, append the `-a` or `--test-all` option:
96
+
To test the post-processing code, append the `-a` or `--test-all` option:
90
97
```shell
91
98
./mfc.sh test -a -j 8
92
99
```
93
100
94
-
This argument will re-run the test stack with `parallel_io=True`, which generates silo_hdf5 files.
101
+
This argument will re-run the test stack with `parallel_io='T'`, which generates silo_hdf5 files.
95
102
It will also turn most write parameters (`*_wrt`) on.
96
-
Then, it searches through the silo files using `h5dump` to ensure that there are no NaNs or Infinitys.
97
-
Although adding this option does not guarantee that accurate silo files are generated, it does ensure that post process does not fail or produce malformed data.
103
+
Then, it searches through the silo files using `h5dump` to ensure that there are no `NaN`s or `Infinity`s.
104
+
Although adding this option does not guarantee that accurate `.silo` files are generated, it does ensure that the post-process code does not fail or produce malformed data.
0 commit comments