You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/about.rst
+17-16Lines changed: 17 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,36 +1,37 @@
1
-
# About ReFrame
1
+
=============
2
+
About ReFrame
3
+
=============
2
4
3
-
## What Is ReFrame?
5
+
What Is ReFrame?
6
+
----------------
4
7
5
8
ReFrame is a framework developed by CSCS to facilitate the writing of regression tests that check the sanity of HPC systems.
6
-
Its main goal is to allow users to write their own regression tests without having to deal with all the details of setting up the environment for the test, quering the status of their job, managing the output of the job and looking for sanity and/or performance results.
9
+
Its main goal is to allow users to write their own regression tests without having to deal with all the details of setting up the environment for the test, querying the status of their job, managing the output of the job and looking for sanity and/or performance results.
7
10
Users should be concerned only about the logical requirements of their tests.
8
11
This allows users' regression checks to be maintained and adapted to new systems easily.
9
12
10
13
The user describes his test in a simple Python class and the framework takes care of all the details of the low-level interaction with the system.
11
14
The framework is structured in such a way that with a basic knowledge of Python and minimal coding a user can write a regression test, which will be able to run out-of-the-box on a variety of systems and programming environments.
12
15
13
16
Writing regression tests in a high-level language, such as Python, allows users to take advantage of the language's higher expressiveness and bigger capabilities compared to classical shell scripting, which is the norm in HPC testing.
14
-
This could lead to a more manageable code base of regression tests with significanly reduced maintenance costs.
17
+
This could lead to a more manageable code base of regression tests with significantly reduced maintenance costs.
15
18
16
-
## ReFrame's Goals
19
+
ReFrame's Goals
20
+
---------------
17
21
18
22
When designing the framework we have set three major goals:
19
23
20
24
Productivity
21
-
: The writer of a regression test should focus only on the logical structure and requirements of the test and should not need to deal with any of the low level details of interacting with the system, e.g., how the environment of the test is loaded, how the associated job is created and has its status checked, how the output parsing is performed etc.
22
-
23
-
25
+
The writer of a regression test should focus only on the logical structure and requirements of the test and should not need to deal with any of the low level details of interacting with the system, e.g., how the environment of the test is loaded, how the associated job is created and has its status checked, how the output parsing is performed etc.
24
26
Portability
25
-
: Configuring the framework to support new systems and system configurations should be easy and should not affect the existing tests.
26
-
Also, adding support of a new system in a regression test should require minimal adjustments.
27
-
27
+
Configuring the framework to support new systems and system configurations should be easy and should not affect the existing tests.
28
+
Also, adding support of a new system in a regression test should require minimal adjustments.
28
29
Robustness and ease of use
29
-
: The new framework must be stable enough and easy to use by non-advanced users.
30
-
When the system needs to be returned to users outside normal working hours the personnel in charge should be able to run the regression suite and verify the sanity of the system with a minimal involvement.
31
-
30
+
The new framework must be stable enough and easy to use by non-advanced users.
31
+
When the system needs to be returned to users outside normal working hours the personnel in charge should be able to run the regression suite and verify the sanity of the system with a minimal involvement.
32
32
33
-
## Why ReFrame?
33
+
Why ReFrame?
34
+
------------
34
35
35
36
HPC systems are highly complex systems in all levels of integration;
36
37
from the physical infrastructure up to the software stack provided to the users.
@@ -44,7 +45,7 @@ Similarly, porting a test to a different system may require significant effort i
44
45
45
46
ReFrame was designed to help HPC support teams to easily write tests that
46
47
47
-
* monitor the impact of changes to the system that would affect negativelly the users,
48
+
* monitor the impact of changes to the system that would affect negatively the users,
0 commit comments