ReFrame 3.8.1

ReFrame v3.8.1 Release Notes

New features and enhancements

n/a

Bug fixes

• Fix incomplete processor info object when processor topology is auto-detected (#2168)
• Fix pattern matching for test name in --ci-generate output (#2160)

Other

• Test run Spack and EasyBuild tutorial examples in a container (#2102)

ReFrame 3.8.0

ReFrame v3.8.0 Release Notes

New features and enhancements

• Allow setting test variables from the command line (#2117)
• New syntax for performance checking (#2083)
• Automatically detect location of Spack (#2123)
• Refactor test registry (#2119)
• Automatically create a Spack environment when not set (#2031)
• Use the variable built-in machinery in the build system classes (#2095)
• Improve handling of user programming errors (#2087)
• Add SGE scheduler backend (#1959)

Bug fixes

• Use partition's and system's environment when autodetecting the topology (#2140)
• Do not bypass metaclass logic in the bind directive (#2147)
• Do not crash if processor and/or device topology files are not properly formatted JSON files (#2136)
• Catch TypeError when filter_params function does not return a tuple (#2122)
• Fix default executable assignment (#2107)
• Make test_cancel_(with_grace|term_ignore) unit tests more robust (#2100)
• Handle None in Decimal conversion of junit report (#2098)
• Do not emit module unuse <path> after loading modules with Lmod from a specific path (#2094)
• Remove unnecessary file locks (#2091)
• Fix hook override with multiple inheritance (#2081)
• Remove redundant whitespace in local launcher's command (#2092)
• Fix the way a custom Python binary is passed to the bootstrap script (#2086)
• Always use $HOME for storing processor auto-detection results (#2074)

Other

• Change the EB template for deployment on 3.7.2 (#2111)
• Fix sanity function deprecation unit test (#2080)
• Don't fail the CI if a cleanup stage fails (#2073)
• Remove sn.sanity_function references from unit tests (#2071)
• Improve documentation of built-ins (#2128)
• Remove quotes from image link in README (#2126)
• Adapt README to use PyPI friendly img include (#2125)
• Use an absolute URL for the ReFrame logo in README.md (#2121)
• Fix documentation about processor auto-detection (#2079)

ReFrame 3.7.3

ReFrame v3.7.3 Release Notes

New features and enhancements

• Automatically create a Spack environment when not set (#2031)
• Use the variable built-in machinery in the build system classes (#2095)
• Improve handling of user programming errors (#2087)

Bug fixes

• Fix default executable assignment (#2107)
• Make test_cancel_(with_grace|term_ignore) unit tests more robust (#2100)
• Handle None in Decimal conversion of junit report (#2098)
• Do not emit module unuse <path> after loading modules with Lmod from a specific path (#2094)

Other

• Change the EB template for deployment on 3.7.2 (#2111)
• Use an absolute URL for the ReFrame logo in README.md (#2121)

ReFrame 3.7.2

ReFrame v3.7.2 Release Notes

New features and enhancements

• Add SGE scheduler backend (#1959)

Bug fixes

• Remove unnecessary file locks (#2091)
• Fix hook override with multiple inheritance (#2081)
• Remove redundant whitespace in local launcher's command (#2092)
• Fix the way a custom Python binary is passed to the bootstrap script (#2086)

ReFrame 3.7.1

ReFrame v3.7.1 Release Notes

This release fixes an important regression in 3.7.0 that could impact site-wide installations.

New features and enhancements

n/a

Bug fixes

• Always use $HOME for storing processor auto-detection results (#2074)

Other

• Fix sanity function deprecation unit test (#2080)
• Don't fail the CI if a cleanup stage fails (#2073)
• Remove sn.sanity_function references from unit tests (#2071)
• Fix documentation about processor auto-detection (#2079)

ReFrame 3.7.0

ReFrame v3.7.0 Release Notes

New features and enhancements

• Print the run report location at the end of a session (#2016)
• Make the @required_version decorator a class definition parameter (#2046)
• Expose @final decorator in the class body (#2058)
• Auto-detect cpu topology (#1991)
• Add sanity_function and deferrable builtins (#2007)
• Make hook-related machinery available as class directives (#1969)
• Add a new build system backend for building test code with Spack (#1871)
• Add new logging handler for sending test data in JSON to an HTTP server (#1964)
• Support test retries in the JUnit report (#1965)

Bug fixes

• Fix TypeError in logger when using tuples as dict keys (#2059)
• Add account and constraint to Eiger configuration (#2063)
• Remove PrgEnv-nvidia from Pilatus environs (#2060)
• Fix pipeline hook override (#2048)
• Increase timeout for test_git_repo_exists unittest (#2052)
• Hide data-descriptors from variable attributes (#2047)
• Restrict use of required keyword (#2012)
• Fix deep-copy of _Undefined constant (#2027)
• Fix unittests for module collections (#2021)
• Respect default values for module objects in the configuration (#2013)
• Fixes #2009 bug in failure summaries when some tests are skipped (#2010)
• Fix variable and parameter access as class attributes (#1988)
• Generate run reports per test with --ci-generate (#1972)
• Mark jobs properly as completed in PBS scheduler (#1944)
• Fix error checking of module commands in the class Tmod backends (#1971)
• Fixes find_modules() behaviour with flat module scheme when an environment is a substring of another one (#1961)

Other

• Serialize unit tests everywhere (#2068)
• Revert the change to codecov version (#2006)
• Use version 1.0.5 of the codecov github action (#2004)
• Add the codecov upload token to the github action (#2003)
• Add tutorial to showcase the use of build automation tools through ReFrame (#1989)
• Update figure and text about test execution (#2002)
• Fix code listings in configuration docs (#1999)
• Add tutorial about debugging sanity and performance patterns (#1985)
• Use PNG logo for compatibility with all browsers (#1976)

ReFrame 3.6.3

ReFrame v3.6.3 Release Notes

New features and enhancements

n/a

Bug fixes

• Restrict use of required keyword (#2012)
• Fix deep-copy of _Undefined constant (#2027)
• Fix unit tests for module collections (#2021)
• Respect default values for module objects in the configuration (#2013)
• Fixes #2009 bug in failure summaries when some tests are skipped (#2010)

ReFrame 3.6.2

ReFrame v3.6.2 Release Notes

New features and enhancements

• Make hook-related machinery available as class directives (#1969)

Bug fixes

• Fix variable and parameter access as class attributes (#1988)

Other

• Revert the change to codecov version (#2006)
• Use version 1.0.5 of the codecov github action (#2004)
• Add the codecov upload token to the github action (#2003)
• Add required access config for Pilatus (#1995)
• Update figure and text about test execution (#2002)
• Fix code listings in configuration docs (#1999)
• Add tutorial about debugging sanity and performance patterns (#1985)

ReFrame 3.6.1

ReFrame v3.6.1 Release Notes

New features and enhancements

• Add a new build system backend for building test code with Spack (#1871)
• Add new logging handler for sending test data in JSON to an HTTP server (#1964)
• Support test retries in the JUnit report (#1965)

Bug fixes

• Generate run reports per test with --ci-generate (#1972)
• Mark jobs properly as completed in PBS scheduler (#1944)
• Fix error checking of module commands in the class Tmod backends (#1971)
• Fixes find_modules() behaviour with flat module scheme when an environment is a substring of another one (#1961)

Other

• Use PNG logo for compatibility with all browsers (#1976)

ReFrame 3.6.0

ReFrame v3.6.0 Release Notes

New features and enhancements

• Add command-line option to generate a JUnit XML report (#1925)
• Add a --list-tags command-line action to list all the available test tags (#1945)
• Add a configuration option to disable automatic module conflict resolution (#1941)
• Deprecate the use of the @parameterized_test decorator (#1934)
• Issue a warning if a module operation is attempted on the nomod modules system (#1933)
• Abbreviate node lists in FAILURE INFO reports (#1912)
• Re-implement pipeline hook mechanism and add a post-init hook (#1865)
• Improve error message when parameters are undefined (#1888)
• Add test API methods for skipping tests (#1875)
• Show a preview of the standard error in cases of build failures (#1873)
• Improve access to the namespaces of both parameter and variable built-ins (#1819)
• Add a time_limit partition configuration parameter and a build_time_limit variable for regression tests (#1860)
• Allow setting the test description and executable name directly in the class body (#1862)
• Minimize the list of doc requirements (#1847)

Bug fixes

• Fix regression in setting the graylog server address (#1956)
• Warn when a check search path does not exist (#1949)
• Properly check exit status of ensurepip in bootstrap.sh (#1953)
• Fix crash when OSError occurs during dumping of test cases (#1926)
• Fix crash when sourcesdir is set to None in class body (#1910)
• Fix missing path to build stdout when collecting EasyBuild installed modules (#1891)
• Fix squeue backend scheduler crash (#1907)
• Fix rescheduling condition for asynchronous execution policy (#1904)
• Color bootstrap.sh only if stdout is a terminal (#1898)
• Fix bootstrap script for pip-less Python installations (#1900)
• Set stdin to null when launching processes from ReFrame, so that processes do no think they are on a tty (#1879)
• Fix the call order on the __set_name__ hook for built-in variables (#1881)
• Do not reset sourcesdir to None if it is set to a URL (#1874)
• Fix typo in variable name (#1866)

Other

• Pull base images for CI instead of building them from scratch (#1909)
• Update documentation of built-ins and update tutorial examples removing the use of __init__ (#1940)
• Make basic configuration example more intuitive w.r.t. to modules systems (#1932)
• Change favicon to the ReFrame logo (#1924)
• Add URL to Twitter badge (#1922)
• Add -pthread to the multithreaded tutorial test (#1870)
• Add tutorial about reusable tests (#1895)
• Update tutorial examples to use the parameter builtin (#1857)
• Various documentation fixes (#1859)