ReFrame 3.5.0

ReFrame v3.5.0 Release Notes

New features and enhancements

• Add processor and device information to the system partitions and make them accessible from the tests (#1773)
• Add support for building tests using EasyBuild (#1719)
• Add a new prepare_cmds partition configuration parameter which allows to emit commands before loading any environment (#1803)
• Improve the container platform API exposed to tests (#1775)
  • Respect the entrypoint and command defined inside the container image.
  • Deprecate workdir and commands fields.
  • Introduce the command field.
  • Allow to skip pulling of the container image from a container registry.
  • Expand container platform tutorial example.
• Log reference values of all performance variables in a single line (#1816)
• Allow deprecation of fields in a future version and issue deprecation warnings also in prereleases (#1804)
• Support parameter and variable access directly from the class body (#1806)
• Add built-ins to manage test variables and parameters (#1699)
• Allow logging arbitrary job attributes (#1788)
• Comply with the semantic versioning specification (#1761)
• Add new action for generating dynamic Gitlab pipelines (#1641)
• Add auto completion support to ReFrame (#1685)
• Add a new family of sanity functions that looks for patterns inside text instead of files (#1705)
• Support multiple job submissions when slurm's job submit limit is reached (#1704)
• Add --maxfail option to stop execution after a certain number of failures (#1676)
• Set executable bit in generated job script files (#1716)

Bug fixes

• Fix passing of stagedir to container platforms (#1842)
• Properly pass num_tasks_per_socket to the scheduler backends (#1837)
• Remove VERSION variable from docs Makefile (#1831)
• Fix status printout in case tests are retried (#1814)
• Deepcopy inherited variables from the parent classes (#1810)
• Make attrs() utility function pass when an AttributeError is raised (#1802)
• Print a FAILURE result if not all test cases have completed (#1801)
• More documentation fixes (#1798)
• Document osext.cray_cdt_version() more precisely (#1796)
• Fix AttributeError crash when handling OS errors while writing a test case file (#1785)
• Move shell completion scripts under share/completions/ (#1787)
• Add Python version check to bootstrap script (#1762)
• Various documentation fixes (#1771)
• Fix bug and parameterize cuda samples tests (#1758)
• Add missing required packages in 'setup.py' (#1767)
• Fix validation of the generated Gitlab pipeline files (#1764)
• Fix skipping of test cases in case of unresolved dependencies (#1751)
• Fix "New in version" annotation in documentation for certain new features (#1754)
• Fix parameter value specification in the parameter() directive (#1722)
• Fix handling of single character scheduler backend options passed through -J (#1718)