ReFrame 4.4.1

Release Notes

Enhancements

• Add note about -P option not supporting tests with raw deps (#3040)
• Document check_result log attribute (#3039)
• Fix typo in file log handler docs (#3034)
• Update README in regards to public test repos (#3017)
• Improve navigation in API documentation (#3016)

Bug fixes

• Evaluate Slurm job nodelist lazily (#3022)
• Treat node name suffixes properly in abbreviated node lists (#3027)
• Upgrade pip before pip-installing reframe for CPU autodetection (#3025)

ReFrame 4.4.0

Release Notes

New features

• Filter tests using arbitrary expressions (#3010)
• Add an SSH-based scheduler backend (#2975)
• Allow pinning a hook as the last of its stage (#2992)
• Support for custom schedulers (#2955)
• Allow setting nested mapping types using the -S option (#2876)

Bug fixes

• Ensure LSF bjobs gets the right format (#2968)

Test library

• New test for testing SSH host keys (#2957, #2996)

ReFrame 4.3.4

Release Notes

Enhancements

• Update filelog log handler docs (#2998)

Bug fixes

• Properly retrieve exit status for PBS Pro jobs (#2993)
• Respect execution order of overriden hooks (#2997)
• Show test references with --describe option (#2999)
• Always remove temporary directory when remote auto-detection fails (#3000)

Other

• Add hpctestlib to the PyPI package (#3003)

ReFrame 4.3.3

Release Notes

Enhancements

• Document default value of format_perfvars (#2977)

Bug fixes

• Fix remote topology detection for pip installations (#2978)
• Accept y and n for boolean conversions (#2976)

Other

• Pin version of flux scheduler in CI (#2994)

ReFrame 4.3.2

Release Notes

Bug fixes

• Run ./bootstrap.sh in a virtual environment to avoid errors on Debian-based systems (#2953)

ReFrame 4.3.1

Release Notes

Enhancements

• Warn on unset variables in fixtures when using the -S option (#2948)

Bug fixes

• Fix doc generation with Python 3.6 (#2949)
• Properly apply logging configuration to all systems listed in target_systems (#2947)
• Update OAR scheduler backend to accept the Job_Id: syntax (#2946)

ReFrame 4.3.0

Release Notes

New features

• Update default --timestamp format (#2931)
• Parameterise test from command line (#2913)
• Additional Spack build system options (#2919)
• Combine perflogs for parameterised tests (#2882)
• Support for pdsh and clush parallel launchers (#2894)
• Support prepare_cmds at the environment level (#2887)
• Support custom system auto-detection methods (#2832)

Enhancements

• Raise job timeout error in local scheduler when time_limit is reached (#2934)
• Update BNF grammar for the test naming scheme (#2933)
• Fixed a typo in documentation - JobLaucher to JobLauncher (#2892)

ReFrame 4.2.2

Release Notes

Enhancements

• Add note about test generation options and --ci-generate (#2929)
• Fail on errors in bootstrap.sh and add a new --ignore-errors option (#2925)
• Fix broken docs links in valid_systems and valid_prog_environs sections (#2920)
• Fixed a typo in documentation - JobLaucher to JobLauncher (#2922)
• Fix broken formatting in extractall_s() docs (#2921)
• Update Slack link in README_minimal.md (#2891)

Bug fixes

• Properly dump json_formatter with --show-config option (#2930)
• Use tests's short name as the name of the job (#2928)
• Properly cleanup resources of dependencies when their dependents are filtered (#2927)

ReFrame 4.2.1

Release Notes

Enhancements

• Improve docs on how access options are treated for PBS-based backends (#2889)
• List the httpjson and filelog handlers as perflog handlers only (#2878)
• Add EUM'23 slides (#2881, #2888)
• New tutorial example on how to use make_test() (#2866)

Bug fixes

• Fix definition of default values for sched_options parameters (#2885)
• Fix in-class updates of inherited mutable variables (#2880)

Other

• Update requests package version and add a Python 3.6 disclaimer (#2883)

ReFrame 4.2.0

Release Notes

New features

• Allow custom HTTP headers with the httpjson log handler (#2854)
• Add support for repeated testing through two new options: --reruns and --duration (#2839)
• Add new ci_extras test variable that allows passing test-specific options to the pipeline generated by --ci-generate (#2833)
• Add a symlink to the latest run report (#2834)
• Simplify custom user imports in tests (#2801)
• Support arbitrary Spack environment configuration (#2819)

Enhancements

• Use official Slack permanent invite link (#2862)
• Set the module of test created by make_test (#2818)

Bug fixes

• Do not symlink against report files in non-default locations (#2855)

Other

• Replace codecov with coverage in CI (#2863)