Skip to content

ReFrame 4.0.0

Choose a tag to compare

@vkarak vkarak released this 21 Dec 20:26
· 1706 commits to master since this release

Release Notes

Changes since version 3.12.0.

New features and enhancements

  • Remove the --strict option (#2711)
  • Remove the --force-local option (#2710)
  • Control verbosity level of the immediate performance info (#2695)
  • Remove the schedulers section from the configuration (#2694)
  • Remove deprecated --ignore-check-conflicts CLI option and the associated configuration option (#2706)
  • Update temp_environment to use env_vars as an argument (#2707)
  • Improve performance logging (#2633)
  • Print better error message when pygelf cannot be imported (#2691)
  • Build configuration incrementally by allowing to combine multiple configuration files (#2557)
  • Relax the value syntax of env_vars (#2649)
  • Deprecate variables in favour of the new env_vars (#2648)
  • Introduce variable aliases (#2647)
  • Change default value of num_gpus_per_node to None (#2638)
  • Extend functionality to get the Cray's CDT version to support systems based on the CPE module (#2644)
  • Allow tests to require references (#2627)
  • Remove the deprecated RFM_GRAYLOG_SERVER environment variable (#2624)
  • Improve framework messages and the performance report (#2618)
  • Add perflog_ignore attribute in httpjson handler (#2620)
  • Allow user defined launchers in the configuration (#2605)
  • Add support for the Apptainer container platform (#2613)
  • Add support for the Flux scheduler (#2598)
  • Stop execution with an error when a cli module fails to load (#2603)
  • Revert to generating unique run reports (#2601)
  • Change default hostname autodetection parameters (#2583)
  • Associate a unique hash with each test (#2578)
  • Add command line option to set the execution order of independent tests (#2575)
  • Drop the old test naming scheme (#2574)
  • Introduce ReFrame 4.0 (#2562)
  • Use the test's extra_resources also for the build job (#2547)
  • Remove deprecated features for 4.x (#2096)
  • Remove deprecated features from 4.x (#1986)
  • Drop the @parameterized_test decorator (#1951)

Bug fixes

  • Fix cleanup crash for non-performance tests when the perflog_compat option is on (#2716)
  • Fix hash clashes for parameterised tests (#2714)
  • Restrict reference tuples acceptable types (#2702)
  • Properly set display name of tests with join fixtures (#2705)
  • Do not require handlers$ in the logging config (#2692)
  • Fix nodelist compaction for single digitless nodes (#2689)
  • Fix filtering of tests with hashcode (#2688)
  • Fix variable assignment when aliases are set in subclasses (#2683)
  • Fix injection of env variables for non default craype (#2682)
  • Pass explicitly the --cpus-per-task option to srun for Slurm >= 22.05 (#2656)
  • Expand the Slurm nodelist using scontrol and not the builtin nodelist_expand() function (#2678)
  • Keep updating the node list during the job (#2634)
  • Filter out unnecessary fixtures when listing or running tests (#2641)
  • Submit jobs using the correct module path when testing scheduler backends (#2611)
  • Document missing log record attributes (#2586)
  • Log correctly %(check_perfvalues)s attribute (#2588)
  • Fix singularity cli option to change to the mounted stage directory with the Singularity container platform (#2581)

Test library

  • Use the builtin validation option of OSU benchmarks to validate the results (#2679)

Other

  • Use an Ubuntu 20.04 image for Python 3.6 tests (#2712)
  • Add support for Python 3.11 and update CI workflow for Python 3.6 (#2703)
  • Revert workaround in script for generating release notes (#2680)
  • Fix script that auto-generates the release notes (#2594)
  • Add a "What's New" page for ReFrame 4.0 (#2709)
  • Document the rest of Job's properties (#2713)
  • Update link in codecov badge (#2708)
  • Fix example in sn.print() docs (#2685)
  • Update copyright notice in docs (#2684)
  • Remove mailing list from README (#2643)
  • Adapt README for dark and light Github modes (#2608)
  • Fix typo on the docs (#2599)
  • Fix broken links in the docs (#2593)
  • Fix documentation of modules test attribute (#2592)
  • Add a warning in documentation about the usage of perf_patterns (#2587)
  • Add CSCS webinar resources + links (#2582)
  • Fix example of httpjson handler usage (#2563)
  • Add note about test dependencies in --repeat option docs (#2564)