Skip to content

Conversation

@vsalomaki
Copy link
Contributor

@vsalomaki vsalomaki commented Sep 9, 2025

The rerun-PR #526 had a bug; the log files for rebot were merged in the wrong order. Effect is that the original test-results overwrote the results from the retest and the merging of reportes created a report with the original fail-results even if retest passed. As a consequence, if there was another rerun-round due to errors, the starting point was the original output.

This PR includes following:

  • Correct reporting output, the output.xml, log.html and report.html contain combined information
  • Add better testing so that the previous round of retest is taken into account
  • Prints out retests "rounds" starting from 1 instead of 0, also suppresses (duplicate) stdout from rebot
  • Update Firefox to 142. The version 141 was no longer available in the docker build
  • Add reference to Rerunning tests into the Readme TOC

Screenshots from reports after, using the "Roll Dice"-tests:
Screenshot from 2025-09-09 21-59-53
Screenshot from 2025-09-09 21-58-16

@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from 719d924 to aaa1d5b Compare September 9, 2025 21:10
@vsalomaki vsalomaki changed the title Rerunning tests: Fix log file handling Bug: Fix log file handling in test-reruns Sep 9, 2025
@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from aaa1d5b to 9560927 Compare September 9, 2025 21:21
* Echo rerun-rounds starting from 1, hide rebot stdout
* Zip log-files from previous test-rounds
@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from 9560927 to 1d36b74 Compare September 9, 2025 21:32
@vsalomaki
Copy link
Contributor Author

Proposing to change the recently added environment variable to a more descriptive, such as ROBOT_RERUN_MAX_ROUNDS

@vsalomaki
Copy link
Contributor Author

Comments? ( @ppodgorsek )

@ppodgorsek
Copy link
Owner

Thanks @vsalomaki and sorry for the delay, I was travelling for a few weeks.

I like the renamed variable, it is much clearer.

@ppodgorsek ppodgorsek merged commit 7dc3dd6 into ppodgorsek:master Nov 7, 2025
3 checks passed
@ppodgorsek ppodgorsek added the bug label Nov 7, 2025
@ppodgorsek ppodgorsek modified the milestones: 7.3.0, 7.3.1 Nov 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants