-
Notifications
You must be signed in to change notification settings - Fork 15
Description
Describe the bug
Actual test execution finishes in ~30 seconds but reportportal represents it as minutes long
Steps to Reproduce
Steps to reproduce the behavior:
- Run tests (i.e. mvn clean test "-Dkarate.options=--tags ${{ github.event.inputs.tags }}" -Dkarate.env=${{ github.event.inputs.env }} - we run from GitHub pipelines)
- Observe the test execution in the report portal
Expected behavior
Report portal shows "near real time" test execution results
Actual behavior
Report portal shows test execution results with minutes long delays. The whole suite finishes in ~30 while reportportal only starts showing first results at around that time. Then several minutes later (4-5) it shows all the results and the suite as completed, "duration" at the "all launches" page as those 4-5 minutes.
Then refreshing the "all launches" page changes the previously 4-5 minutes duration to the real ~30 seconds
Dependency versions
com.epam.reportportal:client-java:jar:5.2.23 (also tried with 5.1.2)
com.epam.reportportal:agent-java-karate:jar:5.1.2
Additional context
It's used to work fast (almost real-time reflecting the test results) but, apparently, we were running from a forked-reportportal-implementation rather than master (for example, agent-java-karate groupId was com.github.vrymar)
The issue started appearing after [vrymar] has migrated our repo to the reportportal main branch
here are some screenshots
Whole test suite pipeline finishes within ~1:30 (there are 104 test cases + extra setup/teardown steps)

While reportportal even minutes later still shows that tests are being executed and only partially completed

Opening a test confirms that: no test results are there in the reportportal yet


By the time reporportal finally finishes loading results, it shows that the execution time was 4-5 minutes

But refreshing the page reveals a reality: the tests were completed within ~30 seconds
