Skip to content

It takes minutes for the report portal to display test results even though a corresponding test suite completes in 30 seconds #40

@AlexThreeSixty

Description

@AlexThreeSixty

Describe the bug
Actual test execution finishes in ~30 seconds but reportportal represents it as minutes long

Steps to Reproduce
Steps to reproduce the behavior:

  1. Run tests (i.e. mvn clean test "-Dkarate.options=--tags ${{ github.event.inputs.tags }}" -Dkarate.env=${{ github.event.inputs.env }} - we run from GitHub pipelines)
  2. Observe the test execution in the report portal

Expected behavior
Report portal shows "near real time" test execution results

Actual behavior
Report portal shows test execution results with minutes long delays. The whole suite finishes in ~30 while reportportal only starts showing first results at around that time. Then several minutes later (4-5) it shows all the results and the suite as completed, "duration" at the "all launches" page as those 4-5 minutes.
Then refreshing the "all launches" page changes the previously 4-5 minutes duration to the real ~30 seconds

Dependency versions
com.epam.reportportal:client-java:jar:5.2.23 (also tried with 5.1.2)
com.epam.reportportal:agent-java-karate:jar:5.1.2

Additional context
It's used to work fast (almost real-time reflecting the test results) but, apparently, we were running from a forked-reportportal-implementation rather than master (for example, agent-java-karate groupId was com.github.vrymar)
The issue started appearing after [vrymar] has migrated our repo to the reportportal main branch

here are some screenshots
Whole test suite pipeline finishes within ~1:30 (there are 104 test cases + extra setup/teardown steps)
ActualTestSuiteFinishesInSeconds

While reportportal even minutes later still shows that tests are being executed and only partially completed
ReportPortalShowsTestSuiteAsBeingExecutedInMinutes

Opening a test confirms that: no test results are there in the reportportal yet
ReportPortalShowsTestAsBeingExecuted
ReportPortalStillNoResults

By the time reporportal finally finishes loading results, it shows that the execution time was 4-5 minutes
ReportPortalShowsFirstActualTimeThatItTookToLoadTheResults

But refreshing the page reveals a reality: the tests were completed within ~30 seconds
AfterARefreshReportPortalMagicallyShowsARealExecutionTime

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions