Test results are duplicated with AllureTestNg listener Java

[ivanpatiuk]

Hi. I was facing an issue with duplicated results for long time, and finally found an explanation. Overral, the problem was, that when you use 'AllureTestNg' listener in yout test classes and doesn't override or change the logic of this class, it producess duplicated test results. The code to reproduce an issue is quite short.

I have read 1 different conversation related to duplicated results, but there was used cucumber, in my case it is not used, as well, there was not mentioned usage of 'onTestStart'

Pom config for the dependencies:

io.qameta.allure
allure-testng
2.22.2 (the same issue in the latest version of this dependency)
test

org.testng
testng
7.7.1
test

Test class:

import org.testng.annotations.Listeners;
import org.testng.annotations.Test;

@Listeners(MyListener.class)
public class MyTest {

    @Test
    void myTest(){

    }
}

Listener:

import io.qameta.allure.testng.AllureTestNg;

public class MyListener extends AllureTestNg{

}

if you execute the 'myTest' test method, it will produce 2 test result files:

However, it is an issue. Because, if your report for the test case has some parameters or attachments, one of this test result files will not have it. Thus, depends which one test result is processed the last, there will be different details in the report.

The method 'onTestStart' comes from ITestListener class. To fix the issue with duplicated test results, you need to override the method from the AllureTestNg class to make it again have empty body:

import io.qameta.allure.testng.AllureTestNg;

public class MyListener extends AllureTestNg {

    @Override
    public void onTestStart(ITestResult testResult) {
    }
}

[ivanpatiuk]

Also, if you add AllureTestNg listener directly to your test - the issue is not present:

import io.qameta.allure.testng.AllureTestNg;
import org.testng.annotations.Listeners;
import org.testng.annotations.Test;

@Listeners(AllureTestNg.class)
public class MyTest {

    @Test
    void myTest(){

    }
}

[baev]

if you want to extend AllureTestNg listener, you need to use the dependency with spi-off classifier. Otherwise, the listener will be registered twice, once via Java-SPI, the second one is via Listeners annotation.

[ivanpatiuk]

Thanks, it actually helped! I am amazed that you have answered on this question 5 years ago and you still leave answers. You are true hero

[baev]

see https://github.com/orgs/allure-framework/discussions/3051