A variety of system test targets fail running loads with java.lang.Math.tanh

[smlambert]

See March 2025 release triage adoptium/aqa-tests#6051 for many instances of system test targets failing across many platforms with similar or same issues (FAIL: gnu.testlet.java.lang.Math.tanh (number 4) got 4374121138083594055 but expected 4374121138083594054 errors)

[2025-03-19T08:15:03.744Z] LT  08:15:02.373 - Test failed
[2025-03-19T08:15:03.744Z] LT    Failure num.  = 1
[2025-03-19T08:15:03.744Z] LT    Test number   = 1959
[2025-03-19T08:15:03.744Z] LT    Test details  = 'Mauve[gnu.testlet.java.lang.Math.tanh]'
[2025-03-19T08:15:03.744Z] LT    Suite number  = 0
[2025-03-19T08:15:03.744Z] LT    Thread number = 3
[2025-03-19T08:15:03.744Z] LT  >>> Captured test output >>>
[2025-03-19T08:15:03.744Z] LT  PASS: gnu.testlet.java.lang.Math.tanh (number 0)
[2025-03-19T08:15:03.744Z] LT  PASS: gnu.testlet.java.lang.Math.tanh (number 1)
[2025-03-19T08:15:03.744Z] LT  PASS: gnu.testlet.java.lang.Math.tanh (number 2)
[2025-03-19T08:15:03.744Z] LT  PASS: gnu.testlet.java.lang.Math.tanh (number 3)
[2025-03-19T08:15:03.744Z] LT  FAIL: gnu.testlet.java.lang.Math.tanh (number 4)
[2025-03-19T08:15:03.744Z] LT  got 4374121138083594055 but expected 4374121138083594054
[2025-03-19T08:15:03.744Z] LT  FAIL: gnu.testlet.java.lang.Math.tanh (number 5)
[2025-03-19T08:15:03.744Z] LT  got -4849250898771181753 but expected -4849250898771181754

List of targets failing in this way:

• MiniMix_5m_0
• MiniMix_5m_1
• MiniMix_10m_0
• MiniMix_10m_1
• MiniMix_aot_5m_0
• MauveSingleThrdLoad_HS_5m_0
• MauveSingleThrdLoad_HS_5m_1
• MauveSingleInvocLoad_HS_5m_0
• MauveSingleInvocLoad_HS_5m_1
• MauveMultiThrdLoad_5m_0
• MauveMultiThrdLoad_5m_1

Did not see this during dryrun because of a different failure (masking these ones).

[sophia-guo]

Seem all x64s are infected, no issue with aarch64s

[smlambert]

Rerun some failing targets with other distros to observe behaviour:

• win64: https://ci.adoptium.net/job/Grinder/12793 - Oracle, Grinder_20250319203807_win64_oracle.tap.txt

• win64: https://ci.adoptium.net/job/Grinder/12792 - Azul, Grinder_20250319203456_win64_azul.tap.txt

        LT  FAIL: gnu.testlet.java.lang.Math.tanh (number 4)
        LT  got 4374121138083594055 but expected 4374121138083594054
        LT  FAIL: gnu.testlet.java.lang.Math.tanh (number 5)
        LT  got -4849250898771181753 but expected -4849250898771181754

Both distros fail in same way which suggests test issue, or common issue that other distros consider non-blocking or did not identify

[smlambert]

Upstream changes that look 'suspicious' for x64 tanh, adoptium/jdk@212e329 (openjdk/jdk#20657)

• committed Sept 24, 2024 (adoptium/jdk@jdk-24+16...jdk-24+17)

Fail Build 25: Grid Sep 26 2024 (Temurin-24+17-202409261902)
Pass Build 20: Grid Sep 5 2024 (Temurin-24+14-202409051903)

This is a change in behaviour for Math.tanh, computing results differently than prior to the change, though slightly, may have unforeseen impacts
4374121138083594055
4374121138083594054

Given other distributors have shipped with this change in behaviour, we will treat this as non-blocking and report it upstream.

[sophia-guo]

Will we just mark those as non-blockers or disable them for April release?

[smlambert]

Ideally, this should be reported upstream and excluded for April under the upstream issue URL.

We can exclude under this issue's URL first, then update the exclude with the upstream URL once raised... if upstream the change in behaviour is deemed to 'not be an issue', we will have to update the test code to accept the new behaviour.

[sophia-guo]

@adamfarley Would you be able to report this to upstream? Thanks.

[adamfarley]

@adamfarley Would you be able to report this to upstream? Thanks.

Done. Please review my phrasing, and let me know if you'd like the issue changed.

https://bugs.openjdk.org/browse/JDK-8353857

[sophia-guo]

Thanks @adamfarley . Would it be able to change the OS to be general instead of windows?

[adamfarley]

Thanks @adamfarley . Would it be able to change the OS to be general instead of windows?

Changed to "Generic".