[CI] SSLErrorMessageFileTests testMessageForPemCertificateOutsideConfigDir failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #9310 / openjdk17_checkpart4_java-fips-matrix
• elasticsearch-periodic #9310 / openjdk23_checkpart4_java-matrix
• elasticsearch-periodic #9310 / openjdk21_checkpart4_java-matrix
• elasticsearch-periodic #9310 / openjdk22_checkpart4_java-matrix
• elasticsearch-periodic #9310 / graalvm-ce17_checkpart4_java-matrix
• elasticsearch-periodic #9310 / openjdk17_checkpart4_java-matrix
• elasticsearch-periodic #9303 / openjdk17_checkpart4_java-fips-matrix
• elasticsearch-periodic #9303 / openjdk17_checkpart4_java-matrix
• elasticsearch-periodic #9303 / openjdk23_checkpart4_java-matrix
• elasticsearch-periodic #9303 / graalvm-ce17_checkpart4_java-matrix

Reproduction Line:

./gradlew ":x-pack:plugin:security:test" --tests "org.elasticsearch.xpack.ssl.SSLErrorMessageFileTests.testMessageForCertificateAuthoritiesOutsideConfigDir" -Dtests.seed=C3EC41F4D310426A -Dtests.locale=ml -Dtests.timezone=America/Guayaquil -Druntime.java=17 -Dtests.fips.enabled=true

Applicable branches:
8.18

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Expected: a throwable with message of "failed to load SSL configuration [xpack.security.http.ssl] - cannot read configured PEM certificate_authorities [/this/path/is/outside/the/config/directory/file.error] because access to read the file is blocked; SSL resources should be placed in the [/dev/shm/bk/bk-agent-prod-gcp-1752323297692495135/elastic/elasticsearch-periodic/x-pack/plugin/security/build/testrun/test/temp/org.elasticsearch.xpack.ssl.SSLErrorMessageFileTests_C3EC41F4D310426A-001/tempDir-025/config] directory"
     but: was <org.elasticsearch.ElasticsearchSecurityException: failed to load SSL configuration [xpack.security.http.ssl] - cannot read configured PEM certificate_authorities [/this/path/is/outside/the/config/directory/file.error] because the file does not exist> at org.elasticsearch.xpack.core.ssl.SSLService.lambda$loadSslConfigurations$11(SSLService.java:622)

Issue Reasons:

• [8.18] 126 consecutive failures in test testMessageForPemCertificateOutsideConfigDir
• [8.18] 21 consecutive failures in step openjdk17_checkpart4_java-fips-matrix
• [8.18] 21 consecutive failures in step openjdk23_checkpart4_java-matrix
• [8.18] 21 consecutive failures in step openjdk21_checkpart4_java-matrix
• [8.18] 21 consecutive failures in step openjdk22_checkpart4_java-matrix
• [8.18] 21 consecutive failures in step graalvm-ce17_checkpart4_java-matrix
• [8.18] 21 consecutive failures in step openjdk17_checkpart4_java-matrix
• [8.18] 21 consecutive failures in pipeline elasticsearch-periodic
• [8.18] 126 failures in test testMessageForPemCertificateOutsideConfigDir (100.0% fail rate in 126 executions)
• [8.18] 21 failures in step openjdk17_checkpart4_java-fips-matrix (100.0% fail rate in 21 executions)
• [8.18] 21 failures in step openjdk23_checkpart4_java-matrix (100.0% fail rate in 21 executions)
• [8.18] 21 failures in step openjdk21_checkpart4_java-matrix (100.0% fail rate in 21 executions)
• [8.18] 21 failures in step openjdk22_checkpart4_java-matrix (100.0% fail rate in 21 executions)
• [8.18] 21 failures in step graalvm-ce17_checkpart4_java-matrix (100.0% fail rate in 21 executions)
• [8.18] 21 failures in step openjdk17_checkpart4_java-matrix (100.0% fail rate in 21 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-security (Team:Security)

[jfreden]

I think all of the SSLErrorMessageFileTests failures started when a PR to Remove security manager from tests was merged. This happens because entitlement checks are not in unit tests yet and the check to skip these tests only checks jdk version https://github.com/elastic/elasticsearch/blob/main/libs/core/src/main/java/org/elasticsearch/jdk/RuntimeVersionFeature.java#L16

[elasticsearchmachine]

Pinging @elastic/es-core-infra (Team:Core/Infra)

[prdoyle]

In progress as part of ES-11597.