-
Notifications
You must be signed in to change notification settings - Fork 161
Jakarta EE 11 TCK Tests
David Matějček edited this page Aug 21, 2025
·
53 revisions
WARNING: This file is actually updated until I remove this message.
Watch these links:
- TCK 11 Project: https://github.com/orgs/jakartaee/projects/12/views/2
- GlassFish TCK Runners repo issue: https://github.com/jakartaee/platform-tck/issues/1434
- ...?
All TCK tests can be executed directly from the GlassFish git repository (IN PROGRESS, MANY WILL FAIL). Prerequisities are:
- JDK21
- Maven 3.9.6+
- Ant 1.10.14+
- Docker host(s)
Or you can use precreated docker node for these builds: dmatej/glassfish-jenkins-node for builds on your Jenkins.
In 2024 the TCK team made a huge progress with the refactoring and moving TCK tests to standalone repositories. That means that we have to follow in this repository too. However the "tckrefactor" branch is not compilable as of 16th April 2024 and currently we don't know if tests in it will be yet useful with the release of TCK for Jakarta EE 11 or if everything will be moved to "standalone".
- 94 tests, under 1 minute.
mvn clean install -Ptck -pl :tck-activation-download,:tck-activation
- TODO: Still JEE10 Platform based, fails to start the server.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=ApplicationClientITest
- Requires https://github.com/jakartaee/authentication/pull/242
- 162 tests, 4 minutes.
mvn clean install -Ptck -pl :tck,:tck-authentication-download,:tck-authentication
- 33 tests, 3 minutes
mvn clean install -Ptck -pl :tck,:tck-authorization-download,:tck-authorization
- 1335 tests, 10 minutes.
mvn clean install -amd -Ptck -pl :tck-cdi
- 295 tests, 12 minutes.
mvn clean install -Ptck -pl :tck-concurrency
- 457 tests, 9 minutes:
mvn clean install -Ptck -pl :tck,:tck-connectors
- This is a huge package, so we usually execute it per partes.
- Tests which wait for timeout for a lot of time, are separated to standalone profiles.
# 90 minutes, 920 tests, 5 errors, 18 skipped, FIXME
# Overlaps with other tests
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,appclient
# 3 hours, 1029 tests
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30bb
# 13 minutes, 36 tests
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30bbEjbLiteConcurrencyTimeout
# 6 tests, 54 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30bbEjbLiteJspTimeoutAnnotated
# 6 tests, 54 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30bbEjbLiteJspTimeoutDescriptor
# 292 tests, 1 minute
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteAppException
# 23 tests, 1 minute
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteDataSource
# 24 tests, 1 minute
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteEnv
# 1154 tests, 7 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteRest
# 184 tests, 13 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteSingleton
# 61 tests, 21 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteStatefulConcurrency
# 11 tests, 91 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteStatefulTimeoutAnnotated
# 11 tests, 92 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30LiteStatefulTimeoutDescriptor
# 228 tests, 9 errors, 26 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30Misc
# 198 tests, 91 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30Timer
# 1 test, 3 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb30Zombie
# 40 tests, 21 tests
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerBasic
# 60 tests, 8 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerInterceptor
# 64 tests, 7 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerMisc
# 36 tests, 17 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerScheduleAuto
# 216 tests, 29 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerScheduleAutoDescriptorExpressionLifecycle
# 160 tests, 41 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerScheduleExpire
# 52 tests, 34 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerScheduleTx
# 52 tests, 34 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32LiteTimerScheduleTxNonPersistent
# 24 tests, 2 minutes
mvn clean install -Ptck -pl :tck-enterprise-beans -Pfull,ejb32Misc
- 361 tests, 10 seconds
mvn clean install -Ptck -pl :tck,:tck-expression-language-download,:tck-expression-language
- ? tests, need 3 hours to pass.
- flaky, waits for the next release including https://github.com/jakartaee/faces/pull/2050 and other PRs made to master.
mvn clean install -Ptck -pl :tck-faces-download,:tck-faces
Or if you need to run just a part of it:
mvn clean install -Ptck -pl :tck-faces -Pcustom -Dtck.modules=org.eclipse.ee4j.tck.faces.faces22:pom
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#appClient # 1231 tests, 150 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#ejb # 1231 tests, 150 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#jsp # 1231 tests, 120 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#servlet # 1231 tests, 120 minutes.
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JSONITest#jsonb # 18 tests, 9 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JSONITest#jsonp # 76 tests, 12 minutes.
mvn clean install -Ptck -pl :glassfish-external-tck-jsonp # 179 tests, 40 seconds.
The third line crashes with:
ClassSelector [className = 'ee.jakarta.tck.jsonp.api.jsonobjecttests.ClientTests', classLoader = null] resolution failed: jakarta/json/JsonValue: jakarta.json.JsonValue
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=MailITest
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=MessagingITest
- TODO: Fails due to OSGI error.
mvn clean install -amd -fae -Ptck -pl :glassfish-external-tck-microprofile
- 682 tests, 6 minutes
mvn clean install -Ptck -pl :javatest,:jakarta-pages-tck,:glassfish-external-tck-pages
- 542 tests, 19 minutes.
- TODO: Still JEE10 based, uses antrun, 501 passed, 31 failed.
mvn clean install -Ptck -pl :jakarta-pages-tags-tck,:glassfish-external-tck-pages-tags
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#appManaged # 1749 tests, 5-6 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#appManagedNoTx # 1887 tests, 5-6 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#pmServlet # 1895 tests, 96 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#puServlet # 1885 tests, 2 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#stateful3 # 1749 tests, 2-3 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#stateless3 # 1897 tests, 160 minutes.
- 2796 tests, 7 minutes.
mvn clean install -Ptck -pl :jakarta-rest-tck,:glassfish-external-tck-rest
- Standalone variant, 1716 tests, 16 minutes.
- Already updated to JEE11
mvn clean install -Ptck -pl :jakarta-servlet-tck,:glassfish-external-tck-servlet
- TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=WebservicesITest#webservices12 # 242 tests, 96 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=WebservicesITest#webservices13 # 53 tests, 27 minutes.
- TODO: Still based on JEE10 Platform
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=TransactionsITest#jta # 141 tests, 17 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=TransactionsITest#xa # 66 tests, 10 minutes.
- 1049 tests, 6 minutes.
mvn clean install -Ptck -pl :glassfish-external-tck-validation
- 737 tests, 4 minutes.
mvn clean install -Ptck -pl :jakarta-websocket-tck,:glassfish-external-tck-websocket