-
Notifications
You must be signed in to change notification settings - Fork 109
Jakarta EE 9 TCK results
CI Job: eftl-jakartaeetck-certification/17/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip
Result : All Tests Pass.
CI Job: eftl-jakartaeetck-certification-web/19/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.0.0-RC2.zip
Result : All Tests Pass.
The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs
CI Job: eftl-standalonetck-certification/120/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip
Result : All Tests Pass!
CI Job: standalonetck-certification/94/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip
CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip
DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip
BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip
Result : All Tests Pass.
CI Job : Yet to run eftl-jaxbtck-certification/9/junit-reports-with-handlebars
Result : All Tests Pass.
Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).
CI Job: eftl-jakartaeetck-run-900/59/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/60/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-web-900/45/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/46/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-25.zip
Result : All Tests Pass!
Use the below jobs to run specific test suites in staged jakartaee9 platform tck against full & web profile glassfish bundles.
- https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification/
- https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification-web/
The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs
CI Jobs: eftl-standalonetck-certification/118/junit-reports-with-handlebars & eftl-standalonetck-certification/119/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip
Result : All Tests Pass!
CI Jobs: standalonetck-certification/93/junit-reports-with-handlebars
Glassfish Bundle : https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip
CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip
DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip
BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip
Result : All Tests Pass!
CI Job : eftl-jaxbtck-certification/8/junit-reports-with-handlebars
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-900/51/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/52/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-web-900/43/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/44/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-18.zip
Result : All Tests Pass!
Use the below jobs to run specific test suites in staged jakartaee9 platform tck against full & web profile glassfish bundles.
- https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification/
- https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification-web/
The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs
CI Jobs: eftl-standalonetck-certification/111/junit-reports-with-handlebars & eftl-standalonetck-certification/112/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip
Result : All Tests Pass!
CI Jobs: standalonetck-certification/89/junit-reports-with-handlebars & standalonetck-certification/92/junit-reports-with-handlebars
Glassfish Bundle : https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip
CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip
DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip
BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip
Result : All Tests Pass!
CI Job : eftl-jaxbtck-certification/89/junit-reports-with-handlebars
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-900/48/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/49/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-11.zip
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-web-900/40/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/41/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-11.zip
The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs
CI Jobs: eftl-standalonetck-certification/98/junit-reports-with-handlebars & eftl-standalonetck-certification/99/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-11.zip
Result : All Tests Pass!
CI Job: eftl-jakartaeetck-run-900/46/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/47/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jaxrs | 19 | Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found |
| jsonb | 726 | Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.) |
CI Job: eftl-jakartaeetck-run-web-900/38/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/39/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-04.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jsonb | 484 | Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (New version of Yasson coming up) |
The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs
CI Jobs: eftl-standalonetck-certification/96/junit-reports-with-handlebars & eftl-standalonetck-certification/97/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip
Result : All tests pass.
CI Job: eftl-jakartaeetck-run-900/41/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/42/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-27.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build |
| jaxrs | 19 | Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found |
| jsonb | 726 | Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.) |
CI Job: eftl-jakartaeetck-run-web-900/32/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/33/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-27.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build |
| jsonb | 484 | Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.) |
CI Job: eftl-jakartaeetck-run-900/37/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/38/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-20.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish |
| jpa | 678 | https://github.com/eclipse-ee4j/eclipselink/issues/886 |
| webservices12 | 7 | Awaiting gf integration of jaxws jars |
| webservices13 | 27 | Awaiting gf integration of jaxws jars |
| jaxrs | 19 | Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found |
| jsonb | 726 | Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.) |
CI Job: eftl-jakartaeetck-run-900/31/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/32/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-SNAPSHOT-nightly.zip (the nightly bundle available on 13th September was used as the weekly glassfish bundle is not available)
| test group | failure count | issue link(s) |
|---|---|---|
| ejb | 3 | DTD update issue - https://github.com/eclipse-ee4j/jakartaee-tck/pull/502 to remove the compat tests |
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish |
| jpa | 678 | https://github.com/eclipse-ee4j/eclipselink/issues/886 |
CI Job: eftl-jakartaeetck-run-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/28/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-06.zip
| test group | failure count | issue link(s) |
|---|---|---|
| ejb | 3 | DTD update issue, related PR https://github.com/eclipse-ee4j/jakartaee-tck/pull/474 (need to remove/exclude or update the BMP/CMP tests that are failing) |
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish |
| signaturetest/javaee | 3 | Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108 |
Please note there are jpa & jaxws schema changes being made in the implementation and these tcks will have to be rerun to get the test passing.
JPA suite has failures after schema changes in the tck repo. CI Job: eftl-jakartaeetck-run-900/30/junit-reports-with-handlebars
| test group | failure count | issue link(s) |
|---|---|---|
| jpa | https://github.com/eclipse-ee4j/eclipselink/issues/886 |
CI Job: eftl-jakartaeetck-run-web-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/28/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-06.zip
| test group | failure count | issue link(s) |
|---|---|---|
| jsf | 7 | https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish |
| signaturetest/javaee | 3 | Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108 |
| CDI porting kit | 47 | https://github.com/eclipse-ee4j/glassfish/issues/23184 |
CI Job: eftl-jakartaeetck-run-900/25/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-30.zip
| test group | failure count | issue link(s) |
|---|---|---|
| ejb32 | 1 | |
| webservices12 | 62 | |
| webservices13 | 1 |
CI Job: eftl-jakartaeetck-run-web-900/25/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/26/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-30.zip
All tests in platform TCK now passes in web profile mode.
| test group | failure count | issue link(s) |
|---|---|---|
| CDI porting kit | 47 | https://github.com/eclipse-ee4j/glassfish/issues/23184 |
All tests in standalone TCKs passes.
CI Job: eftl-jakartaeetck-run-900/23/junit-reports-with-handlebars
Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-23.zip
| test group | failure count | issue link(s) |
|---|---|---|
| ejb32 | 1 | |
| securityapi | 5 | https://github.com/eclipse-ee4j/soteria/issues/280 |
| webservices12 | 62 | |
| webservices13 | 1 |
CI Job: eftl-jakartaeetck-run-web-900/22/junit-reports-with-handlebars
Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-23.zip
| test group | failure count | issue link(s) |
|---|---|---|
| ejb30_lite_packaging | 31 | |
| ejb30_lite_tx | 163 | |
| ejb32 | 8 | |
| jaspic | 50 | |
| jdbc | 2386 | |
| jpa | 1878 | |
| jstl | 85 | |
| samples | 1 | |
| CDI porting kit | 47 | https://github.com/eclipse-ee4j/glassfish/issues/23184 |
CI Job: jakartaee-tck/job/eftl-standalonetck-certification
| standalone TCK | failure count | issue link(s) |
|---|---|---|
| security api | 5 | https://github.com/eclipse-ee4j/soteria/issues/280 |