Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Example changes to get the persistence tests running for all vehicles… #2049

Merged
merged 8 commits into from
Mar 19, 2025

Conversation

starksm64
Copy link
Contributor

… in the ee.jakarta.tck.persistence.core.annotations.basic package.

With these changes the web profile tck-javatest tests pass:

starksm@Scotts-Mac-Studio persistence-platform-tck-run % mvn -Pweb -DskipSBOM test-compile failsafe:integration-test@jta-tests-javatest | tee run.log
...
[INFO] Results:
[INFO] 
[INFO] Tests run: 22, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  19.849 s
[INFO] Finished at: 2025-03-06T23:24:41-06:00
[INFO] ------------------------------------------------------------------------

and the full platform tck-appclient tests pass:

starksm@Scotts-Mac-Studio persistence-platform-tck-run % mvn -Pfull,appclient -DskipSBOM test-compile failsafe:integration-test@jpa-tests-appclient | tee run.log
...
[INFO] Results:
[INFO] 
[INFO] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:32 min
[INFO] Finished at: 2025-03-06T23:35:34-06:00
[INFO] ------------------------------------------------------------------------

Related Issue(s)
Related #1998

… in the ee.jakarta.tck.persistence.core.annotations.basic package.

Related #1998

Signed-off-by: Scott M Stark <starksm@starkinternational.com>
@starksm64 starksm64 marked this pull request as draft March 7, 2025 05:37
@scottmarlow
Copy link
Contributor

I built the issue1998 branch locally but get test failures:

mvn -Pfull,appclient -DskipSBOM test-compile failsafe:integration-test@jpa-tests-appclient | tee /tmp/run.log
...
Tests run: 17, Failures: 0, Errors: 17, Skipped: 0

@starksm64
Copy link
Contributor Author

starksm64 commented Mar 7, 2025 via email

@scottmarlow
Copy link
Contributor

I did use Java SE 17 also. From console output I see:

[ERROR] ee.jakarta.tck.persistence.core.annotations.basic.Client2Stateless3Test.LongOperandResultTypeTests -- Time elapsed: 2.731 s <<< ERROR!
java.lang.Exception: Vehicle runner failed.
at tck.arquillian.protocol.appclient.AppClientMethodExecutor.invoke(AppClientMethodExecutor.java:113)
at org.jboss.arquillian.container.test.impl.execution.RemoteTestExecuter.execute(RemoteTestExecuter.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.invokeObservers(EventContextImpl.java:103)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:90)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:134)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:106)
at org.jboss.arquillian.core.impl.EventImpl.fire(EventImpl.java:62)
at org.jboss.arquillian.container.test.impl.execution.ClientTestExecuter.execute(ClientTestExecuter.java:52)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.invokeObservers(EventContextImpl.java:103)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:90)
at org.jboss.arquillian.container.test.impl.client.ContainerEventController.createContext(ContainerEventController.java:128)
at org.jboss.arquillian.container.test.impl.client.ContainerEventController.createTestContext(ContainerEventController.java:118)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createTestContext(TestContextHandler.java:116)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createClassContext(TestContextHandler.java:83)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createSuiteContext(TestContextHandler.java:69)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:134)
at org.jboss.arquillian.test.impl.EventTestRunnerAdaptor.test(EventTestRunnerAdaptor.java:139)
at org.jboss.arquillian.junit5.ArquillianExtension.interceptInvocation(ArquillianExtension.java:167)
at org.jboss.arquillian.junit5.ArquillianExtension.interceptTestMethod(ArquillianExtension.java:107)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)

[ERROR] ee.jakarta.tck.persistence.core.annotations.basic.Client2Stateless3Test.ShortOperandResultTypeTests -- Time elapsed: 3.059 s <<< ERROR!
java.lang.Exception: Vehicle runner failed.
at tck.arquillian.protocol.appclient.AppClientMethodExecutor.invoke(AppClientMethodExecutor.java:113)
at org.jboss.arquillian.container.test.impl.execution.RemoteTestExecuter.execute(RemoteTestExecuter.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.invokeObservers(EventContextImpl.java:103)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:90)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:134)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:106)
at org.jboss.arquillian.core.impl.EventImpl.fire(EventImpl.java:62)
at org.jboss.arquillian.container.test.impl.execution.ClientTestExecuter.execute(ClientTestExecuter.java:52)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.invokeObservers(EventContextImpl.java:103)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:90)
at org.jboss.arquillian.container.test.impl.client.ContainerEventController.createContext(ContainerEventController.java:128)
at org.jboss.arquillian.container.test.impl.client.ContainerEventController.createTestContext(ContainerEventController.java:118)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createTestContext(TestContextHandler.java:116)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createClassContext(TestContextHandler.java:83)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.test.impl.TestContextHandler.createSuiteContext(TestContextHandler.java:69)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.jboss.arquillian.core.impl.ObserverImpl.invoke(ObserverImpl.java:86)
at org.jboss.arquillian.core.impl.EventContextImpl.proceed(EventContextImpl.java:95)
at org.jboss.arquillian.core.impl.ManagerImpl.fire(ManagerImpl.java:134)
at org.jboss.arquillian.test.impl.EventTestRunnerAdaptor.test(EventTestRunnerAdaptor.java:139)
at org.jboss.arquillian.junit5.ArquillianExtension.interceptInvocation(ArquillianExtension.java:167)
at org.jboss.arquillian.junit5.ArquillianExtension.interceptTestMethod(ArquillianExtension.java:107)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)

Stopping container using command: [/usr/lib/jvm/java-17-openjdk/bin/java, -jar, /home/smarlow/tck/platformtck/glassfish-runner/persistence-platform-tck/persistence-platform-tck-run/target/glassfish8/glassfish/modules/admin-cli.jar, stop-domain, -t]
Waiting finished after 133 ms.
Stopping database using command: [/usr/lib/jvm/java-17-openjdk/bin/java, -jar, /home/smarlow/tck/platformtck/glassfish-runner/persistence-platform-tck/persistence-platform-tck-run/target/glassfish8/glassfish/modules/admin-cli.jar, stop-database, -t]
Fri Mar 07 12:59:51 EST 2025 : Connection obtained for host: 0.0.0.0, port number 1527.
Fri Mar 07 12:59:52 EST 2025 : Apache Derby Network Server - 10.15.2.0 - (1873585) shutdown
[INFO]
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] Client1AppmanagedTest » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client1AppmanagednotxTest » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client1Stateful3Test » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client1Stateless3Test.persistBasicTest1 » Vehicle runner failed.
[ERROR] Client1Stateless3Test.persistBasicTest2 » Vehicle runner failed.
[ERROR] Client1Stateless3Test.persistBasicTest3 » Vehicle runner failed.
[ERROR] Client1Stateless3Test.persistBasicTest4 » Vehicle runner failed.
[ERROR] Client1Stateless3Test.persistBasicTest5 » Vehicle runner failed.
[ERROR] Client2AppmanagedTest » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client2AppmanagednotxTest » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client2Stateful3Test » Deployment Could not deploy jpa_core_annotations_basic_vehicles.ear
[ERROR] Client2Stateless3Test.BigDecimalOperandResultTypeTests » Vehicle runner failed.
[ERROR] Client2Stateless3Test.BigIntegerOperandResultTypeTests » Vehicle runner failed.
[ERROR] Client2Stateless3Test.DoubleOperandResultTypeTests » Vehicle runner failed.
[ERROR] Client2Stateless3Test.FloatOperandResultTypeTests » Vehicle runner failed.
[ERROR] Client2Stateless3Test.LongOperandResultTypeTests » Vehicle runner failed.
[ERROR] Client2Stateless3Test.ShortOperandResultTypeTests » Vehicle runner failed.
[INFO]

From GF server.log, first error is:

[2025-03-07T12:40:26.727589-05:00] [GF 8.0.0-JDK17-M9] [SEVERE] [NCLS-CORE-00026] [jakarta.enterprise.system.core] [tid: _ThreadID=70 _ThreadName=admin-listener(1)] [levelValue: 1000] [[
Exception during lifecycle processing
java.lang.RuntimeException: Target ejb AppManagedVehicleBean for remote ejb 3.0 reference ejb/AppManagedVehicleBean does not expose a remote business interface of type com.sun.ts.tests.common.vehicle.appmanaged.AppManagedVehicleIF
at com.sun.enterprise.deployment.util.ComponentValidator.accept(ComponentValidator.java:452)
at com.sun.enterprise.deployment.util.DefaultDOLVisitor.accept(DefaultDOLVisitor.java:54)
at com.sun.enterprise.deployment.util.ComponentValidator.accept(ComponentValidator.java:84)
at com.sun.enterprise.deployment.util.ApplicationValidator.accept(ApplicationValidator.java:139)
at com.sun.enterprise.deployment.util.AppClientValidator.accept(AppClientValidator.java:43)
at com.sun.enterprise.deployment.BundleDescriptor.visit(BundleDescriptor.java:588)
at com.sun.enterprise.deployment.ApplicationClientDescriptor.visit(ApplicationClientDescriptor.java:593)
at com.sun.enterprise.deployment.util.ApplicationValidator.accept(ApplicationValidator.java:177)
at com.sun.enterprise.deployment.BundleDescriptor.visit(BundleDescriptor.java:588)
at com.sun.enterprise.deployment.archivist.ApplicationArchivist.validate(ApplicationArchivist.java:670)
at com.sun.enterprise.deployment.archivist.ApplicationArchivist.openWith(ApplicationArchivist.java:228)
at com.sun.enterprise.deployment.archivist.ApplicationFactory.openWith(ApplicationFactory.java:200)
at org.glassfish.javaee.core.deployment.DolProvider.processDOL(DolProvider.java:179)
at org.glassfish.javaee.core.deployment.DolProvider.load(DolProvider.java:210)
at org.glassfish.javaee.core.deployment.DolProvider.load(DolProvider.java:80)
at com.sun.enterprise.v3.server.ApplicationLifecycle.loadDeployer(ApplicationLifecycle.java:942)
at com.sun.enterprise.v3.server.ApplicationLifecycle.setupContainerInfos(ApplicationLifecycle.java:881)
at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:411)
at com.sun.enterprise.v3.server.ApplicationLifecycle.deploy(ApplicationLifecycle.java:257)
at org.glassfish.deployment.admin.DeployCommand.execute(DeployCommand.java:474)
at com.sun.enterprise.v3.admin.CommandRunnerImpl$2$1.run(CommandRunnerImpl.java:574)
at com.sun.enterprise.v3.admin.CommandRunnerImpl$2$1.run(CommandRunnerImpl.java:570)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
at java.base/javax.security.auth.Subject.doAs(Subject.java:376)
at com.sun.enterprise.v3.admin.CommandRunnerImpl$2.execute(CommandRunnerImpl.java:569)
at com.sun.enterprise.v3.admin.CommandRunnerImpl$3.run(CommandRunnerImpl.java:600)
at com.sun.enterprise.v3.admin.CommandRunnerImpl$3.run(CommandRunnerImpl.java:592)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
at java.base/javax.security.auth.Subject.doAs(Subject.java:376)
at com.sun.enterprise.v3.admin.CommandRunnerImpl.doCommand(CommandRunnerImpl.java:591)
at com.sun.enterprise.v3.admin.CommandRunnerImpl.doCommand(CommandRunnerImpl.java:1484)

@starksm64
Copy link
Contributor Author

java.lang.RuntimeException: Target ejb AppManagedVehicleBean for remote ejb 3.0 reference ejb/AppManagedVehicleBean does not expose a remote business interface of type

I think this indicates that the tcks/apis/persistence/persistence-inside-container/spec-tests/src/main/resources/com/sun/ts/tests/common/vehicle/appmanaged/appmanaged_vehicle_client.xml still has the old ejb-ref in it. It should just be empty like this:

<application-client xmlns="https://jakarta.ee/xml/ns/jakartaee" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="10" xsi:schemaLocation="https://jakarta.ee/xml/ns/jakartaee https://jakarta.ee/xml/ns/jakartaee/application-client_10.xsd">

</application-client>

@starksm64
Copy link
Contributor Author

I just pulled down the platform-tck and checked out the issue1998 branch on a fedora vm and installed the tck from the platform-tck build, and then ran the tests from the platform-tck/glassfish-runner/persistence-platform-tck/persistence-platform-tck-run directory. It is passing for me.

tck/persistence-platform-tck-run$ mvn -Pfull,appclient -DskipSBOM test-compile failsafe:integration-test@jpa-tests-appclient | tee run.log
...
Sat Mar 08 19:14:41 CST 2025 : Connection obtained for host: 0.0.0.0, port number 1527.
Sat Mar 08 19:14:41 CST 2025 : Apache Derby Network Server - 10.15.2.0 - (1873585) shutdown
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:31 min
[INFO] Finished at: 2025-03-08T19:14:41-06:00
[INFO] ------------------------------------------------------------------------
starksm@fedora:~/Dev/Jakarta/platform-tck/glassfish-runner/persistence-platform-

I would remove all of your ~/.m2/repository/jakarta/tck contents and make sure you do the platform-tck install using -Dmaven.build.cache.enabled=false to ensure you are getting the issue1998 branch contents.

Signed-off-by: Scott M Stark <starksm64@gmail.com>
@starksm64
Copy link
Contributor Author

my last run of this branch:

[ERROR] Tests run: 7291, Failures: 0, Errors: 2185, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:34 h
[INFO] Finished at: 2025-03-10T03:24:35-06:00
[INFO] ------------------------------------------------------------------------

@scottmarlow
Copy link
Contributor

my last run of this branch:

[ERROR] Tests run: 7291, Failures: 0, Errors: 2185, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:34 h
[INFO] Finished at: 2025-03-10T03:24:35-06:00
[INFO] ------------------------------------------------------------------------

Nice progress! I'm still not sure why I cannot run locally (I have the right source ejb vehicle xml file is empty in source tree). I'll see if I can update a CI Jenkins job to run against the changes.

…lass

Signed-off-by: Scott M Stark <starksm@starkinternational.com>
Signed-off-by: Scott M Stark <starksm@starkinternational.com>
Remove the fixed jndi name for stateless3 vehicle ejb

Signed-off-by: Scott M Stark <starksm@starkinternational.com>
@starksm64
Copy link
Contributor Author

Latest changes has:

[ERROR] Tests run: 6968, Failures: 0, Errors: 1375, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  03:10 h
[INFO] Finished at: 2025-03-10T20:13:56-06:00
[INFO] ------------------------------------------------------------------------

Still seeing some deployment errors.

Signed-off-by: Scott M Stark <starksm@starkinternational.com>
@starksm64
Copy link
Contributor Author

starksm64 commented Mar 14, 2025

So the results should be getting better, but a full run is now showing:

[ERROR] Tests run: 4022, Failures: 0, Errors: 520, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:52 h
[INFO] Finished at: 2025-03-14T13:57:07-06:00
[INFO] ------------------------------------------------------------------------

One package that shows all failures in this run is ee.jakarta.tck.persistence.core.metamodelapi.metamodel, but when I run that package by itself I see all passing:

[INFO] Results:
[INFO] 
[INFO] Tests run: 40, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:20 min
[INFO] Finished at: 2025-03-14T14:22:52-06:00
[INFO] ------------------------------------------------------------------------

so we have some cross test pollution that is causing failures in the full run.

@starksm64
Copy link
Contributor Author

So I just ran it again to see what the order of failing tests were, and it was passing at 98.5%?

[ERROR] Tests run: 7289, Failures: 0, Errors: 106, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  04:07 h
[INFO] Finished at: 2025-03-15T16:48:32-06:00
[INFO] ------------------------------------------------------------------------

and the only errors were:

starksm@lima-default persistence-platform-tck-run# cat target/failsafe-reports/*.txt | grep Errors: | grep -v "Errors: 0"
Tests run: 36, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 54.04 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.StoredProcedureQuery.Client1AppmanagedTest
Tests run: 36, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 52.60 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.StoredProcedureQuery.Client1Stateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.064 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.access.field.Client3AppmanagedTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.019 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.access.field.Client3Stateful3Test
Tests run: 10, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 15.64 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.convert.ClientAppmanagedTest
Tests run: 10, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 15.71 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.convert.ClientStateful3Test
Tests run: 6, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 9.963 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.mapkeycolumn.ClientAppmanagedTest
Tests run: 6, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 10.08 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.mapkeycolumn.ClientStateful3Test
Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 18.22 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.nativequery.ClientAppmanagedTest
Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 18.26 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.nativequery.ClientStateful3Test
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.488 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client1AppmanagedTest
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.065 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client1Stateful3Test
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.199 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client2AppmanagedTest
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.175 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client2Stateful3Test
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.328 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client3AppmanagedTest
Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.188 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client3Stateful3Test
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6.371 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client4AppmanagedTest
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6.291 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.annotations.version.Client4Stateful3Test
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 6.974 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.cache.basicTests.ClientAppmanagedTest
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.049 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.cache.basicTests.ClientStateful3Test
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 10.42 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.criteriaapi.CriteriaQuery.Client4AppmanagednotxTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.013 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.criteriaapi.CriteriaQuery.Client7Stateless3Test
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.555 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.criteriaapi.strquery.Client1AppmanagednotxTest
Tests run: 26, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 37.69 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManager.Client1AppmanagedTest
Tests run: 26, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 37.85 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManager.Client1Stateful3Test
Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 8.879 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManager.Client2AppmanagedTest
Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 8.610 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManager.Client2Stateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.843 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManagerFactoryCloseExceptions.ClientAppmanagedTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.796 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManagerFactoryCloseExceptions.ClientAppmanagednotxTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.807 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManagerFactoryCloseExceptions.ClientStateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.890 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entityManagerFactoryCloseExceptions.ClientStateless3Test
Tests run: 11, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 17.52 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXmany.ClientAppmanagednotxTest
Tests run: 11, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 16.71 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXmany.ClientStateless3Test
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.44 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXone.ClientAppmanagedTest
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.06 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXone.ClientAppmanagednotxTest
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.28 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXone.ClientStateful3Test
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.98 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.cascadeall.manyXone.ClientStateless3Test
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 11.47 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.basic.ClientAppmanagedTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.28 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.basic.ClientAppmanagednotxTest
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 16.11 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.manyXone.ClientAppmanagedTest
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 16.41 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.manyXone.ClientAppmanagednotxTest
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 16.42 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.manyXone.ClientStateful3Test
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.57 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.entitytest.persist.manyXone.ClientStateless3Test
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6.164 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.query.language.Client5Stateless3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 12.08 s <<< FAILURE! -- in ee.jakarta.tck.persistence.core.query.language.Client6AppmanagedTest
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 5.543 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.entityManager.ClientAppmanagedTest
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 5.595 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.entityManager.ClientStateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.245 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.appclient.annotation.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.231 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.appclient.descriptor.ClientTest
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 6.464 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.ejb.descriptor.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.282 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.ejb.exclude.ClientTest
Tests run: 15, Failures: 0, Errors: 15, Skipped: 0, Time elapsed: 14.04 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.ejb.resource_local.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.266 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.packaging.ejb.standalone.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.304 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.pluggability.contracts.jta.ClientAppmanagedTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.289 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.pluggability.contracts.jta.ClientStateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.294 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.pluggability.contracts.jta.ClientStateless3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.333 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.pluggability.contracts.resource_local.ClientAppmanagednotxTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.247 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.propagation.am.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.255 s <<< FAILURE! -- in ee.jakarta.tck.persistence.ee.propagation.cm.extended.ClientTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.973 s <<< FAILURE! -- in ee.jakarta.tck.persistence.jpa.ee.packaging.jar.ClientAppmanagedTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.877 s <<< FAILURE! -- in ee.jakarta.tck.persistence.jpa.ee.packaging.jar.ClientStateful3Test
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.946 s <<< FAILURE! -- in ee.jakarta.tck.persistence.jpa.ee.packaging.jar.ClientStateless3Test

Some of these tests like ee.jakarta.tck.persistence.ee.packaging.ejb.exclude.ClientTest don't use a vehicle, the just use an appclient with a remote ejb so the current vehicle update does not apply. A different change will be needed for these type of tests.

Signed-off-by: Scott M Stark <starksm@starkinternational.com>
@starksm64
Copy link
Contributor Author

Again I saw a run with only around 4000 test passing and 500 errors. It looks like the issue is the glassfish container plugin is leaving a bunch of /tmp/gf_uploadsNNN files and the tmp filesystem on the vm I'm testing with is filling up. I have cleared these out and am rerunning to verify.

@starksm64
Copy link
Contributor Author

The latest run, 98.9% passing:

[ERROR] Tests run: 7281, Failures: 0, Errors: 83, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  10:41 h
[INFO] Finished at: 2025-03-17T08:49:55-06:00
[INFO] ------------------------------------------------------------------------

@starksm64
Copy link
Contributor Author

I created this question about being able to delete the gf_uploads* files:
OmniFish-EE/arquillian-container-glassfish#6

@starksm64 starksm64 marked this pull request as ready for review March 19, 2025 21:41
@starksm64 starksm64 merged commit 81cba34 into main Mar 19, 2025
3 checks passed
@starksm64 starksm64 deleted the issue1998 branch March 19, 2025 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants