Skip to content

Initial exclude list for JDK26 #6746

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
smlambert merged 2 commits into from
Nov 27, 2025
Merged

Initial exclude list for JDK26 #6746

smlambert merged 2 commits into from
Nov 27, 2025
+494 −0

Conversation

@smlambert
Copy link
Contributor

@smlambert smlambert commented Nov 25, 2025

Fixes #6745

@smlambert
Copy link
Contributor Author

smlambert commented Nov 25, 2025 •
edited
Loading

Test one of the previously failing targets to check that it addresses the missing file issue:
https://ci.adoptium.net/job/Grinder/15664/

Test all sanity.openjdk and extended.openjdk targets to verify which testcases should get excluded in the newly added fail:
sanity: https://ci.adoptium.net/job/Grinder/15665/
extended (with CLOUD_PROVIDER=azure, PARALLEL=Dynamic, NUM_MACHINES=8) to see if we end up spinning up dynamic containers:
https://ci.adoptium.net/job/Grinder/15677/

@sxa
Copy link
Member

sxa commented Nov 25, 2025

extended (with CLOUD_PROVIDER=azure, PARALLEL=Dynamic, NUM_MACHINES=8) to see if we end up spinning up dynamic containers: https://ci.adoptium.net/job/Grinder/15672/

I've re-run your extended one with nightly instead of releases since it failed as there's no release for 26 yet:
https://ci.adoptium.net/job/Grinder/15675/

sxa
sxa approved these changes Nov 25, 2025
View reviewed changes
Copy link
Member

@sxa sxa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Test one of the previously failing targets to check that it addresses the missing file issue:
https://ci.adoptium.net/job/Grinder/15664/

Approving on the basis that this has passed so resolves the immediate problem and so it's got my pre-approval for when we add additional tests into it and take it out of draft :-)

@smlambert
Copy link
Contributor Author

smlambert commented Nov 26, 2025 •
edited
Loading

Colating results here before updating the problemlist as part of this PR:

sanity on linux aarch64 - 2 testcases failing

not ok 4 - hotspot_tier1_runtime_0
  ---
    output:
      |
        Failed test cases: 
        TEST: runtime/ErrorHandling/MachCodeFramesInErrorFile.java
        TEST: runtime/ErrorHandling/StackWalkNativeToJava.java
    duration_ms: 907268

extended on linux x64 - 7 testcases

not ok 3 - jdk_security3_0
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/security/lib/cacerts/VerifyCACerts.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Camerfirma.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Entrust.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java
        Test results: passed: 989; failed: 4; skipped: 111; excluded: 10; did not match keywords: 12; did not meet module requirements: 3; did not meet platform requirements: 25
    duration_ms: 6047646
  ...
not ok 2 - jdk_net_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/net/MulticastSocket/NoLoopbackPackets.java
        TEST: java/net/MulticastSocket/Test.java
        Test results: passed: 1,038; failed: 2; skipped: 2; did not match keywords: 7; did not meet platform requirements: 11
    duration_ms: 3747179
  ...
not ok 7 - jdk_jdi_0
  ---
    output:
      |
        Failed test cases: 
        TEST: com/sun/jdi/FinalizerTest.java
        Test results: passed: 185; failed: 1; excluded: 1; did not meet platform requirements: 1
    duration_ms: 672572
  ...

@smlambert
Copy link
Contributor Author

smlambert commented Nov 26, 2025 •
edited
Loading

extended.openjdk on x64 windows: https://ci.adoptium.net/job/Grinder/15690/

not ok 2 - jdk_beans_1
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        Test results: passed: 335; failed: 8; excluded: 2; did not match keywords: 4
    duration_ms: 1037337
  ...
not ok 5 - jdk_tools_0
  ---
    output:
      |
        Failed test cases: 
        TEST: tools/jpackage/share/AddLauncherTest.java#id1
        TEST: tools/jpackage/share/AddLShortcutTest.java#id1
        TEST: tools/jpackage/share/AppContentTest.java
        TEST: tools/jpackage/share/AppImagePackageTest.java
        TEST: tools/jpackage/share/BasicTest.java
        TEST: tools/jpackage/share/EmptyFolderTest.java#id0
        TEST: tools/jpackage/share/FileAssociationsTest.java#id0
        TEST: tools/jpackage/share/InOutPathTest.java
        TEST: tools/jpackage/share/InstallDirTest.java#id1
        TEST: tools/jpackage/share/LicenseTest.java#id1
        TEST: tools/jpackage/share/MultiLauncherTwoPhaseTest.java
        TEST: tools/jpackage/share/MultiNameTwoPhaseTest.java
        TEST: tools/jpackage/share/PerUserCfgTest.java
        TEST: tools/jpackage/share/PostImageScriptTest.java
        TEST: tools/jpackage/share/RuntimePackageTest.java#id0
        TEST: tools/jpackage/share/ServiceTest.java#id1
        TEST: tools/jpackage/share/SimplePackageTest.java
        TEST: tools/jpackage/share/VendorTest.java#id1
        TEST: tools/jpackage/windows/Win8282351Test.java
        TEST: tools/jpackage/windows/WinDirChooserTest.java
        TEST: tools/jpackage/windows/WinInstallerIconTest.java
        TEST: tools/jpackage/windows/WinInstallerResourceTest.java
        TEST: tools/jpackage/windows/WinInstallerUiTest.java
        TEST: tools/jpackage/windows/WinL10nTest.java
        TEST: tools/jpackage/windows/WinLongPathTest.java
        TEST: tools/jpackage/windows/WinLongVersionTest.java
        TEST: tools/jpackage/windows/WinMenuGroupTest.java
        TEST: tools/jpackage/windows/WinMenuTest.java
        TEST: tools/jpackage/windows/WinOSConditionTest.java
        TEST: tools/jpackage/windows/WinPerUserInstallTest.java
        TEST: tools/jpackage/windows/WinResourceTest.java
        TEST: tools/jpackage/windows/WinScriptTest.java
        TEST: tools/jpackage/windows/WinShortcutPromptTest.java
        TEST: tools/jpackage/windows/WinShortcutTest.java
        TEST: tools/jpackage/windows/WinUpgradeUUIDTest.java#id1
        TEST: tools/jpackage/windows/WinUrlTest.java
        Test results: passed: 347; failed: 36; skipped: 2; excluded: 2; did not meet platform requirements: 60
    duration_ms: 4805029
  ...
not ok 7 - jdk_jfr_1
  ---
    output:
      |
        Failed test cases: 
        TEST: jdk/jfr/jvm/TestChunkIntegrity.java
        Test results: passed: 13; failed: 1; skipped: 1; excluded: 2; did not meet platform requirements: 619
    duration_ms: 172177
  ...
not ok 9 - jdk_imageio_1
  ---
    output:
      |
        Failed test cases: 
        TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        Test results: passed: 209; failed: 1
    duration_ms: 220470
  ...
not ok 1 - hotspot_compiler_0
  ---
    output:
      |
        Failed test cases: 
        TEST: compiler/gallery/TestNormalMapping.java#visual
    duration_ms: 7
not ok 3 - jdk_security3_0
  ---
    output:
      |
        Failed test cases: 
        TEST: javax/net/ssl/SSLSession/CertMsgCheck.java
        TEST: sun/security/lib/cacerts/VerifyCACerts.java
        TEST: sun/security/mscapi/ShortRSAKeyWithinTLS.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Camerfirma.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Entrust.java
        TEST: sun/security/ssl/X509TrustManagerImpl/distrust/Symantec.java
        Test results: passed: 1,013; failed: 6; skipped: 111; excluded: 10; did not match keywords: 12; did not meet platform requirements: 2
    duration_ms: 5312609
  ...
not ok 1 - hotspot_runtime_0
  ---
    output:
      |
        Failed test cases: 
        TEST: runtime/NMT/NMTPrintMallocSiteOfCorruptedMemory.java
        Test results: passed: 1,046; failed: 1; skipped: 3; did not match keywords: 6; did not meet platform requirements: 164
    duration_ms: 3388926
  ...

I will continue to vet each exclusion via #6749, but it will take time, so to expedite a fix for the jdk26 test runs, I will bring in a problemlist file based on jdk25, with 32-bit platforms removed (as they are not in jdk26).

@smlambert smlambert marked this pull request as ready for review November 26, 2025 18:04
@smlambert smlambert mentioned this pull request Nov 26, 2025
Open
adamfarley
adamfarley approved these changes Nov 27, 2025
View reviewed changes
Copy link
Contributor

@adamfarley adamfarley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@smlambert smlambert merged commit 36ba7f9 into adoptium:master Nov 27, 2025
3 checks passed
@smlambert smlambert deleted the issue6745 branch December 11, 2025 17:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sxa sxa sxa approved these changes

@adamfarley adamfarley adamfarley approved these changes

@andrew-m-leonard andrew-m-leonard andrew-m-leonard approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

bad parameters specified from openjdk jobs on jdk26 tests

4 participants

@smlambert @sxa @adamfarley @andrew-m-leonard