JUnit5 tests are not picked up by surefire plugin

[ielatif]

Affected version 4.3.1-SNAPSHOT

While working on #727 (PR #751) I added some JUnit 5 tests that are not running because not picked up by surefire plugin.
Surefire version 2.22.2 does not play well with JUnit 5.

I noticed that the parent spring-cloud-build define version 3.5.3 for surefire plugin in its PluginManagement (JUnit 5 tests are picked up by this version).

Is there a reason for overriding surefire plugin version in spring-cloud-vault or could we use the version defined in parent's PluginManegement section?

The same applies for these plugins, versions are getting overridden :

• maven-deploy-plugin
• maven-jar-plugin
• maven-javadoc-plugin
• maven-release-plugin
• maven-source-plugin

@mp911de @spencergibb

Thanks

[mp911de]

This isn't entirely correct. JUnit 5 tests are ran. What you've experienced is that you've added @Nested tests that aren't picked up because of the inclusion rules:

<includes>
  <include>**/*Tests.java</include>
  <include>**/*Test.java</include>
</includes>

Nested tests would be required to be included via **/*Tests$*.java/**/*Test$*.java. There's quite some amount of inner classes already, so Spring Cloud Build would need to enable that pattern to see whether something breaks or not.

[ielatif]

I rewrote my unit tests with JUnit 4 and they run now.

JUnit 5 tests are not running for me. This test VaultHealthIndicatorAutoConfigurationTests is not picked up by surefire

Execution report with surefire 2.22.2: VaultHealthIndicatorAutoConfigurationTests is missing

[INFO] --- surefire:2.22.2:test (default-test) @ spring-cloud-vault-config ---
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.springframework.cloud.vault.config.ReactiveVaultBootstrapConfigurationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.663 s - in org.springframework.cloud.vault.config.ReactiveVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDisabledTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.108 s - in org.springframework.cloud.vault.config.VaultConfigDisabledTests
[INFO] Running org.springframework.cloud.vault.config.ReactiveVaultOperationsTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.238 s - in org.springframework.cloud.vault.config.ReactiveVaultOperationsTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.289 s - in org.springframework.cloud.vault.config.VaultPropertySourceLocatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.826 s - in org.springframework.cloud.vault.config.VaultPropertySourceLocatorIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultNamespaceTests
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.044 s - in org.springframework.cloud.vault.config.VaultNamespaceTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigKeyValueBackendDisabledTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.435 s - in org.springframework.cloud.vault.config.VaultConfigKeyValueBackendDisabledTests
[INFO] Running org.springframework.cloud.vault.config.KeyValueSecretIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 s - in org.springframework.cloud.vault.config.KeyValueSecretIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTemplateIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 s - in org.springframework.cloud.vault.config.VaultConfigTemplateIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.PropertyNameTransformerUnitTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.springframework.cloud.vault.config.PropertyNameTransformerUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorProfilesIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.495 s - in org.springframework.cloud.vault.config.VaultPropertySourceLocatorProfilesIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 s - in org.springframework.cloud.vault.config.VaultPropertySourceIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.529 s - in org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigWithVaultConfigurerTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.416 s - in org.springframework.cloud.vault.config.VaultConfigWithVaultConfigurerTests
[INFO] Running org.springframework.cloud.vault.config.VaultHealthIndicatorUnitTests
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.155 s - in org.springframework.cloud.vault.config.VaultHealthIndicatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLoaderUnitTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 s - in org.springframework.cloud.vault.config.VaultConfigDataLoaderUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppRoleTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.486 s - in org.springframework.cloud.vault.config.VaultConfigAppRoleTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapConfigurationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 s - in org.springframework.cloud.vault.config.VaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigKubernetesTests
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.003 s - in org.springframework.cloud.vault.config.VaultConfigKubernetesTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigWithContextTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.516 s - in org.springframework.cloud.vault.config.VaultConfigWithContextTests
[INFO] Running org.springframework.cloud.vault.config.ApplicationFailFastTests
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.292 s - in org.springframework.cloud.vault.config.ApplicationFailFastTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveHealthIndicatorIntegrationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.034 s - in org.springframework.cloud.vault.config.VaultReactiveHealthIndicatorIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppIdCustomMechanismTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.394 s - in org.springframework.cloud.vault.config.VaultConfigAppIdCustomMechanismTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.477 s - in org.springframework.cloud.vault.config.VaultConfigTests
[INFO] Running org.springframework.cloud.vault.config.ConfigDataShutdownTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.417 s - in org.springframework.cloud.vault.config.ConfigDataShutdownTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigLoaderSingleLocationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.218 s - in org.springframework.cloud.vault.config.VaultConfigLoaderSingleLocationTests
[INFO] Running org.springframework.cloud.vault.config.LeasingVaultPropertySourceLocatorUnitTests
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 s - in org.springframework.cloud.vault.config.LeasingVaultPropertySourceLocatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapPropertySourceConfigurationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.116 s - in org.springframework.cloud.vault.config.VaultBootstrapPropertySourceConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultVersionedKvBackendConfigTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.282 s - in org.springframework.cloud.vault.config.VaultVersionedKvBackendConfigTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapperIntegrationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.294 s - in org.springframework.cloud.vault.config.VaultBootstrapperIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveAutoConfigurationTests
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.199 s - in org.springframework.cloud.vault.config.VaultReactiveAutoConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.ClientAuthenticationFactoryUnitTests
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.054 s - in org.springframework.cloud.vault.config.ClientAuthenticationFactoryUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppIdTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.267 s - in org.springframework.cloud.vault.config.VaultConfigAppIdTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigCubbyholeAuthenticationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.27 s - in org.springframework.cloud.vault.config.VaultConfigCubbyholeAuthenticationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLoaderIntegrationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.652 s - in org.springframework.cloud.vault.config.VaultConfigDataLoaderIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLocationResolverUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 s - in org.springframework.cloud.vault.config.VaultConfigDataLocationResolverUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigLoaderTests
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.227 s - in org.springframework.cloud.vault.config.VaultConfigLoaderTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationMountPathTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.246 s - in org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationMountPathTests
[INFO] Running org.springframework.cloud.vault.config.DiscoveryClientVaultBootstrapConfigurationTests
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 s - in org.springframework.cloud.vault.config.DiscoveryClientVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.ReactiveDiscoveryClientVaultBootstrapConfigurationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.098 s - in org.springframework.cloud.vault.config.ReactiveDiscoveryClientVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveBootstrapConfigurationTests
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 s - in org.springframework.cloud.vault.config.VaultReactiveBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.KeyValueSecretBackendMetadataUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in org.springframework.cloud.vault.config.KeyValueSecretBackendMetadataUnitTests
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 123, Failures: 0, Errors: 0, Skipped: 4

Execution report with surefire 3.5.3: VaultHealthIndicatorAutoConfigurationTests is running

[INFO] --- surefire:3.5.3:test (default-test) @ spring-cloud-vault-config ---
[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider
[INFO] 
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.springframework.cloud.vault.config.ReactiveVaultBootstrapConfigurationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.669 s -- in org.springframework.cloud.vault.config.ReactiveVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDisabledTests
OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.308 s -- in org.springframework.cloud.vault.config.VaultConfigDisabledTests
[INFO] Running org.springframework.cloud.vault.config.ReactiveVaultOperationsTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.216 s -- in org.springframework.cloud.vault.config.ReactiveVaultOperationsTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.375 s -- in org.springframework.cloud.vault.config.VaultPropertySourceLocatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.872 s -- in org.springframework.cloud.vault.config.VaultPropertySourceLocatorIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultNamespaceTests
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.064 s -- in org.springframework.cloud.vault.config.VaultNamespaceTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigKeyValueBackendDisabledTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.465 s -- in org.springframework.cloud.vault.config.VaultConfigKeyValueBackendDisabledTests
[INFO] Running org.springframework.cloud.vault.config.KeyValueSecretIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 s -- in org.springframework.cloud.vault.config.KeyValueSecretIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTemplateIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 s -- in org.springframework.cloud.vault.config.VaultConfigTemplateIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.PropertyNameTransformerUnitTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s -- in org.springframework.cloud.vault.config.PropertyNameTransformerUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceLocatorProfilesIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.504 s -- in org.springframework.cloud.vault.config.VaultPropertySourceLocatorProfilesIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultPropertySourceIntegrationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 s -- in org.springframework.cloud.vault.config.VaultPropertySourceIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.432 s -- in org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigWithVaultConfigurerTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.416 s -- in org.springframework.cloud.vault.config.VaultConfigWithVaultConfigurerTests
[INFO] Running org.springframework.cloud.vault.config.VaultHealthIndicatorUnitTests
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 s -- in org.springframework.cloud.vault.config.VaultHealthIndicatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLoaderUnitTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 s -- in org.springframework.cloud.vault.config.VaultConfigDataLoaderUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppRoleTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.455 s -- in org.springframework.cloud.vault.config.VaultConfigAppRoleTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapConfigurationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 s -- in org.springframework.cloud.vault.config.VaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigKubernetesTests
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 s -- in org.springframework.cloud.vault.config.VaultConfigKubernetesTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigWithContextTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.414 s -- in org.springframework.cloud.vault.config.VaultConfigWithContextTests
[INFO] Running org.springframework.cloud.vault.config.ApplicationFailFastTests
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.297 s -- in org.springframework.cloud.vault.config.ApplicationFailFastTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveHealthIndicatorIntegrationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 s -- in org.springframework.cloud.vault.config.VaultReactiveHealthIndicatorIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppIdCustomMechanismTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.428 s -- in org.springframework.cloud.vault.config.VaultConfigAppIdCustomMechanismTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.372 s -- in org.springframework.cloud.vault.config.VaultConfigTests
[INFO] Running org.springframework.cloud.vault.config.ConfigDataShutdownTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.438 s -- in org.springframework.cloud.vault.config.ConfigDataShutdownTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigLoaderSingleLocationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.228 s -- in org.springframework.cloud.vault.config.VaultConfigLoaderSingleLocationTests
[INFO] Running org.springframework.cloud.vault.config.LeasingVaultPropertySourceLocatorUnitTests
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 s -- in org.springframework.cloud.vault.config.LeasingVaultPropertySourceLocatorUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapPropertySourceConfigurationTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.134 s -- in org.springframework.cloud.vault.config.VaultBootstrapPropertySourceConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultVersionedKvBackendConfigTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.293 s -- in org.springframework.cloud.vault.config.VaultVersionedKvBackendConfigTests
[INFO] Running org.springframework.cloud.vault.config.VaultBootstrapperIntegrationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.285 s -- in org.springframework.cloud.vault.config.VaultBootstrapperIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveAutoConfigurationTests
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.201 s -- in org.springframework.cloud.vault.config.VaultReactiveAutoConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.ClientAuthenticationFactoryUnitTests
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.054 s -- in org.springframework.cloud.vault.config.ClientAuthenticationFactoryUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigAppIdTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.266 s -- in org.springframework.cloud.vault.config.VaultConfigAppIdTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigCubbyholeAuthenticationTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.255 s -- in org.springframework.cloud.vault.config.VaultConfigCubbyholeAuthenticationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLoaderIntegrationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.612 s -- in org.springframework.cloud.vault.config.VaultConfigDataLoaderIntegrationTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigDataLocationResolverUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 s -- in org.springframework.cloud.vault.config.VaultConfigDataLocationResolverUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigLoaderTests
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.234 s -- in org.springframework.cloud.vault.config.VaultConfigLoaderTests
[INFO] Running org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationMountPathTests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.246 s -- in org.springframework.cloud.vault.config.VaultConfigTlsCertAuthenticationMountPathTests
[INFO] Running org.springframework.cloud.vault.config.DiscoveryClientVaultBootstrapConfigurationTests
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 s -- in org.springframework.cloud.vault.config.DiscoveryClientVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.ReactiveDiscoveryClientVaultBootstrapConfigurationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.102 s -- in org.springframework.cloud.vault.config.ReactiveDiscoveryClientVaultBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.VaultReactiveBootstrapConfigurationTests
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 s -- in org.springframework.cloud.vault.config.VaultReactiveBootstrapConfigurationTests
[INFO] Running org.springframework.cloud.vault.config.KeyValueSecretBackendMetadataUnitTests
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s -- in org.springframework.cloud.vault.config.KeyValueSecretBackendMetadataUnitTests
[INFO] Running org.springframework.cloud.vault.config.VaultHealthIndicatorAutoConfigurationTests
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.080 s -- in org.springframework.cloud.vault.config.VaultHealthIndicatorAutoConfigurationTests
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 126, Failures: 0, Errors: 0, Skipped: 3

[mp911de]

You are correct and I was not aware that Spring Cloud Vault never migrated to JUnit 5. Apologies.

[mp911de]

That's fixed now. I also migrated all of our tests to JUnit 5 (finally) via #753