Build output directory is not excluded in Windows in Spotless 4.0.x

[davidburstromspotify]

Summary:
Spotless runs on build output files in Windows. The same project passes in Linux and MacOS.

Gradle version: 6.5.1-rc1

Spotless version: 4.0.0 and 4.0.1
Regression when moving from version: 3.30.0

Operating System: Windows Server 2012

Build has standard googleJavaFormat applied.

subprojects {
    apply(plugin = "com.diffplug.gradle.spotless")
    plugins.whenPluginAdded {
        if (this is JavaPlugin) {
            configure<SpotlessExtension> {
                java {
                    googleJavaFormat()
                }   
            }
        }
    }   
}

Build output:

Execution failed for task ':version:spotlessJavaCheck'. org.gradle.api.GradleException: The following files had format violations:
version\build\generated\src\constants\java\project\Version.java
Run 'gradlew.bat :version:spotlessApply' to fix these violations.
Caused by: org.gradle.api.GradleException: The following files had format violations:
     version\build\generated\src\constants\java\project\Version.java
  Run 'gradlew.bat :version:spotlessApply' to fix these violations.
    at com.diffplug.gradle.spotless.SpotlessCheck.formatViolationsFor(SpotlessCheck.java:87)
    at com.diffplug.gradle.spotless.SpotlessCheck.performAction(SpotlessCheck.java:76)
    at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:104)
    ....

[nedtwigg]

Interesting! The culprit PR must be #576, but I don't see how it caused the regression.

How does the code-generation work? Based on the configuration you copy-pasted, I would expect autogenerated files in build/ to be within the Spotless target for all platforms, pre and post 4.x. So I would think that you would need targetExclude like so:

configure<SpotlessExtension> {
  java {
    targetExclude 'build/**'
    googleJavaFormat()
  }   
}

Without knowing more about your code generation, it looks like this may have been a bug in 3.x, which is now fixed in 4.x on Windows, but still broken on 4.x unix. A repo that reproduces the issue would be helpful to resolve the confusion.

[davidburstromspotify]

As per your suggestion, I tried adding

configure<SpotlessExtension> {
  java {
    targetExclude(files("$buildDir/**"))
    googleJavaFormat()
  }   
}

but it made no difference in Windows. The same build error happened.

[davidburstromspotify]

The code generation is done with

val VERSION: String by project

val constantsDir = File(project.buildDir, "generated/src/constants/java")

tasks.register("constantsGenerator") {
    val outputFile = File(constantsDir, "project/Version.java")
    inputs.property("version", VERSION as String)
    outputs.file(outputFile)
    doLast {
        outputFile.parentFile.mkdirs()
        outputFile.writeText("package project;\n" +
                "/** Holds the current build version. */\n" +
                "public final class Version {\n" +
                "  private Version() {}\n" +
                "\n" +
                "  public static final String VERSION = \"$VERSION\";\n" +
                "}\n")
    }
}

tasks.named("compileJava").configure {
    dependsOn(tasks.named("constantsGenerator"))
}

sourceSets.main {
    java.srcDir(constantsDir)
}

So, the directory is considered regular source input.

[valfirst]

It seems I'm facing the same issue: build passes on Linux and MacOS, but fails on Windows.
Build: https://github.com/vividus-framework/vividus/runs/703692427?check_suite_focus=true#step:8:105

* What went wrong:
Execution failed for task ':vividus:spotlessMisc'.
> Illegal char <:> at index 59: D:\a\vividus\vividus\vividus\output\spotless\spotlessMisc\D:\a\vividus\vividus\build.gradle

Change: vividus-framework/vividus-build-system@a2967fe

[nedtwigg]

@valfirst turns out your bug is unrelated to @davidburstromspotify's issue. Thanks for reporting though, it was useful, and we have a fix in #588. You will see vastly improved performance adopting the next version once it is published.

@davidburstromspotify I tried to reproduce, and here was what I observed:

• without targetExclude 'build/**', I get org.gradle.api.GradleException: The following files had format violations, which is correct and expected
• with targetExclude 'build/**', I get a different error, java.nio.file.DirectoryNotEmptyException, which exposes a bug in our incremental update. But if I do a clean and then spotlessCheck, the check passes, as expected. When you said "The same build error happened.", is there any chance it was actually a different error? Regardless, we need to fix the DirectoryNotEmptyException bug.

[nedtwigg]

The DirectoryNotEmptyException is fixed by #589.

[davidburstromspotify]

Just to confirm, I had the exact same problem as before:

Execution failed for task ':version:spotlessJavaCheck'. org.gradle.api.GradleException: The following files had format violations:
    version\build\generated\src\constants\java\project\Version.java

I did also see the DirectoryNotEmptyException at some point while trying out different combos, so I'm happy to see that is fixed.

[nedtwigg]

Oh! I just realized. Something strange is going with your target. Looks like you need targetExclude 'version/build/**', note the version prefix in your error message.

[nedtwigg]

If you have this in some shared/root script:

configure<SpotlessExtension> {
  java {
    targetExclude(files("$buildDir/**"))
    googleJavaFormat()
  }   
}

it might be that you're getting the absolute path of the root build directory put in there, and it's not applying correctly to subprojects. Same thing might be happening with your code generation, it looks your root project has version/build/... in its sourceset, whereas I would expect that folder to only be in the sourceset for the :version subproject.

[davidburstromspotify]

Nope, the targetExclude gets the build directory for the subproject. I'm going to set up a public project that reproduces the issue now.

[davidburstromspotify]

Here's a repo that I have tested on Mac and Windows. https://github.com/davidburstromspotify/spotless-issue-585

[nedtwigg]

I cloned your example repo, on win and mac. I believe it is all operating as expected. You are configuring your spotless in a subprojects block from the root project. In that block, if you do "$buildDir", you will get rootdir/build, not rootdir/subproject/build. Likewise, if you do files('build'), you are calling Project.files() on the root project, not on the subproject.

So I would expect that all of them would fail except for targetExclude('build/**'), because that is the only one where subproject/build will be excluded. You can add printlns to your buildscript for another way to see this.

The only thing I don't understand is why this ever worked in 3.30.0. One reason might be task ordering - if spotless runs before constantsGenerator, which it normally should, then it will pass. I don't know why Spotless 4.0 would change this order.