Permission errors for precompilation on Windows

[fredrikekre]

Several users report file permission errors when precompiling on Julia 1.5.3 which did not happen on 1.5.2, see https://discourse.julialang.org/t/precompilation-error-with-julia-1-5-3-windows-10-64-bit/50028. Since there was a libuv upgrade (rebuild?) between those to releases I guess that might be related.

[bkamins]

I confirm this problem. Currently under Win10 you need to run Julia with administrator privileges to be able to precompile packages (this happens if you run it on top of files previously generated by Julia 1.5.2, so maybe in a clean environment this does not happen - I have not checked).

[KristofferC]

Well, that is quite unfortunate :/. 0305b7c did something with permissions but I don't at glance see how that could cause this.

[bkamins]

What is the status of the issue? I think it requires a quick patch (but unfortunately I am probably not the best person to try fixing it).
I had a teaching session today and the problem also appeared.

Just to expand on the issue: this error shows also when you update packages under Windows on 1.5.3.

[fredrikekre]

So the problem seems to be that precompilation files created with 1.5.2 have "wrong" permissions then? Does the 1.5.2 installer have elevated permissions somehow or how can that binary create files that 1.5.3 is not allowed to change?

[KristofferC]

Does clearing .julia/compiled actually fix it? It seems people reported errors even after that, and only using 1.5.3?

[bkamins]

No it does not. I have removed this folder and then did:

using Tables

what happened is that:

1. DataValuesInterfaces.jl compiled correctly (it is a dependency) - a folder for it got created
2. Tables.jl errors (see below) - a folder for it got created but is empty (it has the same permissions as the folder for DataValuesInterfaces.jl though)

julia> using Tables
[ Info: Precompiling Tables [bd369af6-aec1-5ad0-b16a-f7cc5008161c]
ERROR: LoadError: IOError: unlink: permission denied (EACCES)
Stacktrace:
 [1] uv_error at .\libuv.jl:97 [inlined]
 [2] unlink(::String) at .\file.jl:918
 [3] rm(::String; force::Bool, recursive::Bool) at .\file.jl:268
 [4] compilecache(::Base.PkgId, ::String) at .\loading.jl:1300
 [5] _require(::Base.PkgId) at .\loading.jl:1030
 [6] require(::Base.PkgId) at .\loading.jl:928
 [7] require(::Module, ::Symbol) at .\loading.jl:923
 [8] include(::Function, ::Module, ::String) at .\Base.jl:380
 [9] include(::Module, ::String) at .\Base.jl:368
 [10] top-level scope at none:2
 [11] eval at .\boot.jl:331 [inlined]
 [12] eval(::Expr) at .\client.jl:467
 [13] top-level scope at .\none:3
in expression starting at D:\AppData\.julia\packages\Tables\GBP4H\src\Tables.jl:3
caused by [exception 1]
IOError: unlink: permission denied (EACCES)
Stacktrace:
 [1] uv_error at .\libuv.jl:97 [inlined]
 [2] unlink(::String) at .\file.jl:918
 [3] rm(::String; force::Bool, recursive::Bool) at .\file.jl:268
 [4] rename(::String, ::String; force::Bool) at .\file.jl:928
 [5] compilecache(::Base.PkgId, ::String) at .\loading.jl:1296
 [6] _require(::Base.PkgId) at .\loading.jl:1030
 [7] require(::Base.PkgId) at .\loading.jl:928
 [8] require(::Module, ::Symbol) at .\loading.jl:923
 [9] include(::Function, ::Module, ::String) at .\Base.jl:380
 [10] include(::Module, ::String) at .\Base.jl:368
 [11] top-level scope at none:2
 [12] eval at .\boot.jl:331 [inlined]
 [13] eval(::Expr) at .\client.jl:467
 [14] top-level scope at .\none:3
┌ Warning: temp cleanup
│   exception =
│    IOError: unlink: permission denied (EACCES)
│    Stacktrace:
│     [1] uv_error at .\libuv.jl:97 [inlined]
│     [2] unlink(::String) at .\file.jl:918
│     [3] rm(::String; force::Bool, recursive::Bool) at .\file.jl:268
│     [4] temp_cleanup_purge(::Bool) at .\file.jl:514
│     [5] temp_cleanup_purge() at .\file.jl:507
│     [6] _atexit() at .\initdefs.jl:316
│     [7] exit at .\initdefs.jl:28 [inlined]
│     [8] _start() at .\client.jl:509
└ @ Base.Filesystem file.jl:518
ERROR: Failed to precompile Tables [bd369af6-aec1-5ad0-b16a-f7cc5008161c] to D:\AppData\.julia\compiled\v1.5\Tables\Z804B_MpOTO.ji.
Stacktrace:
 [1] error(::String) at .\error.jl:33
 [2] compilecache(::Base.PkgId, ::String) at .\loading.jl:1305
 [3] _require(::Base.PkgId) at .\loading.jl:1030
 [4] require(::Base.PkgId) at .\loading.jl:928
 [5] require(::Module, ::Symbol) at .\loading.jl:923

[KristofferC]

#38433 seems related.

Is it this chmod that messes things up

julia/base/loading.jl

Line 1293 in 599ecd8

chmod(tmppath, filemode(path) & 0o777)

?

But in #38433 there is no explicit chmod so maybe not...

[fredrikekre]

Aren't we chmoding now when cleaning up tmpdirs?

[KristofferC]

Hm, yes, so maybe it is chmod in both cases...?

[bkamins]

Any progress on this. For a reference this is what I get when trying to do using Parsers:

Path   : .julia\compiled\v1.5\Parsers\833b9_MpOTO.ji
Access : BUILTIN\Users Allow  Modify, Synchronize
         BUILTIN\Administrators Allow  FullControl
         NT AUTHORITY\SYSTEM Allow  FullControl
         NT AUTHORITY\Authenticated Users Allow  Modify, Synchronize

Path   : .julia\compiled\v1.5\Parsers\jl_5C04.tmp
Access : Everyone Allow  DeleteSubdirectoriesAndFiles, Write, ReadAndExecute, Synchronize
         NT AUTHORITY\Authenticated Users Allow  DeleteSubdirectoriesAndFiles, Write, ReadAndExecute, Synchronize
         NT AUTHORITY\SYSTEM Allow  FullControl
         BUILTIN\Administrators Allow  FullControl
         BUILTIN\Users Allow  DeleteSubdirectoriesAndFiles, Write, ReadAndExecute, Synchronize
         HOST\username Allow  DeleteSubdirectoriesAndFiles, Write, ReadAndExecute, Synchronize

as you can see the problem is with jl_5C04.tmp file. The 833b9_MpOTO.ji file has correct permissions. For the temp file the problem is that Modify right is not given to the process as you can see, which disallows the Julia process to delete the file (unless run as administrator).