FFMPEG recompilation failure (libavformat)

[gipert]

Hi, since my last system update this morning (Arch Linux), FFMPEG precompilation fails with the following linker error:

ERROR: The following 1 direct dependency failed to precompile:

FFMPEG [c87230d0-a227-11e9-1b43-d7ebe4e7570a]

ERROR: LoadError: InitError: could not load library "/home/gipert/.julia/artifacts/7f40eeb66d90d3026ae5fb68761c263b57adb840/lib/libavdevice.so"
/usr/lib/libavformat.so.58: undefined symbol: avpriv_packet_list_free, version LIBAVCODEC_58
Stacktrace:
  [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
    @ Base.Libc.Libdl ./libdl.jl:114
  [2] dlopen(s::String, flags::UInt32)
    @ Base.Libc.Libdl ./libdl.jl:114
  [3] macro expansion
    @ ~/.julia/packages/JLLWrappers/bkwIo/src/products/library_generators.jl:54 [inlined]
  [4] __init__()
    @ FFMPEG_jll ~/.julia/packages/FFMPEG_jll/xCSqL/src/wrappers/x86_64-linux-gnu.jl:47
  [5] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base ./loading.jl:674
  [6] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base ./loading.jl:760
  [7] _require(pkg::Base.PkgId)
    @ Base ./loading.jl:998
  [8] require(uuidkey::Base.PkgId)
    @ Base ./loading.jl:914
  [9] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:901
 [10] include
    @ ./Base.jl:386 [inlined]
 [11] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::Nothing)
    @ Base ./loading.jl:1213
 [12] top-level scope
    @ none:1
 [13] eval
    @ ./boot.jl:360 [inlined]
 [14] eval(x::Expr)
    @ Base.MainInclude ./client.jl:446
 [15] top-level scope
    @ none:1
during initialization of module FFMPEG_jll
in expression starting at /home/gipert/.julia/packages/FFMPEG/aazvf/src/FFMPEG.jl:1
Stacktrace:
 [1] pkgerror(msg::String)
   @ Pkg.Types /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.6/Pkg/src/Types.jl:55
 [2] precompile(ctx::Pkg.Types.Context; internal_call::Bool, strict::Bool, kwargs::Base.Iterators.Pairs{Union{}, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
   @ Pkg.API /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.6/Pkg/src/API.jl:1244
 [3] precompile
   @ /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.6/Pkg/src/API.jl:920 [inlined]
 [4] #precompile#196
   @ /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.6/Pkg/src/API.jl:918 [inlined]
 [5] precompile()
   @ Pkg.API /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.6/Pkg/src/API.jl:918
 [6] top-level scope
   @ REPL[49]:1

I've also tried downloading again the artifact but no luck. Ideas?

[gipert]

Looks the same issue as in #36, a workaround is to manually point LD_LIBRARY_PATH to the artifact folder where libavformat.so is.

[giordano]

Alternatively, clear LD_LIBRARY_PATH when running julia, unless needed for some specific packages, for example

LD_LIBRARY_PATH="" julia

[gipert]

Ciao @giordano, indeed, I eventually figured out that my Geant4 installation (from the Arch Linux AUR repo) was adding /usr/lib to LD_LIBRARY_PATH... nasty! I just removed /etc/profile.d/geant4_profile.sh then.

[IanButterworth]

I've just hit this problem on a system where LD_LIBRARY_PATH isn't set, and it isn't fixed by LD_LIBRARY_PATH="" julia

Is there another mechanism other than LD_LIBRARY_PATH that can bring system ffmpeg in?

[IanButterworth]

I just realized I was hitting this because on Julia < 1.8 there's a bug where the module import order isn't guaranteed (fixed by JuliaLang/julia#45861).

I was using a dep that used a system lib that imported ffmpeg, and thought that having using VideoIO before using that lib should have fixed it, but in some cases the order was messed up.

I fixed it by manually controlling when my package that used a system lib initializes, rather than automatically in its __init__()

Pretty nasty bug to debug