Failing to Find jinja2

[meawoppl]

I'm seeing the build process fail to find jinja2 despite it being installed and reported as detected in the meson outputs:

cd libcamera &&     git submodule update --init &&     meson setup build --buildtype=release -Dpipelines=rpi/vc4,rpi/pisp -Dipas=rpi/vc4,rpi/pisp -Dv4l2=true -Dgstreamer=enabled -Dtest=false -Dlc-compliance=disabled -Dcam=disabled -Dqcam=disabled -Ddocumentation=disabled -Dpycamera=enabled &&     cd build &&     ninja &&     ninja install
[camera]    ---> Running in 5757fdd6a9fc
[camera]   Cloning into 'libpisp'...
[camera]   
[camera]   The Meson build system
[camera]   Version: 1.3.2
[camera]   Source dir: /libcamera
[camera]   Build dir: /libcamera/build
[camera]   Build type: native build
[camera]   DEPRECATION: Option 'v4l2' value 'true' is replaced by 'enabled'
[camera]   Project name: libcamera
[camera]   Project version: 0.5.0
[camera]   C compiler for the host machine: cc (gcc 13.3.0 "cc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   C linker for the host machine: cc ld.bfd 2.42
[camera]   C++ compiler for the host machine: c++ (gcc 13.3.0 "c++ (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   C++ linker for the host machine: c++ ld.bfd 2.42
[camera]   Host machine cpu family: aarch64
[camera]   Host machine cpu: aarch64
[camera]   Header "fcntl.h" has symbol "F_ADD_SEALS" : YES 
[camera]   Header "unistd.h" has symbol "issetugid" : NO 
[camera]   Header "locale.h" has symbol "locale_t" : YES 
[camera]   Header "sys/mman.h" has symbol "memfd_create" : YES 
[camera]   Header "stdlib.h" has symbol "secure_getenv" : YES 
[camera]   Compiler for C supports arguments -Wno-c99-designator: NO 
[camera]   Found pkg-config: YES (/usr/bin/pkg-config) 1.8.1
[camera]   Found CMake: /usr/bin/cmake (3.28.3)
[camera]   Run-time dependency lttng-ust found: NO (tried pkgconfig and cmake)
[camera]   Program ./parser.py found: YES (/libcamera/utils/codegen/ipc/./parser.py)
[camera]   Program ./generate.py found: YES (/libcamera/utils/codegen/ipc/./generate.py)
[camera]   Program ./extract-docs.py found: YES (/libcamera/utils/codegen/ipc/./extract-docs.py)
[camera]   Configuring version.h using configuration
[camera]   Program openssl found: YES (/usr/bin/openssl)
[camera]   Run-time dependency libyuv found: NO (tried pkgconfig and cmake)
[camera]   Has header "libyuv.h" : NO 
[camera]   Library atomic found: YES
[camera]   Run-time dependency threads found: YES
[camera]   Run-time dependency libdw found: YES 0.190
[camera]   Run-time dependency libunwind found: YES 1.6.2
[camera]   Header "execinfo.h" has symbol "backtrace" : YES 
[camera]   Library rt found: YES
[camera]   Run-time dependency libpisp found: NO (tried pkgconfig and cmake)
[camera]   Looking for a fallback subproject for the dependency libpisp
[camera]   Executing subproject libpisp 
[camera]   libpisp| DEPRECATION: Option 'v4l2' value 'true' is replaced by 'enabled'
[camera]   libpisp| Project name: libpisp
[camera]   libpisp| Project version: 1.2.0
[camera]   libpisp| C compiler for the host machine: cc (gcc 13.3.0 "cc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   libpisp| C linker for the host machine: cc ld.bfd 2.42
[camera]   libpisp| C++ compiler for the host machine: c++ (gcc 13.3.0 "c++ (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   libpisp| C++ linker for the host machine: c++ ld.bfd 2.42
[camera]   libpisp| Configuring pisp_build_config.h using configuration
[camera]   libpisp| Run-time dependency nlohmann_json found: NO (tried pkgconfig and cmake)
[camera]   libpisp| Looking for a fallback subproject for the dependency nlohmann_json
[camera]   libpisp| Using subprojects/libpisp/subprojects/nlohmann_json.wrap
[camera]   libpisp| Downloading nlohmann_json source from https://github.com/nlohmann/json/releases/download/v3.11.2/include.zip
[camera]   Cloning into 'libyaml'...
[camera]   
[camera]   HEAD is now at 2c891fc Changes for v0.2.5 release
[camera]   
[camera]   Executing subproject libpisp:nlohmann_json
[camera]   nlohmann_json| DEPRECATION: Option 'v4l2' value 'true' is replaced by 'enabled'
[camera]   nlohmann_json| Project name: nlohmann_json
[camera]   nlohmann_json| Project version: 3.11.2
[camera]   nlohmann_json| C++ compiler for the host machine: c++ (gcc 13.3.0 "c++ (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   nlohmann_json| C++ linker for the host machine: c++ ld.bfd 2.42
[camera]   nlohmann_json| Build targets in project: 25
[camera]   nlohmann_json| Subproject nlohmann_json finished.
[camera]   libpisp| Dependency nlohmann_json from subproject subprojects/nlohmann_json-3.11.2 found: YES 3.11.2
[camera]   libpisp| Dependency threads found: YES unknown (cached)
[camera]   libpisp| Library dl found: YES
[camera]   libpisp| Run-time dependency Boost (missing: log, log_setup, system, thread) found: NO (tried system)
[camera]   libpisp| Build targets in project: 27
[camera]   libpisp| Subproject libpisp finished.
[camera]   Dependency libpisp from subproject subprojects/libpisp found: YES 1.2.0
[camera]   Checking for function "dlopen" : YES 
[camera]   Run-time dependency libudev found: YES 255
[camera]   Run-time dependency yaml-0.1 found: NO (tried pkgconfig and cmake)
[camera]   Run-time dependency gnutls found: YES 3.8.3
[camera]   Executing subproject libyaml method cmake 
[camera]   libyaml| Found CMake: /usr/bin/cmake (3.28.3)
[camera]   | Configuring the build directory with CMake version 3.28.3
[camera]   | Running CMake with: -G Ninja -DCMAKE_INSTALL_PREFIX=/usr/local -DCMAKE_POSITION_INDEPENDENT_CODE=ON
[camera]   | - build directory:          /libcamera/build/subprojects/libyaml/__CMake_build
[camera]   | - source directory:         /libcamera/subprojects/libyaml
[camera]   | - toolchain file:           /libcamera/build/subprojects/libyaml/__CMake_build/CMakeMesonToolchainFile.cmake
[camera]   | - preload file:             /usr/lib/python3/dist-packages/mesonbuild/cmake/data/preload.cmake
[camera]   | - trace args:               --trace-expand --trace-format=json-v1 --no-warn-unused-cli --trace-redirect=cmake_trace.txt
[camera]   | - disabled policy warnings: [CMP0025, CMP0047, CMP0056, CMP0060, CMP0065, CMP0066, CMP0067, CMP0082, CMP0089, CMP0102]
[camera]   | CMake Deprecation Warning at CMakeLists.txt:2 (cmake_minimum_required):
[camera]   | Compatibility with CMake < 3.5 will be removed from a future version of
[camera]   | CMake.
[camera]   | Update the VERSION argument <min> value or use a ...<max> suffix to tell
[camera]   | CMake that the project does not need compatibility with older versions.
[camera]   | Put cmake in trace mode, but with variables expanded.
[camera]   | Put cmake in trace mode and sets the trace output format.
[camera]   | Not searching for unused variables given on the command line.
[camera]   | Put cmake in trace mode and redirect trace output to a file instead of stderr.
[camera]   | Trace will be written to cmake_trace.txt
[camera]   | -- The C compiler identification is GNU 13.3.0
[camera]   | -- Detecting C compiler ABI info
[camera]   | -- Detecting C compiler ABI info - done
[camera]   | -- Check for working C compiler: /usr/bin/cc - skipped
[camera]   | -- Detecting C compile features
[camera]   | -- Detecting C compile features - done
[camera]   | -- Configuring done (0.3s)
[camera]   | -- Generating done (0.0s)
[camera]   | -- Build files have been written to: /libcamera/build/subprojects/libyaml/__CMake_build
[camera]   libyaml| CMake configuration: SUCCEEDED
[camera]   libyaml| CMake project yaml has 42 build targets.
[camera]   libyaml| Generated Meson AST: /libcamera/build/subprojects/libyaml/meson.build
[camera]   libyaml| DEPRECATION: Option 'v4l2' value 'true' is replaced by 'enabled'
[camera]   libyaml| Project name: yaml
[camera]   libyaml| Project version: undefined
[camera]   libyaml| C compiler for the host machine: cc (gcc 13.3.0 "cc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0")
[camera]   libyaml| C linker for the host machine: cc ld.bfd 2.42
[camera]   libyaml| Build targets in project: 70
[camera]   libyaml| Subproject libyaml finished.
[camera]   Dependency libexif skipped: feature android disabled
[camera]   Dependency libjpeg skipped: feature android disabled
[camera]   Dependency libevent_pthreads skipped: feature cam disabled
[camera]   Dependency libevent_pthreads skipped: feature lc-compliance disabled
[camera]   Run-time dependency libtiff-4 found: YES 4.5.1
[camera]   Dependency gtest skipped: feature lc-compliance disabled
[camera]   Dependency qt6 (modules: Core, Gui, OpenGL, OpenGLWidgets, Widgets) skipped: feature qcam disabled
[camera]   Run-time dependency glib-2.0 found: YES 2.80.0
[camera]   Run-time dependency gstreamer-video-1.0 found: YES 1.24.2
[camera]   Run-time dependency gstreamer-allocators-1.0 found: YES 1.24.2
[camera]   Run-time dependency python3 found: YES 3.11
[camera]   Run-time dependency pybind11 found: YES 2.11.1
[camera]   Configuring libcamerify using configuration
[camera]   Program doxygen skipped: feature documentation disabled
[camera]   Program dot skipped: feature documentation disabled
[camera]   Program sphinx-build-3 found: NO
[camera]   Program sphinx-build skipped: feature documentation disabled
[camera]   Configuring config.h using configuration
[camera]   Program python3 (jinja2, yaml, jinja2, ply) found: YES (/usr/local/bin/python3) modules: jinja2, yaml, jinja2, ply
[camera]   Build targets in project: 94
[camera]   libcamera 0.5.0
[camera]     Versions
[camera]       Sources                  : 0.5.0
[camera]     Paths
[camera]       LIBCAMERA_DATA_DIR       : "/usr/local/share/libcamera"
[camera]       LIBCAMERA_SYSCONF_DIR    : "/usr/local/etc/libcamera"
[camera]       IPA_PROXY_DIR            : "/usr/local/libexec/libcamera"
[camera]       IPA_CONFIG_DIR           : "/usr/local/etc/libcamera/ipa:/usr/local/share/libcamera/ipa"
[camera]       IPA_MODULE_DIR           : "/usr/local/lib/aarch64-linux-gnu/libcamera"
[camera]     Configuration
[camera]       SoftISP support          : false
[camera]       IPA modules signed with  : gnutls
[camera]       Enabled pipelines        : rpi/vc4
[camera]                                  rpi/pisp
[camera]       Enabled IPA modules      : rpi/vc4
[camera]                                  rpi/pisp
[camera]       Controls files           : control_ids_core.yaml
[camera]                                  control_ids_debug.yaml
[camera]                                  control_ids_draft.yaml
[camera]                                  control_ids_rpi.yaml
[camera]       Properties files         : property_ids_draft.yaml
[camera]                                  property_ids_core.yaml
[camera]       Hotplug support          : YES
[camera]       Tracing support          : NO
[camera]       Android support          : NO
[camera]       GStreamer support        : YES
[camera]       Python bindings          : YES
[camera]       V4L2 emulation support   : YES
[camera]       cam application          : NO
[camera]       qcam application         : NO
[camera]       lc-compliance application: NO
[camera]       Unit tests               : NO
[camera]     Subprojects
[camera]       libpisp                  : YES 1 warnings
[camera]       libyaml                  : YES
[camera]       nlohmann_json            : YES (from libpisp)
[camera]     User defined options
[camera]       buildtype                : release
[camera]       cam                      : disabled
[camera]       documentation            : disabled
[camera]       gstreamer                : enabled
[camera]       ipas                     : rpi/vc4,rpi/pisp
[camera]       lc-compliance            : disabled
[camera]       pipelines                : rpi/vc4,rpi/pisp
[camera]       pycamera                 : enabled
[camera]       qcam                     : disabled
[camera]       test                     : false
[camera]       v4l2                     : true
[camera]   Found ninja-1.11.1 at /usr/bin/ninja
[camera]   [1/254] Generating subprojects/libpisp/src/libpisp/backend/Default config to build dir with a custom command
[camera]   [2/254] Generating include/libcamera/property_ids_core.yaml_h with a custom command (wrapped by meson to set env)
[camera]   FAILED: include/libcamera/property_ids.h 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/gen-controls.py -o include/libcamera/property_ids.h --mode properties -t ../include/libcamera/control_ids.h.in -r ../include/libcamera/../../src/libcamera/control_ranges.yaml ../include/libcamera/../../src/libcamera/property_ids_draft.yaml ../include/libcamera/../../src/libcamera/property_ids_core.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/gen-controls.py", line 10, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [3/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_common_pisp_logging.cpp.o
[camera]   [4/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/flags.cpp.o
[camera]   [5/254] Generating src/py/libcamera/py_gen_properties with a custom command (wrapped by meson to set env)
[camera]   FAILED: src/py/libcamera/py_properties_generated.cpp 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/src/py/libcamera/gen-py-controls.py --mode properties -o src/py/libcamera/py_properties_generated.cpp -t ../src/py/libcamera/py_controls_generated.cpp.in ../include/libcamera/../../src/libcamera/property_ids_draft.yaml ../include/libcamera/../../src/libcamera/property_ids_core.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/src/py/libcamera/gen-py-controls.py", line 7, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [6/254] Generating src/libcamera/controls_ids_cpp with a custom command (wrapped by meson to set env)
[camera]   FAILED: src/libcamera/control_ids.cpp 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/gen-controls.py -o src/libcamera/control_ids.cpp --mode controls -t ../src/libcamera/control_ids.cpp.in -r ../src/libcamera/control_ranges.yaml ../include/libcamera/../../src/libcamera/control_ids_core.yaml ../include/libcamera/../../src/libcamera/control_ids_debug.yaml ../include/libcamera/../../src/libcamera/control_ids_draft.yaml ../include/libcamera/../../src/libcamera/control_ids_rpi.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/gen-controls.py", line 10, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [7/254] Generating src/gstreamer/gstlibcamera-controls.cpp with a custom command (wrapped by meson to set env)
[camera]   FAILED: src/gstreamer/gstlibcamera-controls.cpp 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/gen-gst-controls.py -o src/gstreamer/gstlibcamera-controls.cpp -t ../src/gstreamer/gstlibcamera-controls.cpp.in ../include/libcamera/../../src/libcamera/control_ids_core.yaml ../include/libcamera/../../src/libcamera/control_ids_debug.yaml ../include/libcamera/../../src/libcamera/control_ids_draft.yaml ../include/libcamera/../../src/libcamera/control_ids_rpi.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/gen-gst-controls.py", line 13, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [8/254] Generating src/libcamera/properties_ids_cpp with a custom command (wrapped by meson to set env)
[camera]   FAILED: src/libcamera/property_ids.cpp 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/gen-controls.py -o src/libcamera/property_ids.cpp --mode properties -t ../src/libcamera/control_ids.cpp.in -r ../src/libcamera/control_ranges.yaml ../include/libcamera/../../src/libcamera/property_ids_draft.yaml ../include/libcamera/../../src/libcamera/property_ids_core.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/gen-controls.py", line 10, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [9/254] Generating src/py/libcamera/py_gen_controls with a custom command (wrapped by meson to set env)
[camera]   FAILED: src/py/libcamera/py_controls_generated.cpp 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/src/py/libcamera/gen-py-controls.py --mode controls -o src/py/libcamera/py_controls_generated.cpp -t ../src/py/libcamera/py_controls_generated.cpp.in ../include/libcamera/../../src/libcamera/control_ids_core.yaml ../include/libcamera/../../src/libcamera/control_ids_debug.yaml ../include/libcamera/../../src/libcamera/control_ids_draft.yaml ../include/libcamera/../../src/libcamera/control_ids_rpi.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/src/py/libcamera/gen-py-controls.py", line 7, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [10/254] Generating include/libcamera/control_ids_rpi.yaml_h with a custom command (wrapped by meson to set env)
[camera]   FAILED: include/libcamera/control_ids.h 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/gen-controls.py -o include/libcamera/control_ids.h --mode controls -t ../include/libcamera/control_ids.h.in -r ../include/libcamera/../../src/libcamera/control_ranges.yaml ../include/libcamera/../../src/libcamera/control_ids_core.yaml ../include/libcamera/../../src/libcamera/control_ids_debug.yaml ../include/libcamera/../../src/libcamera/control_ids_draft.yaml ../include/libcamera/../../src/libcamera/control_ids_rpi.yaml
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/gen-controls.py", line 10, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [11/254] Generating include/libcamera/formats_h with a custom command
[camera]   [12/254] Compiling C object utils/ipu3/ipu3-unpack.p/ipu3-unpack.c.o
[camera]   [13/254] Compiling C object utils/ipu3/ipu3-pack.p/ipu3-pack.c.o
[camera]   [14/254] Generating utils/codegen/ipc/mojom_templates with a custom command (wrapped by meson to set env)
[camera]   FAILED: utils/codegen/ipc/libcamera_templates.zip 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/ipc/./generate.py -o utils/codegen/ipc precompile
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/ipc/./generate.py", line 14, in <module>
[camera]       import mojo.public.tools.bindings.mojom_bindings_generator as generator
[camera]     File "/libcamera/utils/codegen/ipc/mojo/public/tools/bindings/mojom_bindings_generator.py", line 43, in <module>
[camera]       from mojom.generate import template_expander
[camera]     File "/libcamera/utils/codegen/ipc/mojo/public/tools/mojom/mojom/generate/template_expander.py", line 13, in <module>
[camera]       import jinja2
[camera]   ModuleNotFoundError: No module named 'jinja2'
[camera]   [15/254] Generating src/py/libcamera/py_gen_formats with a custom command
[camera]   [16/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_writer.c.o
[camera]   [17/254] Generating include/libcamera/internal/tp_header with a custom command
[camera]   [18/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_dumper.c.o
[camera]   [19/254] Generating src/libcamera/version.cpp with a custom command
[camera]   [20/254] Generating subprojects/libpisp/src/version.cpp with a custom command
[camera]   [21/254] Generating include/libcamera/ipa/core_mojom_module with a custom command (wrapped by meson to set env)
[camera]   FAILED: include/libcamera/ipa/core.mojom-module 
[camera]   env PYTHONDONTWRITEBYTECODE=1 PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/ipc/./parser.py --output-root /libcamera/build --input-root /libcamera --mojoms ../include/libcamera/ipa/core.mojom
[camera]   Traceback (most recent call last):
[camera]     File "/libcamera/utils/codegen/ipc/./parser.py", line 15, in <module>
[camera]       import mojo.public.tools.mojom.mojom_parser as parser
[camera]     File "/libcamera/utils/codegen/ipc/mojo/public/tools/mojom/mojom_parser.py", line 28, in <module>
[camera]       from mojom.parse import parser
[camera]     File "/libcamera/utils/codegen/ipc/./mojo/public/tools/mojom/mojom/parse/parser.py", line 15, in <module>
[camera]       from mojom.parse.lexer import Lexer
[camera]     File "/libcamera/utils/codegen/ipc/./mojo/public/tools/mojom/mojom/parse/lexer.py", line 12, in <module>
[camera]       from ply.lex import TOKEN
[camera]   ModuleNotFoundError: No module named 'ply'
[camera]   [22/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_reader.c.o
[camera]   [23/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_loader.c.o
[camera]   [24/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/class.cpp.o
[camera]   [25/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/mutex.cpp.o
[camera]   [26/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/semaphore.cpp.o
[camera]   [27/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_parser.c.o
[camera]   [28/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_api.c.o
[camera]   [29/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_input_stage.cpp.o
[camera]   [30/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_output_stage.cpp.o
[camera]   [31/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_variants_variant.cpp.o
[camera]   [32/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_context_stage.cpp.o
[camera]   [33/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_stages.cpp.o
[camera]   [34/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_frontend_frontend.cpp.o
[camera]   [35/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_rescale_stage.cpp.o
[camera]   [36/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/signal.cpp.o
[camera]   [37/254] Generating src/ipa-priv-key with a custom command
[camera]   .+............+.+.....+.+...+...........+.+.....+....+............+............+..+...............+....+..+...+......+..........+...........+...+.+.........+.....+................+........+..........+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+........+......+.+...+......+.....................+............+...+..+...+.......+.....+.+..+.......+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
[camera]   .+.......+......+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+...+..+.............+...+.........+...+..+...+...............+.......+.....+...+...+......+.+..+.......+.....+...+...+..........+.....+....+...+..+.........+....+......+..+....+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+......+..+.+......+........+...+...+.+......+..+......+....+..+................+...+..+....+........+.+..+.............+..+.........+.........+.......+..+.+......+...+...+..+...+......................+............+........+...+....+.........+.....+.+...+.....+.......+........+......+.......+.....+....+...+..+..................+...+.........+....+.....+....+........+.........+...+.+......+...........+...+....+.....+.......+......+........+.......+.........+.........+.....+.+......+..+.+......+.....+.+.........+......+..+.....................+....+...+...+..+...+.......+..............+.............+............+...+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
[camera]   [38/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_crop_stage.cpp.o
[camera]   [39/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_pipeline.cpp.o
[camera]   [40/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_pisp_tiling.cpp.o
[camera]   [41/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_tiling_split_stage.cpp.o
[camera]   [42/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/event_dispatcher.cpp.o
[camera]   [43/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/unique_fd.cpp.o
[camera]   [44/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_common_pisp_utils.cpp.o
[camera]   [45/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/message.cpp.o
[camera]   [46/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/memfd.cpp.o
[camera]   [47/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/bound_method.cpp.o
[camera]   [48/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/shared_fd.cpp.o
[camera]   [49/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_backend.cpp.o
[camera]   [50/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/event_notifier.cpp.o
[camera]   [51/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/timer.cpp.o
[camera]   [52/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/utils.cpp.o
[camera]   [53/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/file.cpp.o
[camera]   [54/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/backtrace.cpp.o
[camera]   [55/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/object.cpp.o
[camera]   [56/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/helpers_v4l2_device.cpp.o
[camera]   [57/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/event_dispatcher_poll.cpp.o
[camera]   [58/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/thread.cpp.o
[camera]   [59/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_emitter.c.o
[camera]   [60/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_backend_prepare.cpp.o
[camera]   [61/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/helpers_backend_device.cpp.o
[camera]   [62/254] Compiling C object subprojects/libyaml/libyaml.a.p/src_scanner.c.o
[camera]   [63/254] Compiling C++ object src/libcamera/base/libcamera-base.so.0.5.0.p/log.cpp.o
[camera]   [64/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_common_pisp_pwl.cpp.o
[camera]   [65/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/helpers_media_device.cpp.o
[camera]   [66/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_backend_default_config.cpp.o
[camera]   [67/254] Compiling C++ object subprojects/libpisp/src/libpisp.so.1.2.0.p/libpisp_backend_backend_debug.cpp.o
[camera]   ninja: build stopped: subcommand failed.
[camera]   Removing intermediate container 5757fdd6a9fc
[camera]   The command '/bin/sh -c cd libcamera &&     git submodule update --init &&     meson setup build --buildtype=release -Dpipelines=rpi/vc4,rpi/pisp -Dipas=rpi/vc4,rpi/pisp -Dv4l2=true -Dgstreamer=enabled -Dtest=false -Dlc-compliance=disabled -Dcam=disabled -Dqcam=disabled -Ddocumentation=disabled -Dpycamera=enabled &&     cd build &&     ninja &&     ninja install' returned a non-zero code: 1
[Info]     Uploading images
[Success]  Successfully uploaded images
[Error]    Some services failed to build:
[Error]      Service: camera
[Error]        Error: The command '/bin/sh -c cd libcamera &&     git submodule update --init &&     meson setup build --buildtype=release -Dpipelines=rpi/vc4,rpi/pisp -Dipas=rpi/vc4,rpi/pisp -Dv4l2=true -Dgstreamer=enabled -Dtest=false -Dlc-compliance=disabled -Dcam=disabled -Dqcam=disabled -Ddocumentation=disabled -Dpycamera=enabled &&     cd build &&     ninja &&     ninja install' returned a non-zero code: 1
[Info]     Built on c617b98
[Error]    Not deploying release.
Remote build failed

[meawoppl]

There is something in meson.build that overwrited the PYTHONPATH variable before running the generation scripts. I don't understand meson well enough to triage, but if I add the needed path back in in utils/codgen/build.meson things work again.

[naushir]

PYTHONPATH gets set in the meson.build file here:

libcamera/utils/codegen/meson.build

Line 8 in d83ff0a

py_build_env.prepend('PYTHONPATH', meson.current_source_dir())

But the same build config works for me, so I don't think it's the direct cause of the failure.

@kbingham any thoughts about this build error? jinja2 seems to have been located by meson, but the gen-controls script fails to import the module.

[naushir]

@meawoppl are you building libcamera from within a virtual environment?

[kbingham]

@meawoppl Can you explain what you mean by "Add the needed path back" means ? Are you manually setting it entirely? Are you adding something that was otherwise set by your more global system environment, or are you adding back in a path that libcamera needs to function ?

I see this line in the debug prints:

[camera]   env PYTHONDONTWRITEBYTECODE=1 \
PYTHONPATH=/libcamera/utils/codegen /libcamera/utils/codegen/ipc/./parser.py \
 --output-root /libcamera/build \
--input-root /libcamera \
--mojoms ../include/libcamera/ipa/core.mojom

What's env PYTHONDONTWRITEBYTECODE=1 coming from?

I wonder if for some reason meson is not getting the PYTHONPATH - so when it's performing the prepend - we only end up with PYTHONPATH=/libcamera/utils/codegen ?

[naushir]

What's env PYTHONDONTWRITEBYTECODE=1 coming from?

This comes from the meson build file:

libcamera/utils/codegen/meson.build

Line 7 in d83ff0a

py_build_env.set('PYTHONDONTWRITEBYTECODE', '1')

[kbingham]

Aha, So it looks like that script is indeed completely ignoring any externally set PYTHONPATH ...

py_build_env = environment()
# \todo Investigate usage of PYTHONPYCACHEPREFIX for Python >= 3.8
py_build_env.set('PYTHONDONTWRITEBYTECODE', '1')
py_build_env.prepend('PYTHONPATH', meson.current_source_dir())

Looks like it will only keep those variables in the path - so if @meawoppl's environment is relying on any externally / non-system paths being specified then it wouldn't be accounted for here ?

We certainly need to know more about the build environment to understand or reproduce this ...

I would wonder if

-py_build_env.set('PYTHONDONTWRITEBYTECODE', '1')
+py_build_env.prepend('PYTHONDONTWRITEBYTECODE', '1')

has a material effect here.

[naushir]

@meawoppl any updates on this issue?

[naushir]

Closing now. If this is still occurring, please do reopen the issue.