Closed
Description
Your current environment
The output of `python collect_env.py`
Your output of `python collect_env.py` here
🐛 Describe the bug
We are currently encountering errors during the build image step of all Buildkite CI pipelines, caused by a failure when installing and building mamba-ssm==2.2.4.
The same issue occurs locally as well. Interestingly, the package installs successfully when using pip, but fails consistently with uv pip, which appears to be triggering a source build instead of using a prebuilt wheel.
Full Log
[2025-04-23T15:00:54Z] #41 35.50 × Failed to build `mamba-ssm==2.2.4`
--
| [2025-04-23T15:00:54Z] #41 35.50 ├─▶ The build backend returned an error
| [2025-04-23T15:00:54Z] #41 35.50 ╰─▶ Call to `setuptools.build_meta.build_wheel` failed (exit status: 1)
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 [stdout]
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 torch.__version__ = 2.7.0+cu126
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 running bdist_wheel
| [2025-04-23T15:00:54Z] #41 35.50 Guessing wheel URL:
| [2025-04-23T15:00:54Z] #41 35.50 https://github.com/state-spaces/mamba/releases/download/v2.2.4/mamba_ssm-2.2.4+cu12torch2.7cxx11abiTRUE-cp312-cp312-linux_x86_64.whl
| [2025-04-23T15:00:54Z] #41 35.50 Precompiled wheel not found. Building from source...
| [2025-04-23T15:00:54Z] #41 35.50 running build
| [2025-04-23T15:00:54Z] #41 35.50 running build_py
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/distributed/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/distributed/distributed_utils.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/distributed/tensor_parallel.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/models
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/models/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/models
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/models/config_mamba.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/models
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/models/mixer_seq_simple.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/models
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/block.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/mamba2.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/mamba2_simple.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/mamba_simple.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/mha.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/mlp.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/modules/ssd_minimal.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/selective_scan_interface.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/utils/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/utils/generation.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/utils/hf.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/utils/torch.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
| [2025-04-23T15:00:54Z] #41 35.50 creating build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/__init__.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/k_activations.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/layer_norm.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/layernorm_gated.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/selective_state_update.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/softplus.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/ssd_bmm.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/ssd_chunk_scan.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/ssd_chunk_state.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/ssd_combined.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 copying mamba_ssm/ops/triton/ssd_state_passing.py ->
| [2025-04-23T15:00:54Z] #41 35.50 build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
| [2025-04-23T15:00:54Z] #41 35.50 running egg_info
| [2025-04-23T15:00:54Z] #41 35.50 writing mamba_ssm.egg-info/PKG-INFO
| [2025-04-23T15:00:54Z] #41 35.50 writing dependency_links to mamba_ssm.egg-info/dependency_links.txt
| [2025-04-23T15:00:54Z] #41 35.50 writing requirements to mamba_ssm.egg-info/requires.txt
| [2025-04-23T15:00:54Z] #41 35.50 writing top-level names to mamba_ssm.egg-info/top_level.txt
| [2025-04-23T15:00:54Z] #41 35.50 reading manifest file 'mamba_ssm.egg-info/SOURCES.txt'
| [2025-04-23T15:00:54Z] #41 35.50 adding license file 'LICENSE'
| [2025-04-23T15:00:54Z] #41 35.50 adding license file 'AUTHORS'
| [2025-04-23T15:00:54Z] #41 35.50 writing manifest file 'mamba_ssm.egg-info/SOURCES.txt'
| [2025-04-23T15:00:54Z] #41 35.50 running build_ext
| [2025-04-23T15:00:54Z] #41 35.50 building 'selective_scan_cuda' extension
| [2025-04-23T15:00:54Z] #41 35.50 creating
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/nDNbeVprJkkwnrHlWVFpv/src/build/temp.linux-x86_64-cpython-312/csrc/selective_scan
| [2025-04-23T15:00:54Z] #41 35.50 ninja: error:
| [2025-04-23T15:00:54Z] #41 35.50 '/root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/nDNbeVprJkkwnrHlWVFpv/src/csrc/selective_scan/selective_scan.cpp',
| [2025-04-23T15:00:54Z] #41 35.50 needed by
| [2025-04-23T15:00:54Z] #41 35.50 '/root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/nDNbeVprJkkwnrHlWVFpv/src/build/temp.linux-x86_64-cpython-312/csrc/selective_scan/selective_scan.o',
| [2025-04-23T15:00:54Z] #41 35.50 missing and no known rule to make it
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 [stderr]
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/_subclasses/functional_tensor.py:276:
| [2025-04-23T15:00:54Z] #41 35.50 UserWarning: Failed to initialize NumPy: No module named 'numpy'
| [2025-04-23T15:00:54Z] #41 35.50 (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:81.)
| [2025-04-23T15:00:54Z] #41 35.50 cpu = _conversion_method_template(device=torch.device("cpu"))
| [2025-04-23T15:00:54Z] #41 35.50 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:82:
| [2025-04-23T15:00:54Z] #41 35.50 SetuptoolsDeprecationWarning: `project.license` as a TOML table is
| [2025-04-23T15:00:54Z] #41 35.50 deprecated
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50 Please use a simple string containing a SPDX expression for
| [2025-04-23T15:00:54Z] #41 35.50 `project.license`. You can also use `project.license-files`. (Both
| [2025-04-23T15:00:54Z] #41 35.50 options available on setuptools>=77.0.0).
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 By 2026-Feb-18, you need to update your project and remove
| [2025-04-23T15:00:54Z] #41 35.50 deprecated calls
| [2025-04-23T15:00:54Z] #41 35.50 or your builds will no longer be supported.
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 See
| [2025-04-23T15:00:54Z] #41 35.50 https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license
| [2025-04-23T15:00:54Z] #41 35.50 for details.
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50 corresp(dist, value, root_dir)
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:82:
| [2025-04-23T15:00:54Z] #41 35.50 SetuptoolsWarning: `install_requires` overwritten in `pyproject.toml`
| [2025-04-23T15:00:54Z] #41 35.50 (dependencies)
| [2025-04-23T15:00:54Z] #41 35.50 corresp(dist, value, root_dir)
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:61:
| [2025-04-23T15:00:54Z] #41 35.50 SetuptoolsDeprecationWarning: License classifiers are deprecated.
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50 Please consider removing the following classifiers in favor of a
| [2025-04-23T15:00:54Z] #41 35.50 SPDX license expression:
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 License :: OSI Approved :: BSD License
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 See
| [2025-04-23T15:00:54Z] #41 35.50 https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license
| [2025-04-23T15:00:54Z] #41 35.50 for details.
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50 dist._finalize_license_expression()
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/dist.py:759:
| [2025-04-23T15:00:54Z] #41 35.50 SetuptoolsDeprecationWarning: License classifiers are deprecated.
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50 Please consider removing the following classifiers in favor of a
| [2025-04-23T15:00:54Z] #41 35.50 SPDX license expression:
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 License :: OSI Approved :: BSD License
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 See
| [2025-04-23T15:00:54Z] #41 35.50 https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license
| [2025-04-23T15:00:54Z] #41 35.50 for details.
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 ********************************************************************************
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 !!
| [2025-04-23T15:00:54Z] #41 35.50 self._finalize_license_expression()
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py:480:
| [2025-04-23T15:00:54Z] #41 35.50 UserWarning: The detected CUDA version (12.4) has a minor version
| [2025-04-23T15:00:54Z] #41 35.50 mismatch with the version that was used to compile PyTorch (12.6). Most
| [2025-04-23T15:00:54Z] #41 35.50 likely this shouldn't be a problem.
| [2025-04-23T15:00:54Z] #41 35.50 warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version,
| [2025-04-23T15:00:54Z] #41 35.50 torch.version.cuda))
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py:490:
| [2025-04-23T15:00:54Z] #41 35.50 UserWarning: There are no x86_64-linux-gnu-g++ version bounds defined
| [2025-04-23T15:00:54Z] #41 35.50 for CUDA version 12.4
| [2025-04-23T15:00:54Z] #41 35.50 warnings.warn(f'There are no {compiler_name} version bounds defined
| [2025-04-23T15:00:54Z] #41 35.50 for CUDA version {cuda_str_version}')
| [2025-04-23T15:00:54Z] #41 35.50 Emitting ninja build file
| [2025-04-23T15:00:54Z] #41 35.50 /root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/nDNbeVprJkkwnrHlWVFpv/src/build/temp.linux-x86_64-cpython-312/build.ninja...
| [2025-04-23T15:00:54Z] #41 35.50 Compiling objects...
| [2025-04-23T15:00:54Z] #41 35.50 Allowing ninja to set a default number of workers... (overridable by
| [2025-04-23T15:00:54Z] #41 35.50 setting the environment variable MAX_JOBS=N)
| [2025-04-23T15:00:54Z] #41 35.50 Traceback (most recent call last):
| [2025-04-23T15:00:54Z] #41 35.50 File "<string>", line 317, in run
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 240, in urlretrieve
| [2025-04-23T15:00:54Z] #41 35.50 with contextlib.closing(urlopen(url, data)) as fp:
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 215, in urlopen
| [2025-04-23T15:00:54Z] #41 35.50 return opener.open(url, data, timeout)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 521, in open
| [2025-04-23T15:00:54Z] #41 35.50 response = meth(req, response)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 630, in
| [2025-04-23T15:00:54Z] #41 35.50 http_response
| [2025-04-23T15:00:54Z] #41 35.50 response = self.parent.error(
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 559, in error
| [2025-04-23T15:00:54Z] #41 35.50 return self._call_chain(*args)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 492, in _call_chain
| [2025-04-23T15:00:54Z] #41 35.50 result = func(*args)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/urllib/request.py", line 639, in
| [2025-04-23T15:00:54Z] #41 35.50 http_error_default
| [2025-04-23T15:00:54Z] #41 35.50 raise HTTPError(req.full_url, code, msg, hdrs, fp)
| [2025-04-23T15:00:54Z] #41 35.50 urllib.error.HTTPError: HTTP Error 404: Not Found
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 During handling of the above exception, another exception occurred:
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 Traceback (most recent call last):
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 2506, in _run_ninja_build
| [2025-04-23T15:00:54Z] #41 35.50 subprocess.run(
| [2025-04-23T15:00:54Z] #41 35.50 File "/usr/lib/python3.12/subprocess.py", line 571, in run
| [2025-04-23T15:00:54Z] #41 35.50 raise CalledProcessError(retcode, process.args,
| [2025-04-23T15:00:54Z] #41 35.50 subprocess.CalledProcessError: Command '['ninja', '-v']' returned
| [2025-04-23T15:00:54Z] #41 35.50 non-zero exit status 1.
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 The above exception was the direct cause of the following exception:
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 Traceback (most recent call last):
| [2025-04-23T15:00:54Z] #41 35.50 File "<string>", line 11, in <module>
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/build_meta.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 432, in build_wheel
| [2025-04-23T15:00:54Z] #41 35.50 return _build(['bdist_wheel'])
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/build_meta.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 423, in _build
| [2025-04-23T15:00:54Z] #41 35.50 return self._build_with_temp_dir(
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/build_meta.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 404, in _build_with_temp_dir
| [2025-04-23T15:00:54Z] #41 35.50 self.run_setup()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/build_meta.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 317, in run_setup
| [2025-04-23T15:00:54Z] #41 35.50 exec(code, locals())
| [2025-04-23T15:00:54Z] #41 35.50 File "<string>", line 336, in <module>
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/__init__.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 117, in setup
| [2025-04-23T15:00:54Z] #41 35.50 return distutils.core.setup(**attrs)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/core.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 186, in setup
| [2025-04-23T15:00:54Z] #41 35.50 return run_commands(dist)
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/core.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 202, in run_commands
| [2025-04-23T15:00:54Z] #41 35.50 dist.run_commands()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1002, in run_commands
| [2025-04-23T15:00:54Z] #41 35.50 self.run_command(cmd)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1104, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 super().run_command(command)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1021, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 cmd_obj.run()
| [2025-04-23T15:00:54Z] #41 35.50 File "<string>", line 334, in run
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 370, in run
| [2025-04-23T15:00:54Z] #41 35.50 self.run_command("build")
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/cmd.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 357, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 self.distribution.run_command(command)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1104, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 super().run_command(command)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1021, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 cmd_obj.run()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/command/build.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 135, in run
| [2025-04-23T15:00:54Z] #41 35.50 self.run_command(cmd_name)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/cmd.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 357, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 self.distribution.run_command(command)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1104, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 super().run_command(command)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/dist.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1021, in run_command
| [2025-04-23T15:00:54Z] #41 35.50 cmd_obj.run()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 99, in run
| [2025-04-23T15:00:54Z] #41 35.50 _build_ext.run(self)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 368, in run
| [2025-04-23T15:00:54Z] #41 35.50 self.build_extensions()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 1010, in build_extensions
| [2025-04-23T15:00:54Z] #41 35.50 build_ext.build_extensions(self)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 484, in build_extensions
| [2025-04-23T15:00:54Z] #41 35.50 self._build_extensions_serial()
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 510, in _build_extensions_serial
| [2025-04-23T15:00:54Z] #41 35.50 self.build_extension(ext)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 264, in build_extension
| [2025-04-23T15:00:54Z] #41 35.50 _build_ext.build_extension(self, ext)
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 565, in build_extension
| [2025-04-23T15:00:54Z] #41 35.50 objects = self.compiler.compile(
| [2025-04-23T15:00:54Z] #41 35.50 ^^^^^^^^^^^^^^^^^^^^^^
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 815, in unix_wrap_ninja_compile
| [2025-04-23T15:00:54Z] #41 35.50 _write_ninja_file_and_compile_objects(
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 2159, in _write_ninja_file_and_compile_objects
| [2025-04-23T15:00:54Z] #41 35.50 _run_ninja_build(
| [2025-04-23T15:00:54Z] #41 35.50 File
| [2025-04-23T15:00:54Z] #41 35.50 "/root/.cache/uv/builds-v0/.tmpsU4Kk1/lib/python3.12/site-packages/torch/utils/cpp_extension.py",
| [2025-04-23T15:00:54Z] #41 35.50 line 2522, in _run_ninja_build
| [2025-04-23T15:00:54Z] #41 35.50 raise RuntimeError(message) from e
| [2025-04-23T15:00:54Z] #41 35.50 RuntimeError: Error compiling objects for extension
| [2025-04-23T15:00:54Z] #41 35.50
| [2025-04-23T15:00:54Z] #41 35.50 hint: This usually indicates a problem with the package or the build
| [2025-04-23T15:00:54Z] #41 35.50 environment.
| [2025-04-23T15:01:28Z] #41 ERROR: process "/bin/sh -c uv pip install --system -r requirements/dev.txt" did not complete successfully: exit code: 1
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.