Cannot download Qwen 235B's model-00076-of-00118.safetensors from CLI

[leoleoasd]

Describe the bug

huggingface-cli download Qwen/Qwen3-235B-A22B

Yesterday it worked fine.

Reproduction

No response

Logs

$ uv run huggingface-cli download Qwen/Qwen3-235B-A22B
......

Download complete. Moving file to /tmp/instance_storage/HF/hub/models--Qwen--Qwen3-235B-A22B/blobs/e0a1ffe2e29e70bb6b623a8a307807d03eb189d18f26664f513a1c4f3e5791c8
Traceback (most recent call last): 15%|██████████████████████▏                                                                                                                            | 604M/3.99G [00:05<00:10, 316MB/s]
  File "/workdir/.venv/bin/huggingface-cli", line 10, in <module>
    sys.exit(main()).safetensors:  71%|███████████████████████████████████████████████████████████████████████████████████████████████████████                                           | 2.82G/3.99G [00:09<00:01, 654MB/s]
             ^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/commands/huggingface_cli.py", line 57, in main█████████████████████████████████████▊                                 | 3.09G/3.99G [00:09<00:01, 672MB/s]
    service.run()
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/commands/download.py", line 153, in run██████████████████████████████████████████████████████████████████████████████| 3.99G/3.99G [00:10<00:00, 762MB/s]
    print(self._download())  # Print path to downloaded files
          ^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/commands/download.py", line 187, in _download
    return snapshot_download(
           ^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 297, in snapshot_download
    thread_map(
  File "/workdir/.venv/lib/python3.12/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map
    return _executor_map(ThreadPoolExecutor, fn, *iterables, **tqdm_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map
    return list(tqdm_class(ex.map(fn, *iterables, chunksize=chunksize), **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/tqdm/std.py", line 1181, in __iter__
    for obj in iterable:
               ^^^^^^^^
  File "/root/miniforge3/lib/python3.12/concurrent/futures/_base.py", line 619, in result_iterator
    yield _result_or_cancel(fs.pop())
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniforge3/lib/python3.12/concurrent/futures/_base.py", line 317, in _result_or_cancel
    return fut.result(timeout)
           ^^^^^^^^^^^^^^^^^^^
  File "/root/miniforge3/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/root/miniforge3/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/root/miniforge3/lib/python3.12/concurrent/futures/thread.py", line 59, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 271, in _inner_hf_hub_download
    return hf_hub_download(
           ^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1008, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1159, in _hf_hub_download_to_cache_dir
    _download_to_tmp_and_move(
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1708, in _download_to_tmp_and_move
    xet_get(
  File "/workdir/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 627, in xet_get
    download_files(
RuntimeError: Data processing error: CAS service error : Other Internal Error: JoinError::Panic(Id(20331), "index out of bounds: the len is 5 but the index is 5", ...)

System info

- huggingface_hub version: 0.31.1
- Platform: Linux-5.10.228-219.884.amzn2.x86_64-x86_64-with-glibc2.35
- Python version: 3.12.8
- Running in iPython ?: No
- Running in notebook ?: No
- Running in Google Colab ?: No
- Running in Google Colab Enterprise ?: No
- Token path ?: /tmp/instance_storage/HF/token
- Has saved token ?: False
- Configured git credential helpers:
- FastAI: N/A
- Tensorflow: N/A
- Torch: 2.6.0
- Jinja2: 3.1.6
- Graphviz: N/A
- keras: N/A
- Pydot: N/A
- Pillow: 11.2.1
- hf_transfer: 0.1.9
- gradio: N/A
- tensorboard: N/A
- numpy: 2.2.5
- pydantic: 2.11.4
- aiohttp: 3.11.18
- hf_xet: 1.1.0
- ENDPOINT: https://huggingface.co
- HF_HUB_CACHE: /tmp/instance_storage/HF/hub
- HF_ASSETS_CACHE: /tmp/instance_storage/HF/assets
- HF_TOKEN_PATH: /tmp/instance_storage/HF/token
- HF_STORED_TOKENS_PATH: /tmp/instance_storage/HF/stored_tokens
- HF_HUB_OFFLINE: False
- HF_HUB_DISABLE_TELEMETRY: False
- HF_HUB_DISABLE_PROGRESS_BARS: None
- HF_HUB_DISABLE_SYMLINKS_WARNING: False
- HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False
- HF_HUB_DISABLE_IMPLICIT_TOKEN: False
- HF_HUB_ENABLE_HF_TRANSFER: False
- HF_HUB_ETAG_TIMEOUT: 10
- HF_HUB_DOWNLOAD_TIMEOUT: 10

[leoleoasd]

Seems that it fails with the same file (https://huggingface.co/Qwen/Qwen3-235B-A22B/blob/main/model-00076-of-00118.safetensors), if I manually download it into the cache dir

wget https://huggingface.co/Qwen/Qwen3-235B-A22B/resolve/main/model-00076-of-00118.safetensors -o 79e9d8c532fd1e1ef6b6fd1a1c8a86ac473c0a281054e142ce046e1ebdc3c8c3

then it's working fine.

[hanouticelina]

Hi @leoleoasd,
sorry for the inconvenience. The issue seems related to hf_xet, could you upgrade the version of hf_xet to latest (hf_xet==1.1.2) and try again?

cc @rajatarya

[leoleoasd]

I think this is a server issue, I tried today with the same environment and it was working again.

[hanouticelina]

Thanks for the heads up! don't hesitate to comment here if you get the same error in the future

[ShayekhBinIslam]

Hi @leoleoasd, sorry for the inconvenience. The issue seems related to hf_xet, could you upgrade the version of hf_xet to latest (hf_xet==1.1.2) and try again?

cc @rajatarya

Solved by using hf_xet==1.1.2. hf_xet==1.1.0 was broken. Thanks!

[liujiayi0531]

hf-xet 1.1.2 works for me! 1.1.4 NOT WORK

[rajatarya]

hf-xet 1.1.2 works for me! 1.1.4 NOT WORK

@liujiayi0531 Can you share the error you see with 1.1.4? The changes in 1.1.4 should not cause regressions - so it is suprising that 1.1.2 is working and 1.1.4 is not.

[liujiayi0531]

@rajatarya RuntimeError: Data processing error: CAS service error : ReqwestMiddleware Error: Request failed after 5 retries. I will try to reproduce that tomorrow