Does not handle a lack of internet well

[aarongerber]

The script is being run in an isolated VM (no internet) with GPU passthrough. The only way to get the script to start is to enable Internet at the start.

python demo_gradio.py
Currently enabled native sdp backends: ['flash', 'math', 'mem_efficient', 'cudnn']
Xformers is not installed!
Flash Attn is not installed!
Sage Attn is not installed!
Namespace(share=False, server='0.0.0.0', port=None, inbrowser=False)
Free VRAM 23.32470703125 GB
High-VRAM Mode: False
Downloading shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 9243.65it/s]
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 6.10it/s]
Traceback (most recent call last):
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 60, in create_connection
for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
File "/usr/lib/python3.10/socket.py", line 955, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 488, in _make_request
raise new_e
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 464, in _make_request
self._validate_conn(conn)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
conn.connect()
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connection.py", line 704, in connect
self.sock = sock = self._new_conn()
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connection.py", line 205, in _new_conn
raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x79c4b2194af0>: Failed to resolve 'huggingface.co' ([Errno -2] Name or service not known)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/lllyasviel/FramePackI2V_HY (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x79c4b2194af0>: Failed to resolve 'huggingface.co' ([Errno -2] Name or service not known)"))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/linux/Desktop/popos-data/FramePack/demo_gradio.py", line 58, in
transformer = HunyuanVideoTransformer3DModelPacked.from_pretrained('lllyasviel/FramePackI2V_HY', torch_dtype=torch.bfloat16).cpu()
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 1109, in from_pretrained
resolved_model_file, sharded_metadata = _get_checkpoint_shard_files(
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/diffusers/utils/hub_utils.py", line 407, in _get_checkpoint_shard_files
model_files_info = model_info(pretrained_model_name_or_path, revision=revision, token=token)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/huggingface_hub/hf_api.py", line 2591, in model_info
r = get_session().get(path, headers=headers, timeout=timeout, params=params)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 96, in send
return super().send(request, *args, **kwargs)
File "/home/linux/Desktop/popos-data/FramePack/venv/lib/python3.10/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: (MaxRetryError('HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/lllyasviel/FramePackI2V_HY (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x79c4b2194af0>: Failed to resolve 'huggingface.co' ([Errno -2] Name or service not known)"))'), '(Request ID: 69a17fe2-c536-4c56-88b8-b83c67b179eb)')

[LentoMan]

Looks like the second part regarding model_info that was mentioned in this huggingface_hub pull request was never fully implemented and it appears that model_info is still doesn't handle offline mode properly for diffusers?

Setting HF_HUB_OFFLINE=1 doesn't work either, but a quick fix that appears to work:

Make a copy of demo_gradio.py to demo_gradio_offline.py and change:

transformer = HunyuanVideoTransformer3DModelPacked.from_pretrained('lllyasviel/FramePackI2V_HY', torch_dtype=torch.bfloat16).cpu()

to:

transformer_path = os.path.join(os.environ.get('HF_HOME'), 'hub', 'models--lllyasviel--FramePackI2V_HY', 'snapshots', '86cef4396041b6002c957852daac4c91aaa47c79')
transformer = HunyuanVideoTransformer3DModelPacked.from_pretrained(transformer_path, torch_dtype=torch.bfloat16).cpu()

Then launch the demo_gradio_offline.py version instead when working offline.

[aarongerber]

I can confirm that fixes it. Wish I could have worked through that on my own as fast as you did. I've seen this elsewhere so it makes sense it's not in lllyasviel's code proper.

Not sure if lllyasviel wants to make and edit or let it lie so I'll leave it to lllyasviel

[z80-2024]

Hello! I’m very happy to have found your solution. I was facing the same problem for several days.
Thanks to your help, we can now create videos even in an offline environment. I look forward to creating great videos using this solution.

Thank you so much.

[FySyde]

LentoMan - Hello, your answer was very helpful - thank you very much)) Only the file "demo_gradio.py" does not need to be replaced with the name "demo_gradio_offline.py" - just make a backup copy somewhere, replace the lines of code and everything works perfectly both with and without the Internet))