How to manually include additional modules indirectly needed by the app?

[tigerinus]

I did try to search for similar questions but couldn't find the solution. (Sorry if there is a solution)

Basically the code needs optimum and auto-gptq:

# SENTENCE_TRANSFORMERS_HOME=/DATA TRANSFORMERS_CACHE=/DATA ./dist/server/server
2024-01-02 13:20:09.936960221 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:1983 CreateInferencePybindStateModule] Init provider bridge failed.
Loading model all-MiniLM-L6-v2 ...
Loading vectorstore Chroma ...
Loading LLM TheBloke/Llama-2-13b-Chat-GPTQ ...
Traceback (most recent call last):
  File "server.py", line 202, in <module>
  File "server.py", line 148, in chain
  File "transformers/models/auto/auto_factory.py", line 565, in from_pretrained
  File "transformers/modeling_utils.py", line 2704, in from_pretrained
ImportError: Loading a GPTQ quantized model requires optimum (`pip install optimum`) and auto-gptq library (`pip install auto-gptq`)
[4184700] Failed to execute script 'server' due to unhandled exception!

I tried following approach according to #8155

a = Analysis(
    ....
    module_collection_mode={
        "optimum": "pyz+py",
        "auto-gptq": "pyz+py",
        ...
    },
)

but no luck.

[rokm]

transformers checks for its dependencies by querying their metadata, so you need to ensure that metadata is collected. E.g., --copy-metadata optimum --copy-metadata auto-gptq on command line, or

from PyInstaller.utils.hooks import copy_metadata

datas = []
datas += copy_metadata('optimum')
datas += copy_metadata('auto-gptq')
...
a = Analysis(
    ...,
    datas=datas,
    ...
)

You can also try using the git HEAD of pyinstaller-hooks-contrib, which has a hook for transformers (and should collect the metadata in question out-of-the-box):

pip uninstall pyinstaller-hooks-contrib
pip install https://github.com/pyinstaller/pyinstaller-hooks-contrib/archive/refs/heads/master.zip