Unable to run example.py

[jessebikman]

I am running torchrun --nproc_per_node 1 example.py --ckpt_dir ./7B/ --tokenizer_path ./tokenizer.model

and my output is

NOTE: Redirects are currently not supported in Windows or MacOs.
Traceback (most recent call last):
  File "/opt/homebrew/bin/torchrun", line 33, in <module>
    sys.exit(load_entry_point('torch==1.13.0a0+git49444c3', 'console_scripts', 'torchrun')())
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 346, in wrapper
    return f(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/run.py", line 762, in main
    run(args)
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/run.py", line 753, in run
    elastic_launch(
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 132, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 237, in launch_agent
    result = agent.run()
             ^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
    result = f(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 709, in run
    result = self._invoke_run(role)
             ^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 844, in _invoke_run
    self._initialize_workers(self._worker_group)
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
    result = f(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/api.py", line 681, in _initialize_workers
    worker_ids = self._start_workers(worker_group)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/metrics/api.py", line 129, in wrapper
    result = f(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/agent/server/local_elastic_agent.py", line 271, in _start_workers
    self._pcontext = start_processes(
                     ^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/__init__.py", line 207, in start_processes
    redirs = to_map(redirects, nprocs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/torch/distributed/elastic/multiprocessing/api.py", line 162, in to_map
    map[i] = val_or_map.get(i, Std.NONE)
             ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
(base)

Any idea what's happening here?

[dondaha]

In Windows, I met the same problem.But in Ubuntu, it's okay.

[neuhaus]

You need to provide more information about your OS, python, the libraries and their versions and your GPU.

[jessebikman]

@neuhaus Thank you for suggesting that. Here is the information:

MacOS Ventura 13.2.1 (22D68) with M1 Pro, 16 core GPU, 16 GB RAM

Python 3.11.2

Here's my output from pip list

Package                            Version
---------------------------------- ---------------
alabaster                          0.7.12
anaconda-client                    1.7.2
anaconda-navigator                 1.9.6
anaconda-project                   0.8.2
appnope                            0.1.0
appscript                          1.0.1
asn1crypto                         0.24.0
astroid                            2.1.0
astropy                            3.1
atomicwrites                       1.2.1
attrs                              18.2.0
Babel                              2.6.0
backcall                           0.1.0
backports.os                       0.1.1
backports.shutil-get-terminal-size 1.0.0
beautifulsoup4                     4.6.3
bitarray                           0.8.3
bkcharts                           0.2
blaze                              0.11.3
bleach                             3.0.2
bokeh                              1.0.2
boto                               2.49.0
Bottleneck                         1.2.1
certifi                            2022.12.7
cffi                               1.11.5
chardet                            3.0.4
Click                              7.0
cloudpickle                        0.6.1
clyent                             1.2.2
colorama                           0.4.1
conda                              23.1.0
conda-build                        3.23.3
conda-package-handling             2.0.2
conda_package_streaming            0.7.0
conda-verify                       3.1.1
contextlib2                        0.5.5
cryptography                       2.4.2
cycler                             0.10.0
Cython                             0.29.2
cytoolz                            0.9.0.1
dask                               1.0.0
datashape                          0.5.4
decorator                          4.3.0
defusedxml                         0.5.0
distributed                        1.25.1
docutils                           0.14
entrypoints                        0.2.3
et-xmlfile                         1.0.1
fairscale                          0.4.6
fastcache                          1.0.2
filelock                           3.0.10
fire                               0.5.0
Flask                              1.0.2
Flask-Cors                         3.0.7
flit_core                          3.6.0
fsspec                             2022.11.0
future                             0.17.1
gevent                             1.3.7
glob2                              0.6
gmpy2                              2.0.8
greenlet                           0.4.15
h5py                               2.8.0
heapdict                           1.0.0
html5lib                           1.0.1
idna                               2.8
imageio                            2.4.1
imagesize                          1.1.0
importlib-metadata                 6.0.0
ipykernel                          5.1.0
ipython                            7.2.0
ipython_genutils                   0.2.0
ipywidgets                         7.4.2
isort                              4.3.4
itsdangerous                       1.1.0
jdcal                              1.4
jedi                               0.13.2
Jinja2                             2.10
joblib                             1.1.1
json5                              0.9.6
jsonschema                         2.6.0
jupyter                            1.0.0
jupyter-client                     5.2.4
jupyter-console                    6.0.0
jupyter-core                       4.4.0
jupyterlab                         0.35.3
jupyterlab-server                  0.2.0
keyring                            17.0.0
kiwisolver                         1.0.1
lazy-object-proxy                  1.3.1
libarchive-c                       2.8
lief                               0.9.0
llvmlite                           0.26.0
locket                             0.2.0
lxml                               4.2.5
MarkupSafe                         1.1.0
matplotlib                         3.0.2
mccabe                             0.6.1
mistune                            0.8.4
mkl-fft                            1.0.6
mkl-random                         1.0.2
mkl-service                        2.3.0
mock                               4.0.3
more-itertools                     4.3.0
mpmath                             1.1.0
msgpack                            0.5.6
multipledispatch                   0.6.0
navigator-updater                  0.2.1
nbconvert                          5.4.0
nbformat                           4.4.0
networkx                           2.2
nltk                               3.4
nose                               1.3.7
notebook                           5.7.4
numba                              0.41.0
numexpr                            2.6.8
numpy                              1.19.2
numpydoc                           0.8.0
odo                                0.5.1
olefile                            0.46
openpyxl                           2.5.12
packaging                          18.0
pandas                             0.23.4
pandocfilters                      1.4.2
parso                              0.3.1
partd                              0.3.9
path.py                            11.5.0
pathlib2                           2.3.3
patsy                              0.5.1
pep8                               1.7.1
pexpect                            4.6.0
pickleshare                        0.7.5
Pillow                             5.3.0
pip                                23.0.1
pkginfo                            1.4.2
pluggy                             1.0.0
ply                                3.11
prometheus-client                  0.5.0
prompt-toolkit                     2.0.7
psutil                             5.4.8
ptyprocess                         0.6.0
py                                 1.7.0
pycodestyle                        2.4.0
pycosat                            0.6.3
pycparser                          2.19
pycrypto                           2.6.1
pycurl                             7.43.0.2
pyflakes                           2.0.0
Pygments                           2.3.1
pylint                             2.2.2
pyodbc                             4.0.25
pyOpenSSL                          18.0.0
pyparsing                          2.3.0
pyrsistent                         0.18.0
PySocks                            1.6.8
pytest                             4.0.2
pytest-arraydiff                   0.3
pytest-astropy                     0.5.0
pytest-doctestplus                 0.2.0
pytest-openfiles                   0.3.1
pytest-remotedata                  0.3.1
python-dateutil                    2.7.5
pytz                               2018.7
PyWavelets                         1.0.1
PyYAML                             3.13
pyzmq                              17.1.2
QtAwesome                          0.5.3
qtconsole                          4.4.3
QtPy                               1.5.2
requests                           2.21.0
rope                               0.11.0
ruamel.yaml                        0.17.21
ruamel_yaml                        0.15.46
ruamel.yaml.clib                   0.2.6
scikit-image                       0.14.1
scikit-learn                       0.20.1
scipy                              1.1.0
seaborn                            0.9.0
Send2Trash                         1.5.0
sentencepiece                      0.1.97
setuptools                         67.4.0
simplegeneric                      0.8.1
singledispatch                     3.4.0.3
six                                1.12.0
snowballstemmer                    1.2.1
sortedcollections                  1.0.1
sortedcontainers                   2.1.0
soupsieve                          2.3.2.post1
Sphinx                             1.8.2
sphinxcontrib-applehelp            1.0.2
sphinxcontrib-devhelp              1.0.2
sphinxcontrib-htmlhelp             2.0.0
sphinxcontrib-jsmath               1.0.1
sphinxcontrib-qthelp               1.0.3
sphinxcontrib-serializinghtml      1.1.5
sphinxcontrib-websupport           1.1.0
spyder                             3.3.2
spyder-kernels                     0.3.0
SQLAlchemy                         1.2.15
statsmodels                        0.9.0
sympy                              1.3
tables                             3.4.4
tblib                              1.3.2
termcolor                          2.2.0
terminado                          0.8.1
testpath                           0.4.2
toml                               0.10.2
toolz                              0.9.0
torch                              1.13.1
torchaudio                         0.7.0a0+a853dff
torchvision                        0.8.2
tornado                            5.1.1
tqdm                               4.28.1
traitlets                          4.3.2
typing_extensions                  4.5.0
unicodecsv                         0.14.1
urllib3                            1.24.1
wcwidth                            0.1.7
webencodings                       0.5.1
Werkzeug                           1.0.1
wheel                              0.32.3
widgetsnbextension                 3.4.2
wrapt                              1.10.11
wurlitzer                          1.0.2
xlrd                               1.2.0
XlsxWriter                         1.1.2
xlwings                            0.15.1
xlwt                               1.3.0
zict                               0.1.3
zipp                               3.15.0
zstandard                          0.19.0

[yoroshikun]

Same issue, bumping 👍 Macosx, Monterey, M1Pro 32gb

[yoroshikun]

To avoid this issue, downgrade python. try 3.7~ (use a version manager like asdf, rtx). then make sure to install the requirements using the command.

[yadongwang110]

the same quesiton

[piyushmutha]

any solution found? I'm facing the same issue in Windows

[amitsangani]

Are you still seeing this issue on Llama 2?

[arferreira]

Same here, I am using a MacBook M1, I will try to downgrade my python to 3.7 to see.