Unable to pre-compile cpu_adam

[yinxx]

Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\admin\AppData\Local\Temp\pip-install-p66b9m1r\deepspeed\setup.py", line 135, in
abort(f"Unable to pre-compile {op_name}")
File "C:\Users\admin\AppData\Local\Temp\pip-install-p66b9m1r\deepspeed\setup.py", line 43, in abort
assert False, msg
AssertionError: Unable to pre-compile cpu_adam
[WARNING] Torch did not find cuda available, if cross-compiling or running with cpu only you can ignore this message. Adding compute capability for Pascal, Volta, and Turing (compute capabilities 6.0, 6.1, 6.2)
DS_BUILD_OPS=1
[WARNING] One can disable cpu_adam with DS_BUILD_CPU_ADAM=0
[ERROR] Unable to pre-compile cpu_adam

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in C:\Users\admin\AppData\Local\Temp\pip-install-p66b9m1r\deepspeed\

[RezaYazdaniAminabadi]

Hi @yinxx

Can you please paste the whole log to see what caused the issue? Also, how do you install deepspeed?
Can you try running sudo DS_BUILD_CPU_ADAM=1 python setup.py -v install ?
Thanks,
Reza

[PuyangChen]

hi, @RezaYazdaniAminabadi
I have meet this issue too.
here is the whole log:
pip install deepspeed

ERROR: Command errored out with exit status 1:
 command: 'e:\software\python\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\zhuang8\\AppData\\Local\\Temp\\2\\pip-install-w_4dcvu6\\deepspeed\\setup.py'"'"'; __file__='"'"'C:\\Users\\zhuang8\\AppData\\Local\\Temp\\2\\pip-install-w_4dcvu6\\deepspeed\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base pip-egg-info
     cwd: C:\Users\zhuang8\AppData\Local\Temp\2\pip-install-w_4dcvu6\deepspeed\
Complete output (10 lines):
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\zhuang8\AppData\Local\Temp\2\pip-install-w_4dcvu6\deepspeed\setup.py", line 135, in <module>
    abort(f"Unable to pre-compile {op_name}")
  File "C:\Users\zhuang8\AppData\Local\Temp\2\pip-install-w_4dcvu6\deepspeed\setup.py", line 43, in abort
    assert False, msg
AssertionError: Unable to pre-compile cpu_adam
DS_BUILD_OPS=1
 [WARNING]  One can disable cpu_adam with DS_BUILD_CPU_ADAM=0
 [ERROR]  Unable to pre-compile cpu_adam
----------------------------------------

ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

btw, I want to install deepspeed in a Windows server instead of Linux. does the system lead to problem?

thanks,
Puyang

[PuyangChen]

Hi, @yinxx
do you fix this error?

[lostmsu]

Can somebody share any insight about why cpu_adam and some other ops are not supported on Windows?

[Johnz86]

I have the same issue, default pip install and installation from source does not work for me.
I will end up with:

  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: 'c:\tvorba\programovanie\python\gpt3neojupyter\scripts\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Tvorba\\Programovanie\\Python\\gpt3neojupyter\\DeepSpeed\\setup.py'"'"'; __file__='"'"'C:\\Tvorba\\Programovanie\\Python\\gpt3neojupyter\\DeepSpeed\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\jakub\AppData\Local\Temp\pip-pip-egg-info-oop7kp6y'
       cwd: C:\Tvorba\Programovanie\Python\gpt3neojupyter\DeepSpeed\
  Complete output (10 lines):
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\Tvorba\Programovanie\Python\gpt3neojupyter\DeepSpeed\setup.py", line 138, in <module>
      abort(f"Unable to pre-compile {op_name}")
    File "C:\Tvorba\Programovanie\Python\gpt3neojupyter\DeepSpeed\setup.py", line 43, in abort
      assert False, msg
  AssertionError: Unable to pre-compile cpu_adam
  DS_BUILD_OPS=1
   [WARNING]  One can disable cpu_adam with DS_BUILD_CPU_ADAM=0
   [ERROR]  Unable to pre-compile cpu_adam

[lostmsu]

This should have been fixed by #1634

[tjruwase]

@lostmsu, thanks for fixing this.

@yinxx, can you please confirm the fix so this can be closed?

[loadams]

Closing this for now as the issue appears to be resolved.