Build failure (from source) fatal error: local_scheduler/format/local_scheduler_generated.h: No such file or directory

[ejxqy]

System information

• Linux Ubuntu 18.04:
• Ray installed from source:
• Latest version from git (commit-id: 19d6ca0):
• Python version 3.6.5:
• Exact command to reproduce "python setup.py install":

Describe the problem

Build fails with the error "local_scheduler_generated.h: No such file or directory"

Source code / logs

[ 44%] Building CXX object src/ray/CMakeFiles/ray_objlib.dir/raylet/node_manager.cc.o
/home/js/ray/src/ray/raylet/node_manager.cc:4:10: fatal error: local_scheduler/format/local_scheduler_generated.h: No such file or directory
#include "local_scheduler/format/local_scheduler_generated.h"
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
src/ray/CMakeFiles/ray_objlib.dir/build.make:413: recipe for target 'src/ray/CMakeFiles/ray_objlib.dir/raylet/node_manager.cc.o' failed
make[2]: *** [src/ray/CMakeFiles/ray_objlib.dir/raylet/node_manager.cc.o] Error 1
CMakeFiles/Makefile2:331: recipe for target 'src/ray/CMakeFiles/ray_objlib.dir/all' failed
make[1]: *** [src/ray/CMakeFiles/ray_objlib.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2

error.log

[robertnishihara]

Can you try cloning a fresh copy of the Ray repository and building it again (and if it fails, share the full stdout/stderr)?

It looks like the error happened earlier than what is recorded in the log.

[ejxqy]

Using the following comands
git clone https://github.com/ray-project/ray.git
cd ray/python
pip install -e . --verbose

And got the following error:
Command "/home/js/anaconda3/bin/python -c "import setuptools, tokenize;file='/home/js/ray/python/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" develop --no-deps" failed with error code 1 in /home/js/ray/python/

The full error log is
error.log

[robertnishihara]

It's possible that this has been fixed by #2221.

Can you try removing the whole directory and trying again with the latest source?

You can also install Ray with pip install ray and if you want to try out the latest commits you can get install the nightly versions using the instructions at http://ray.readthedocs.io/en/latest/installation.html#trying-the-latest-version-of-ray.

[guoyuhong]

@robertnishihara I think this is the same issue in 2271.

[robertnishihara]

Thanks @ejxqy. Please try with the latest master and let me know if the issue persists.

[simon-mo]

Should be fixed on latest master.