Cannot npm install due to gpu.js/angle not compiling

[LittleLightLittleFire]

$  npm install js-slang

npm ERR! code 1
npm ERR! path /xxxx/xxxx/node_modules/gpu.js/node_modules/gl
npm ERR! command failed
npm ERR! command sh -c prebuild-install || node-gyp rebuild
npm ERR! make: Entering directory '/xxxx/xxxx/node_modules/gpu.js/node_modules/gl/build'
npm ERR!   CXX(target) Release/obj.target/angle_common/angle/src/common/Float16ToFloat32.o
npm ERR! make: Leaving directory '/xxxx/xxxx/node_modules/gpu.js/node_modules/gl/build'
npm ERR! prebuild-install warn install No prebuilt binaries found (target=18.16.0 runtime=node arch=x64 libc= platform=linux)
npm ERR! gyp info it worked if it ends with ok
npm ERR! gyp info using node-gyp@9.3.1
npm ERR! gyp info using node@18.16.0 | linux | x64
npm ERR! gyp info find Python using Python version 3.11.3 found at "/usr/bin/python3"
npm ERR! gyp info spawn /usr/bin/python3
npm ERR! gyp info spawn args [
npm ERR! gyp info spawn args   '/xxxx/xxxx/node_modules/node-gyp/gyp/gyp_main.py',
npm ERR! gyp info spawn args   'binding.gyp',
npm ERR! gyp info spawn args   '-f',
npm ERR! gyp info spawn args   'make',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/xxxx/xxxx/node_modules/gpu.js/node_modules/gl/build/config.gypi',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/xxxx/xxxx/node_modules/node-gyp/addon.gypi',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/xxxx/xxxx/.cache/node-gyp/18.16.0/include/node/common.gypi',
npm ERR! gyp info spawn args   '-Dlibrary=shared_library',
npm ERR! gyp info spawn args   '-Dvisibility=default',
npm ERR! gyp info spawn args   '-Dnode_root_dir=/xxxx/xxxx/.cache/node-gyp/18.16.0',
npm ERR! gyp info spawn args   '-Dnode_gyp_dir=/xxxx/xxxx/node_modules/node-gyp',
npm ERR! gyp info spawn args   '-Dnode_lib_file=/xxxx/xxxx/.cache/node-gyp/18.16.0/<(target_arch)/node.lib',
npm ERR! gyp info spawn args   '-Dmodule_root_dir=/xxxx/xxxx/node_modules/gpu.js/node_modules/gl',
npm ERR! gyp info spawn args   '-Dnode_engine=v8',
npm ERR! gyp info spawn args   '--depth=.',
npm ERR! gyp info spawn args   '--no-parallel',
npm ERR! gyp info spawn args   '--generator-output',
npm ERR! gyp info spawn args   'build',
npm ERR! gyp info spawn args   '-Goutput_dir=.'
npm ERR! gyp info spawn args ]
npm ERR! gyp info spawn make
npm ERR! gyp info spawn args [ 'BUILDTYPE=Release', '-C', 'build' ]
npm ERR! In file included from ../angle/src/common/debug.h:16,
npm ERR!                  from ../angle/src/common/mathutil.h:12,
npm ERR!                  from ../angle/src/common/Float16ToFloat32.cpp:9:
npm ERR! ../angle/src/common/angleutils.h:36:14: error: ‘uintptr_t’ does not name a type
npm ERR!    36 | extern const uintptr_t DirtyPointer;
npm ERR!       |              ^~~~~~~~~
npm ERR! ../angle/src/common/angleutils.h:21:1: note: ‘uintptr_t’ is defined in header ‘<cstdint>’; did you forget to ‘#include <cstdint>’?
npm ERR!    20 | #include <vector>
npm ERR!   +++ |+#include <cstdint>
npm ERR!    21 | 
npm ERR! make: *** [angle/src/angle_common.target.mk:159: Release/obj.target/angle_common/angle/src/common/Float16ToFloat32.o] Error 1
npm ERR! gyp ERR! build error 
npm ERR! gyp ERR! stack Error: `make` failed with exit code: 2
npm ERR! gyp ERR! stack     at ChildProcess.onExit (/xxxx/xxxx/node_modules/node-gyp/lib/build.js:203:23)
npm ERR! gyp ERR! stack     at ChildProcess.emit (node:events:513:28)
npm ERR! gyp ERR! stack     at ChildProcess._handle.onexit (node:internal/child_process:291:12)
npm ERR! gyp ERR! System Linux 6.3.1-arch1-1
npm ERR! gyp ERR! command "/xxxx/xxxx/.nvm/versions/node/v18.16.0/bin/node" "/xxxx/xxxx/node_modules/.bin/node-gyp" "rebuild"
npm ERR! gyp ERR! cwd /xxxx/xxxx/node_modules/gpu.js/node_modules/gl
npm ERR! gyp ERR! node -v v18.16.0
npm ERR! gyp ERR! node-gyp -v v9.3.1
npm ERR! gyp ERR! not ok

[RichDom2185]

Hi! Do you mind providing the following information for troubleshooting:

• Your OS
• Chip (ARM/x86)
• Node.js version

Thanks!

[LittleLightLittleFire]

Arch Linux
x64
v18.16.0

[LittleLightLittleFire]

Docker file for easy repo:

FROM archlinux/archlinux:base-devel

RUN pacman -Syu npm xorg --noconfirm
RUN npm install -g js-slang

Step 3/3 : RUN npm install -g js-slang
 ---> Running in 0987d79bcc28
npm WARN deprecated @npmcli/move-file@2.0.1: This functionality has been moved to @npmcli/fs
npm notice 
npm notice New major version of npm available! 8.19.2 -> 9.6.6
npm notice Changelog: <https://github.com/npm/cli/releases/tag/v9.6.6>
npm notice Run `npm install -g npm@9.6.6` to update!
npm notice 
npm ERR! code 1
npm ERR! path /usr/lib/node_modules/js-slang/node_modules/gl
npm ERR! command failed
npm ERR! command sh -c -- prebuild-install || node-gyp rebuild
npm ERR! make: Entering directory '/usr/lib/node_modules/js-slang/node_modules/gl/build'
npm ERR!   CXX(target) Release/obj.target/angle_common/angle/src/common/Float16ToFloat32.o
npm ERR! make: Leaving directory '/usr/lib/node_modules/js-slang/node_modules/gl/build'
npm ERR! prebuild-install warn install No prebuilt binaries found (target=19.9.0 runtime=node arch=x64 libc= platform=linux)
npm ERR! gyp info it worked if it ends with ok
npm ERR! gyp info using node-gyp@9.3.1
npm ERR! gyp info using node@19.9.0 | linux | x64
npm ERR! gyp info find Python using Python version 3.11.3 found at "/usr/sbin/python3"
npm ERR! gyp http GET https://nodejs.org/download/release/v19.9.0/node-v19.9.0-headers.tar.gz
npm ERR! gyp http 200 https://nodejs.org/download/release/v19.9.0/node-v19.9.0-headers.tar.gz
npm ERR! gyp http GET https://nodejs.org/download/release/v19.9.0/SHASUMS256.txt
npm ERR! gyp http 200 https://nodejs.org/download/release/v19.9.0/SHASUMS256.txt
npm ERR! gyp info spawn /usr/sbin/python3
npm ERR! gyp info spawn args [
npm ERR! gyp info spawn args   '/usr/lib/node_modules/js-slang/node_modules/node-gyp/gyp/gyp_main.py',
npm ERR! gyp info spawn args   'binding.gyp',
npm ERR! gyp info spawn args   '-f',
npm ERR! gyp info spawn args   'make',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/usr/lib/node_modules/js-slang/node_modules/gl/build/config.gypi',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/usr/lib/node_modules/js-slang/node_modules/node-gyp/addon.gypi',
npm ERR! gyp info spawn args   '-I',
npm ERR! gyp info spawn args   '/root/.cache/node-gyp/19.9.0/include/node/common.gypi',
npm ERR! gyp info spawn args   '-Dlibrary=shared_library',
npm ERR! gyp info spawn args   '-Dvisibility=default',
npm ERR! gyp info spawn args   '-Dnode_root_dir=/root/.cache/node-gyp/19.9.0',
npm ERR! gyp info spawn args   '-Dnode_gyp_dir=/usr/lib/node_modules/js-slang/node_modules/node-gyp',
npm ERR! gyp info spawn args   '-Dnode_lib_file=/root/.cache/node-gyp/19.9.0/<(target_arch)/node.lib',
npm ERR! gyp info spawn args   '-Dmodule_root_dir=/usr/lib/node_modules/js-slang/node_modules/gl',
npm ERR! gyp info spawn args   '-Dnode_engine=v8',
npm ERR! gyp info spawn args   '--depth=.',
npm ERR! gyp info spawn args   '--no-parallel',
npm ERR! gyp info spawn args   '--generator-output',
npm ERR! gyp info spawn args   'build',
npm ERR! gyp info spawn args   '-Goutput_dir=.'
npm ERR! gyp info spawn args ]
npm ERR! gyp info spawn make
npm ERR! gyp info spawn args [ 'BUILDTYPE=Release', '-C', 'build' ]
npm ERR! In file included from ../angle/src/common/debug.h:16,
npm ERR!                  from ../angle/src/common/mathutil.h:12,
npm ERR!                  from ../angle/src/common/Float16ToFloat32.cpp:9:
npm ERR! ../angle/src/common/angleutils.h:36:14: error: ‘uintptr_t’ does not name a type
npm ERR!    36 | extern const uintptr_t DirtyPointer;
npm ERR!       |              ^~~~~~~~~
npm ERR! ../angle/src/common/angleutils.h:21:1: note: ‘uintptr_t’ is defined in header ‘<cstdint>’; did you forget to ‘#include <cstdint>’?
npm ERR!    20 | #include <vector>
npm ERR!   +++ |+#include <cstdint>
npm ERR!    21 | 
npm ERR! make: *** [angle/src/angle_common.target.mk:157: Release/obj.target/angle_common/angle/src/common/Float16ToFloat32.o] Error 1
npm ERR! gyp ERR! build error 
npm ERR! gyp ERR! stack Error: `make` failed with exit code: 2
npm ERR! gyp ERR! stack     at ChildProcess.onExit (/usr/lib/node_modules/js-slang/node_modules/node-gyp/lib/build.js:203:23)
npm ERR! gyp ERR! stack     at ChildProcess.emit (node:events:513:28)
npm ERR! gyp ERR! stack     at ChildProcess._handle.onexit (node:internal/child_process:293:12)
npm ERR! gyp ERR! System Linux 6.3.1-arch1-1
npm ERR! gyp ERR! command "/usr/bin/node" "/usr/lib/node_modules/js-slang/node_modules/.bin/node-gyp" "rebuild"
npm ERR! gyp ERR! cwd /usr/lib/node_modules/js-slang/node_modules/gl
npm ERR! gyp ERR! node -v v19.9.0
npm ERR! gyp ERR! node-gyp -v v9.3.1
npm ERR! gyp ERR! not ok

[RichDom2185]

I can reproduce this running via Docker on an M1 Mac (using the --platform=linux/amd64 switch). Let us look into it.

Thanks for reporting!

[RichDom2185]

Sorry for the delay; I strongly suspect it has something to do with the Python version (3.11) - it is a known issue that node-gyp is not compatible with Python 3.11. I am still trying to install Python 3.10 manually, but without success (not too familiar using arch/yay unfortunately). I'm trying out a couple different configs.

Is using Arch a necessary requirement?

[RichDom2185]

Update: figured out how to get Python 3.10 set up, but it still did not resolve the issue:

FROM --platform=linux/amd64 archlinux/archlinux:base-devel

# Makepkg requires non-root user
RUN useradd --create-home --shell=/bin/false build && usermod -L build
RUN echo "build ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers

# Install yay
RUN pacman -Syu git --noconfirm
RUN git clone https://aur.archlinux.org/yay-bin.git /tmp/yay-bin
RUN chown -R build:build /tmp/yay-bin
WORKDIR /tmp/yay-bin
RUN sudo -u build makepkg --noconfirm -si

# Install python 3.10
RUN sudo -u build yay -S python310 --noconfirm

# Install js-slang
RUN pacman -Sy npm xorg --noconfirm
RUN npm install --python=python3.10 -g js-slang

results in the same error.

[RichDom2185]

Unfortunately, I still could not get it to run on Arch, but Alpine as well as Debian/Ubuntu works, although a global install will result to a module resolution error (something to do with our py-slang submodule), thus we need to build from source:

FROM nikolaik/python-nodejs:python3.10-nodejs16-alpine

RUN apk update && apk add bash alpine-sdk pkgconfig libx11-dev libxi-dev libxext-dev

WORKDIR /usr/src
RUN git clone --recurse-submodules --depth 1 https://github.com/source-academy/js-slang.git

WORKDIR /usr/src/js-slang
# Yarn is preinstalled
RUN yarn install --frozen-lockfile
RUN yarn build

# Add to PATH (following README instructions)
WORKDIR /usr/src/js-slang/dist
RUN npm link

ENTRYPOINT [ "js-slang" ]

[LittleLightLittleFire]

I've had a deeper look and it is not an issue with python 3.11
It seems like the bug with is the gl​ package (which is a dependncy of js-slang)

e.g. changing it to npm install gl does not work either.
The simple reason is that the gl package (https://github.com/stackgl/headless-gl) uses a super old version of angle, which has a minor bug where it uses uintptr without importing #include <cstdint>

The dependency tree is as follows js-slang -> gpu.js -> gl

[RichDom2185]

The simple reason is that the gl package (https://github.com/stackgl/headless-gl) uses a super old version of angle, which has a minor bug where it uses uintptr without importing #include <cstdint>

I realise this is the issue as well. It used to be allowed in GCC versions below 13, but not anymore.

Setting GCC version to 12 works (still have to build from source, though):

FROM --platform=linux/amd64 archlinux/archlinux:base-devel

RUN pacman -Syu git npm xorg gcc12 --noconfirm
RUN npm install -g yarn

WORKDIR /usr/src
RUN git clone --recurse-submodules --depth 1 https://github.com/source-academy/js-slang.git
WORKDIR /usr/src/js-slang
RUN CC=gcc-12 CXX=g++-12 yarn install --frozen-lockfile
RUN yarn build

WORKDIR /usr/src/js-slang/dist
RUN npm link

ENTRYPOINT [ "js-slang" ]

[LittleLightLittleFire]

This is fine, I can work with this.

[LittleLightLittleFire]

I've gotten it to build with:

FROM archlinux/archlinux:base-devel

RUN pacman -Syu npm xorg gcc12 --noconfirm
RUN CC=gcc-12 CXX=g++-12 npm install -g js-slang

However when I run it:

docker tag d15a212f835c test
docker run -ti test bash

[root@9a0ed9a26213 /]# js-slang 
node:internal/modules/cjs/loader:1051
  throw err;
  ^

Error: Cannot find module 'fast-levenshtein'
Require stack:
- /usr/lib/node_modules/js-slang/dist/py-slang/src/resolver.js
- /usr/lib/node_modules/js-slang/dist/py-slang/src/index.js
- /usr/lib/node_modules/js-slang/dist/parser/python/index.js
- /usr/lib/node_modules/js-slang/dist/parser/parser.js
- /usr/lib/node_modules/js-slang/dist/stdlib/parser.js
- /usr/lib/node_modules/js-slang/dist/stdlib/index.js
- /usr/lib/node_modules/js-slang/dist/modules/requireProvider.js
- /usr/lib/node_modules/js-slang/dist/modules/moduleLoader.js
- /usr/lib/node_modules/js-slang/dist/interpreter/interpreter.js
- /usr/lib/node_modules/js-slang/dist/interpreter/closure.js
- /usr/lib/node_modules/js-slang/dist/utils/stringify.js
- /usr/lib/node_modules/js-slang/dist/errors/errors.js
- /usr/lib/node_modules/js-slang/dist/schedulers.js
- /usr/lib/node_modules/js-slang/dist/createContext.js
- /usr/lib/node_modules/js-slang/dist/index.js
- /usr/lib/node_modules/js-slang/dist/repl/repl.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1048:15)
    at Module._load (node:internal/modules/cjs/loader:901:27)
    at Module.require (node:internal/modules/cjs/loader:1115:19)
    at require (node:internal/modules/helpers:119:18)
    at Object.<anonymous> (/usr/lib/node_modules/js-slang/dist/py-slang/src/resolver.js:7:21)
    at Module._compile (node:internal/modules/cjs/loader:1233:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1287:10)
    at Module.load (node:internal/modules/cjs/loader:1091:32)
    at Module._load (node:internal/modules/cjs/loader:938:12)
    at Module.require (node:internal/modules/cjs/loader:1115:19) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
    '/usr/lib/node_modules/js-slang/dist/py-slang/src/resolver.js',
    '/usr/lib/node_modules/js-slang/dist/py-slang/src/index.js',
    '/usr/lib/node_modules/js-slang/dist/parser/python/index.js',
    '/usr/lib/node_modules/js-slang/dist/parser/parser.js',
    '/usr/lib/node_modules/js-slang/dist/stdlib/parser.js',
    '/usr/lib/node_modules/js-slang/dist/stdlib/index.js',
    '/usr/lib/node_modules/js-slang/dist/modules/requireProvider.js',
    '/usr/lib/node_modules/js-slang/dist/modules/moduleLoader.js',
    '/usr/lib/node_modules/js-slang/dist/interpreter/interpreter.js',
    '/usr/lib/node_modules/js-slang/dist/interpreter/closure.js',
    '/usr/lib/node_modules/js-slang/dist/utils/stringify.js',
    '/usr/lib/node_modules/js-slang/dist/errors/errors.js',
    '/usr/lib/node_modules/js-slang/dist/schedulers.js',
    '/usr/lib/node_modules/js-slang/dist/createContext.js',
    '/usr/lib/node_modules/js-slang/dist/index.js',
    '/usr/lib/node_modules/js-slang/dist/repl/repl.js'
  ]
}

Node.js v20.5.0
[root@9a0ed9a26213 /]#

[RichDom2185]

I encountered the same issue when I tried to install globally using -g; hence why in the above examples that I gave, I built js-slang from source instead (and subsequently set the entrypoint in the Dockerfile).

---

I discussed offline with @Fidget-Spinner and he suggested that the py-slang submodule might not be getting TS-compiled when installing js-slang using -g, but we haven't looked into it yet. @Fidget-Spinner could you advice on this?