Skip to content

Fresh install doesn't work #29

Description

@yundddd

Hello. I'm following the installation guide and there are couple issues I'm working through.
1: It looks like the guard only accepts two pins:

Genesis pin-gate] STRICT FAIL: vllm pin '0.20.2' is NOT on the Genesis known-good list (2 entries). Allowed pins: ['0.20.1rc1.dev16+g7a1eb8ac2', '0.20.2rc1.dev9+g01d4d1ad3']. To accept this pin, add it to KNOWN_GOOD_VLLM_PINS in vllm/_genesis/guards.py and document the validation in CHANGELOG.

Am I supposed to not use nightly as it's way ahead? I'm confused how we reproduce results with a nightly image.

2: The mounting point for _genesis in startup script is at

v /home/tim/genesis-vllm-patches/vllm/_genesis:/usr/local/lib/python3.12/dist-packages/vllm/_genesis:ro \

Looking at vllm/vllm-openai:v0.20.2 (which I assume is close to the image you pinned), it actually uses /site-packages/ instead of /dist-packages.

3: I guess this -network genesis-vllm-patches_default can be removed, aside from other changes (scripts/start_27b_int4_TQ_k8v4.sh)?

I'm also a bit confused for the oneline install script.

curl -sSL https://raw.githubusercontent.com/Sandermage/genesis-vllm-patches/main/install.sh | bash

Genesis vLLM Patches — installer
https://github.com/Sandermage/genesis-vllm-patches


» Pre-flight checks
  ok: OS: Linux
  ok: Python: 3.14 (/usr/bin/python3)
  ok: git + curl available

» GPU detection
  ok: GPU: NVIDIA GeForce RTX 5090 × 1
      matched preset GPU class: rtx 5090

» vLLM detection
  ok: vllm: ?

» Container-runtime caveat probe (Proxmox VE)
  ok: no Proxmox VE markers — docker path should be safe

» Pick workload
  ok: workload: balanced (non-interactive default — re-run with --workload to change)

» Resolve Genesis pin
  ok: pin: v7.51-stable-2026-04-27 (latest stable tag)

» Genesis source (/home/tim/.genesis)
info: found existing clone — updating
  ok: Genesis at a8c202d (ref: v7.51-stable-2026-04-27)
 err: Genesis tree at v7.51-stable-2026-04-27 is missing vllm/_genesis/compat/cli.py — wrong pin?

It looks like v7.51 tag was behind some refactor on master and is missing the cli.py.
Is there any reason to clone the repo again to ./genesis if we could just checkout different branches locally?

I'm interested in providing some data points on Ubuntu and in WSL but there are some rough edges here I need to overcome. Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions