Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 1.0.0.dev placeholder doesn't work with uv pip install #9244

Open
1 task done
mil-ad opened this issue Oct 10, 2024 · 2 comments
Open
1 task done

[Bug]: 1.0.0.dev placeholder doesn't work with uv pip install #9244

mil-ad opened this issue Oct 10, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@mil-ad
Copy link

mil-ad commented Oct 10, 2024

Your current environment

na

Model Input Dumps

No response

🐛 Describe the bug

The recommended way for pip installing latest wheels (i.e. pip install https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl) works with vanilla pip but does not work with uv pip. I raised an issue in uv but I don't think this is a uv bug. Would be great to explore more robust options for this.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@mil-ad mil-ad added the bug Something isn't working label Oct 10, 2024
@cjackal
Copy link
Contributor

cjackal commented Oct 10, 2024

I think the installation guide must be updated somehow like

  1. first download the wheel from s3 w/ e.g. curl
  2. rename the wheel file with the "correct" version inscribed in the wheel METADATA (it requires some unzip yoga, I suppose)
  3. (uv) pip install the renamed wheel file

Current (mis)behavior of pip successfully install wrongly-named wheel file is kind of antipattern - not only uv but many repository managers (e.g. sonartype Nexus) that provide pypi mirror support may also check the wheel filename version with wheel metadata version, which would be main blocker to maintain a private mirror for vllm wheels

@dtrifiro
Copy link
Contributor

The problem is that the wheel files should not be renamed, perhaps we need to rethink the approach introduced in #8919

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants