[Installation]: Error when importing LLM from vllm

[manishkumar0709]

My current environment

i am using linux system, rtx 4080, cuda version: 12.1, python version - 3.9

from vllm import LLM
ImportError: cannot import name 'LLM' from 'vllm' (unknown location)

How you are installing vllm

pip install vllm

[DarkLight1337]

Can you run pip list and see if vllm is in the list of installed packages? If you're managing multiple Python environments, double-check that you're using the correct one.

[manishkumar0709]

yes i have installed correctly , had doubled check

[DarkLight1337]

Has this problem been resolved?

[miridih-jyjang]

Same problem here!

[DarkLight1337]

Same problem here!

Please provide more details about your environment by running collect_env.py.

[yfllllll]

have u solved it ?

[gianmarcoalessio]

sameeeee

[DarkLight1337]

sameeeee

Please provide more details of your environment.

[jdc4429]

I have the same issue.. Then read only works for Linux? Running Windows 10 Pro...

Why does this not work under other OS's? I was able to build using the existing torch without error.. So what's the problem???

[DarkLight1337]

I have the same issue.. Then read only works for Linux? Running Windows 10 Pro...

Why does this not work under other OS's? I was able to build using the existing torch without error.. So what's the problem???

As mentioned on the Installation page, we don't officially support Windows OS in general. If you want to run vLLM on your Windows machine, I suggest using WSL.

[JamesSand]

I have met the same problem. I am using ubuntu. I installed vllm via builid from source. I am trying to run the quantization tutorial.

Met the same error

    from vllm import LLM                                                                                                
ImportError: cannot import name 'LLM' from 'vllm' (unknown location)

[DarkLight1337]

Can you run pip list and show the output? Also, how are you running vLLM?

[JamesSand]

I have met the same problem. I am using ubuntu. I installed vllm via builid from source. I am trying to run the quantization tutorial.

Met the same error

    from vllm import LLM                                                                                                
ImportError: cannot import name 'LLM' from 'vllm' (unknown location)

Thank you for your prompt reply.
I have fixed this issue. Sorry this is due to my stupid mistake.
I just clone the vllm repo, and run the python script in the same dir that contains vllm repo.