Skip to content

Commit

Permalink
[[Misc]] Add extra deps for openai server image (#8792)
Browse files Browse the repository at this point in the history
  • Loading branch information
jeejeelee authored Sep 25, 2024
1 parent 300da09 commit c6f2485
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ FROM vllm-base AS vllm-openai

# install additional dependencies for openai api server
RUN --mount=type=cache,target=/root/.cache/pip \
pip install accelerate hf_transfer 'modelscope!=1.15.0'
pip install accelerate hf_transfer 'modelscope!=1.15.0' bitsandbytes>=0.44.0 timm==0.9.10

ENV VLLM_USAGE_SOURCE production-docker-image

Expand Down

0 comments on commit c6f2485

Please sign in to comment.