Bump vllm from 0.8.4 to 0.9.0 in /serving/docker

[dependabot]

Bumps vllm from 0.8.4 to 0.9.0.

Release notes

Sourced from vllm's releases.

v0.9.0

Highlights

This release features 649 commits, from 215 contributors (82 new contributors!)

• vLLM has upgraded to PyTorch 2.7! (#16859) This is a breaking change for environment dependency.
  • The default wheel has been upgraded from CUDA 12.4 to CUDA 12.8. We will distribute CUDA 12.6 wheel on GitHub artifact.
  • As a general rule of thumb, our CUDA version policy follow PyTorch's CUDA version policy.
• Enhanced NVIDIA Blackwell support. vLLM now ships with initial set of optimized kernels on NVIDIA Blackwell with both attention and mlp.
  • You can use our docker image or install FlashInfer nightly wheel pip install https://download.pytorch.org/whl/cu128/flashinfer/flashinfer_python-0.2.5%2Bcu128torch2.7-cp38-abi3-linux_x86_64.whl then set VLLM_ATTENTION_BACKEND=FLASHINFER for better performance.
  • Upgraded support for the new FlashInfer main branch. (#15777)
  • Please checkout vllm-project/vllm#18153 for the full roadmap
• Initial DP, EP, PD support for large scale inference
  • EP:
    • Permute and unpermute kernel for moe optimization (#14568)
    • Modularize fused experts and integrate PPLX kernels (#15956)
    • Refactor pplx init logic to make it modular (prepare for deepep) (#18200)
    • Add ep group and all2all interface (#18077)
  • DP:
    • Decouple engine process management and comms (#15977)
  • PD:
    • NIXL Integration (#17751)
    • Local attention optimization for NIXL (#18170)
    • Support multiple kv connectors (#17564)
• Migrate docs from Sphinx to MkDocs (#18145, #18610, #18614, #18616. #18622, #18626, #18627, #18635, #18637, #18657, #18663, #18666, #18713)

Notable Changes

• Removal of CUDA 12.4 support due to PyTorch upgrade to 2.7.
• Change top_k to be disabled with 0 (still accept -1 for now) (#17773)
• The seed is now set to 0 by default for V1 Engine, meaning that different vLLM runs now yield the same outputs even if temperature > 0. This does not modify the random state in user code since workers are run in separate processes unless VLLM_USE_V1_MULTIPROCESSING=0. (#17929, #18741)

Model Enhancements

• Support MiMo-7B (#17433), MiniMax-VL-01 (#16328), Ovis 1.6 (#17861), Ovis 2 (#15826), GraniteMoeHybrid 4.0 (#17497), FalconH1* (#18406), LlamaGuard4 (#17315)
  • Please install the development version of transformers (from source) to use Falcon-H1.
• Embedding models: nomic-embed-text-v2-moe (#17785), new class of gte models (#17986)
• Progress in Hybrid Memory Allocator (#17394, #17479, #17474, #17483, #17193, #17946, #17945, #17999, #18001, #18593)
• DeepSeek: perf enhancement by moving more calls into cuda-graph region(#17484, #17668), Function Call (#17784), MTP in V1 (#18435)
• Qwen2.5-1M: Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
• Qwen2.5-VL speed enhancement via rotary_emb optimization (#17973)
• InternVL models with Qwen2.5 backbone now support video inputs (#18499)

Performance, Production and Scaling

• Support full cuda graph in v1 (#16072)
• Pipeline Parallelism: MultiprocExecutor support (#14219), torchrun (#17827)
• Support sequence parallelism combined with pipeline parallelism (#18243)
• Async tensor parallelism using compilation pass (#17882)
• Perf: Use small max_num_batched_tokens for A100 (#17885)
• Fast Model Loading: Tensorizer support for V1 and LoRA (#17926)
• Multi-modality: Automatically cast multi-modal input dtype before transferring device (#18756)

Security

... (truncated)

Commits

• 5873877 [Bugfix] Mistral tool calling when content is list (#18729)
• 696259c [Core] Automatically cast multi-modal input dtype (#18756)
• 6b6d496 optimize get_kv_cache_torch_dtype (#18531)
• aaa4ac1 Disable prefix cache by default for benchmark (#18639)
• 06a0338 [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)
• 4318c05 [CI/Build] Remove imports of built-in re (#18750)
• a68e293 [Doc] Convert Sphinx directives ( {class}, {meth}, {attr}, ...) to MkD...
• 6881107 [BUG FIX] minicpm (#18739)
• e0f0ff8 [Build] fix cpu build missing libtbbmalloc.so (#18744)
• c24b157 Minor fix about MooncakeStoreConnector (#18721)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
  You can disable automated security fix PRs for this repo from the Security Alerts page.