Commits

Branch selector

 main

User selector

mgoin

Datepicker

All time

Commit History

Commits on Jan 29, 2025

• Bugfix for whisper quantization due to fake k_proj bias (vllm-project#12524)

  Show description for bd02164
  mgoin

  authored
  bd02164

  Copy full SHA for bd02164

• [TPU] Add example for profiling TPU inference (vllm-project#12531)

  Show description for fbb5bd4
  mgoin

  authored
  fbb5bd4

  Copy full SHA for fbb5bd4

Commits on Jan 28, 2025

• Replace missed warning_once for rerank API (vllm-project#12472)

  Show description for 0f657bd
  mgoin

  authored
  0f657bd

  Copy full SHA for 0f657bd

• Fix bad path in prometheus example (vllm-project#12481)

  Show description for 426a5c3
  mgoin

  authored
  426a5c3

  Copy full SHA for 426a5c3

Commits on Jan 23, 2025

• [Docs] Update FP8 KV Cache documentation (vllm-project#12238)

  Show description for 01a5594
  

  mgoin

  and

  DarkLight1337

  authored
  01a5594

  Copy full SHA for 01a5594

Commits on Jan 21, 2025

• Add quantization and guided decoding CODEOWNERS (vllm-project#12228)

  Show description for ecf6781
  mgoin

  authored
  ecf6781

  Copy full SHA for ecf6781

Commits on Jan 16, 2025

• Various cosmetic/comment fixes (vllm-project#12089)

  Show description for 9aa1519
  mgoin

  authored
  9aa1519

  Copy full SHA for 9aa1519

Commits on Jan 9, 2025

• [Doc] Recommend uv and python 3.12 for quickstart guide (vllm-project#11849)

  Show description for 730e959
  mgoin

  authored
  730e959

  Copy full SHA for 730e959

Commits on Jan 3, 2025

• Update requirements-tpu.txt to support python 3.9 and 3.11 (vllm-project#11695)

  Show description for bf0d97d
  mgoin

  authored
  bf0d97d

  Copy full SHA for bf0d97d

Commits on Dec 31, 2024

• [Bugfix] Fix OpenAI parallel sampling when using xgrammar (vllm-project#11637)

  Show description for 74fa1d1
  mgoin

  authored
  74fa1d1

  Copy full SHA for 74fa1d1

Commits on Dec 29, 2024

• Remove print statement in DeepseekScalingRotaryEmbedding (vllm-project#11604)

  mgoin

  authored
  0aa38d1

  Copy full SHA for 0aa38d1

Commits on Dec 26, 2024

• [Model] [Quantization] Support deepseek_v3 w8a8 fp8 block-wise quantization (vllm-project#11523)

  Show description for 2072924
  

  3 peopleauthored
  2072924

  Copy full SHA for 2072924

Commits on Dec 23, 2024

• [Bugfix] Add kv cache scales to gemma2.py (vllm-project#11269)

  mgoin

  authored
  60fb4f3

  Copy full SHA for 60fb4f3

• [CI] Expand OpenAI test_chat.py guided decoding tests (vllm-project#11048)

  Show description for 63afbe9
  mgoin

  authored
  63afbe9

  Copy full SHA for 63afbe9

• [Bugfix] Fix CFGGuide and use outlines for grammars that can't convert to GBNF (vllm-project#11389)

  Show description for 5bfb30a
  mgoin

  authored
  5bfb30a

  Copy full SHA for 5bfb30a

Commits on Dec 20, 2024

• [Bugfix] Don't log OpenAI field aliases as ignored (vllm-project#11378)

  Show description for d573aea
  mgoin

  authored
  d573aea

  Copy full SHA for d573aea

• [Misc] Add tqdm progress bar during graph capture (vllm-project#11349)

  Show description for b880ffb
  mgoin

  authored
  b880ffb

  Copy full SHA for b880ffb

Commits on Dec 19, 2024

• [CI] Expand test_guided_generate to test all backends (vllm-project#11313)

  Show description for a30482f
  mgoin

  authored
  a30482f

  Copy full SHA for a30482f

Commits on Dec 18, 2024

• [Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project#11264)

  mgoin

  authored
  c77eb8a

  Copy full SHA for c77eb8a

Commits on Dec 17, 2024

• [CI] Add test case with JSON schema using references + use xgrammar by default with OpenAI parse (vllm-project#10935)

  Show description for 0064f69
  mgoin

  authored
  0064f69

  Copy full SHA for 0064f69

Commits on Dec 10, 2024

• [Docs] Add dedicated tool calling page to docs (vllm-project#10554)

  Show description for 6d52528
  

  mgoin

  and

  tlrmchlsmth

  authored
  6d52528

  Copy full SHA for 6d52528

Commits on Dec 6, 2024

• [Core] Support Lark grammars for XGrammar (vllm-project#10870)

  Show description for 8b59631
  mgoin

  authored
  8b59631

  Copy full SHA for 8b59631

Commits on Dec 5, 2024

• [Bugfix] Fallback to outlines for complex json schemas (vllm-project#10899)

  Show description for 8d370e9
  mgoin

  authored
  8d370e9

  Copy full SHA for 8d370e9

Commits on Dec 3, 2024

• [Bugfix] Only require XGrammar on x86 (vllm-project#10865)

  Show description for 7090c27
  mgoin

  authored
  7090c27

  Copy full SHA for 7090c27

• [Bugfix] Prevent benchmark_throughput.py from using duplicated random prompts (vllm-project#10753)

  mgoin

  authored
  4433195

  Copy full SHA for 4433195

Commits on Nov 26, 2024

• [Bugfix] Check bnb_4bit_quant_storage for bitsandbytes (vllm-project#10642)

  mgoin

  authored
  7576cd3

  Copy full SHA for 7576cd3

• [Bugfix] Fix using -O[0,3] with LLM entrypoint (vllm-project#10677)

  Show description for 9a99273
  mgoin

  authored
  9a99273

  Copy full SHA for 9a99273

Commits on Nov 23, 2024

• Update default max_num_batch_tokens for chunked prefill to 2048 (vllm-project#10544)

  mgoin

  authored
  02a43f8

  Copy full SHA for 02a43f8

Commits on Nov 21, 2024

• Add small example to metrics.rst (vllm-project#10550)

  mgoin

  authored
  9afa014

  Copy full SHA for 9afa014

Commits on Nov 19, 2024

• Add openai.beta.chat.completions.parse example to structured_outputs.rst (vllm-project#10433)

  mgoin

  authored
  74f8c2c

  Copy full SHA for 74f8c2c

Commits on Nov 18, 2024

• [Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)

  Show description for 281cc4b
  mgoin

  authored
  281cc4b

  Copy full SHA for 281cc4b

Commits on Nov 9, 2024

• [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (vllm-project#10169)

  Show description for f83fecc
  mgoin

  authored
  f83fecc

  Copy full SHA for f83fecc

Commits on Nov 8, 2024

• Add hf_transfer to testing image (vllm-project#10096)

  mgoin

  authored
  aea6ad6

  Copy full SHA for aea6ad6

Commits on Nov 7, 2024

• [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (vllm-project#10095)

  Show description for 4ab3256
  mgoin

  authored
  4ab3256

  Copy full SHA for 4ab3256

Commits on Nov 6, 2024

• Remove ScaledActivation for AWQ (vllm-project#10057)

  Show description for 399c798
  mgoin

  authored
  399c798

  Copy full SHA for 399c798

Pagination

Previous

Next