Commits

Branch selector

 main

User selector

mgoin

Datepicker

All time

Commit History

Commits on Dec 20, 2024

• [Bugfix] Don't log OpenAI field aliases as ignored (vllm-project#11378)

  Show description for d573aea
  mgoin

  authored
  d573aea

• [Misc] Add tqdm progress bar during graph capture (vllm-project#11349)

  Show description for b880ffb
  mgoin

  authored
  b880ffb

Commits on Dec 19, 2024

• [CI] Expand test_guided_generate to test all backends (vllm-project#11313)

  Show description for a30482f
  mgoin

  authored
  a30482f

Commits on Dec 18, 2024

• [Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project#11264)

  mgoin

  authored
  c77eb8a

Commits on Dec 17, 2024

• [CI] Add test case with JSON schema using references + use xgrammar by default with OpenAI parse (vllm-project#10935)

  Show description for 0064f69
  mgoin

  authored
  0064f69

Commits on Dec 10, 2024

• [Docs] Add dedicated tool calling page to docs (vllm-project#10554)

  Show description for 6d52528
  

  mgoin

  and

  tlrmchlsmth

  authored
  6d52528

Commits on Dec 6, 2024

• [Core] Support Lark grammars for XGrammar (vllm-project#10870)

  Show description for 8b59631
  mgoin

  authored
  8b59631

Commits on Dec 5, 2024

• [Bugfix] Fallback to outlines for complex json schemas (vllm-project#10899)

  Show description for 8d370e9
  mgoin

  authored
  8d370e9

Commits on Dec 3, 2024

• [Bugfix] Only require XGrammar on x86 (vllm-project#10865)

  Show description for 7090c27
  mgoin

  authored
  7090c27

• [Bugfix] Prevent benchmark_throughput.py from using duplicated random prompts (vllm-project#10753)

  mgoin

  authored
  4433195

Commits on Nov 26, 2024

• [Bugfix] Check bnb_4bit_quant_storage for bitsandbytes (vllm-project#10642)

  mgoin

  authored
  7576cd3

• [Bugfix] Fix using -O[0,3] with LLM entrypoint (vllm-project#10677)

  Show description for 9a99273
  mgoin

  authored
  9a99273

Commits on Nov 23, 2024

• Update default max_num_batch_tokens for chunked prefill to 2048 (vllm-project#10544)

  mgoin

  authored
  02a43f8

Commits on Nov 21, 2024

• Add small example to metrics.rst (vllm-project#10550)

  mgoin

  authored
  9afa014

Commits on Nov 19, 2024

• Add openai.beta.chat.completions.parse example to structured_outputs.rst (vllm-project#10433)

  mgoin

  authored
  74f8c2c

Commits on Nov 18, 2024

• [Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)

  Show description for 281cc4b
  mgoin

  authored
  281cc4b

Commits on Nov 9, 2024

• [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (vllm-project#10169)

  Show description for f83fecc
  mgoin

  authored
  f83fecc

Commits on Nov 8, 2024

• Add hf_transfer to testing image (vllm-project#10096)

  mgoin

  authored
  aea6ad6

Commits on Nov 7, 2024

• [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (vllm-project#10095)

  Show description for 4ab3256
  mgoin

  authored
  4ab3256

Commits on Nov 6, 2024

• Remove ScaledActivation for AWQ (vllm-project#10057)

  Show description for 399c798
  mgoin

  authored
  399c798

Commits on Nov 5, 2024

• [CI] Prune back the number of tests in tests/kernels/* (vllm-project#9932)

  Show description for 235366f
  mgoin

  authored
  235366f

• [CI] Prune tests/models/decoder_only/language/* tests (vllm-project#9940)

  Show description for 0246246
  mgoin

  authored
  0246246

• [Model] Support quantization of PixtralHFTransformer for PixtralHF (vllm-project#9921)

  Show description for a53046b
  mgoin

  authored
  a53046b

Commits on Nov 4, 2024

• [Bugfix] Respect modules_to_not_convert within awq_marlin (vllm-project#9895)

  Show description for 8f0a9ca
  mgoin

  authored
  8f0a9ca

Commits on Nov 1, 2024

• [CI/Build] Add Model Tests for PixtralHF (vllm-project#9813)

  mgoin

  authored
  30a2e80

• [Model] Support bitsandbytes for MiniCPMV (vllm-project#9891)

  Show description for 93a76dd
  mgoin

  authored
  93a76dd

• [Bugfix] Fix layer skip logic with bitsandbytes (vllm-project#9887)

  Show description for 37a4947
  mgoin

  authored
  37a4947

Commits on Oct 31, 2024

• [Model] Support quantization of Qwen2VisionTransformer (vllm-project#9817)

  Show description for d087bf8
  mgoin

  authored
  d087bf8

Commits on Oct 30, 2024

• [Bugfix][VLM] Make apply_fp8_linear work with >2D input (vllm-project#9812)

  mgoin

  authored
  226688b

Commits on Oct 29, 2024

• [Bugfix] Fix prefix strings for quantized VLMs (vllm-project#9772)

  mgoin

  authored
  bc73e98

• [CI][Bugfix] Skip chameleon for transformers 4.46.1 (vllm-project#9808)

  mgoin

  authored
  ab6f981

Commits on Oct 25, 2024

• [Bugfix] Fix compressed_tensors_moe bad config.strategy (vllm-project#9677)

  mgoin

  authored
  ca0d922

Commits on Oct 24, 2024

• [Bugfix] Remove xformers requirement for Pixtral (vllm-project#9597)

  Show description for c91ed47
  mgoin

  authored
  c91ed47

• [Log][Bugfix] Fix default value check for image_url.detail (vllm-project#9663)

  mgoin

  authored
  e26d37a

• [Bugfix] Use "vision_model" prefix for MllamaVisionModel (vllm-project#9628)

  Show description for b7df53c
  mgoin

  authored
  b7df53c

Pagination

PreviousNext