Commits

Branch selector

 main

User selector

mgoin

Datepicker

All time

Commit History

Commits on Dec 6, 2024

• [Core] Support Lark grammars for XGrammar (vllm-project#10870)

  Show description for 8b59631
  mgoin

  authored
  8b59631

  Copy full SHA for 8b59631

Commits on Dec 5, 2024

• [Bugfix] Fallback to outlines for complex json schemas (vllm-project#10899)

  Show description for 8d370e9
  mgoin

  authored
  8d370e9

  Copy full SHA for 8d370e9

Commits on Dec 3, 2024

• [Bugfix] Only require XGrammar on x86 (vllm-project#10865)

  Show description for 7090c27
  mgoin

  authored
  7090c27

  Copy full SHA for 7090c27

• [Bugfix] Prevent benchmark_throughput.py from using duplicated random prompts (vllm-project#10753)

  mgoin

  authored
  4433195

  Copy full SHA for 4433195

Commits on Nov 26, 2024

• [Bugfix] Check bnb_4bit_quant_storage for bitsandbytes (vllm-project#10642)

  mgoin

  authored
  7576cd3

  Copy full SHA for 7576cd3

• [Bugfix] Fix using -O[0,3] with LLM entrypoint (vllm-project#10677)

  Show description for 9a99273
  mgoin

  authored
  9a99273

  Copy full SHA for 9a99273

Commits on Nov 23, 2024

• Update default max_num_batch_tokens for chunked prefill to 2048 (vllm-project#10544)

  mgoin

  authored
  02a43f8

  Copy full SHA for 02a43f8

Commits on Nov 21, 2024

• Add small example to metrics.rst (vllm-project#10550)

  mgoin

  authored
  9afa014

  Copy full SHA for 9afa014

Commits on Nov 19, 2024

• Add openai.beta.chat.completions.parse example to structured_outputs.rst (vllm-project#10433)

  mgoin

  authored
  74f8c2c

  Copy full SHA for 74f8c2c

Commits on Nov 18, 2024

• [Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)

  Show description for 281cc4b
  mgoin

  authored
  281cc4b

  Copy full SHA for 281cc4b

Commits on Nov 9, 2024

• [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (vllm-project#10169)

  Show description for f83fecc
  mgoin

  authored
  f83fecc

  Copy full SHA for f83fecc

Commits on Nov 8, 2024

• Add hf_transfer to testing image (vllm-project#10096)

  mgoin

  authored
  aea6ad6

  Copy full SHA for aea6ad6

Commits on Nov 7, 2024

• [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (vllm-project#10095)

  Show description for 4ab3256
  mgoin

  authored
  4ab3256

  Copy full SHA for 4ab3256

Commits on Nov 6, 2024

• Remove ScaledActivation for AWQ (vllm-project#10057)

  Show description for 399c798
  mgoin

  authored
  399c798

  Copy full SHA for 399c798

Commits on Nov 5, 2024

• [CI] Prune back the number of tests in tests/kernels/* (vllm-project#9932)

  Show description for 235366f
  mgoin

  authored
  235366f

  Copy full SHA for 235366f

• [CI] Prune tests/models/decoder_only/language/* tests (vllm-project#9940)

  Show description for 0246246
  mgoin

  authored
  0246246

  Copy full SHA for 0246246

• [Model] Support quantization of PixtralHFTransformer for PixtralHF (vllm-project#9921)

  Show description for a53046b
  mgoin

  authored
  a53046b

  Copy full SHA for a53046b

Commits on Nov 4, 2024

• [Bugfix] Respect modules_to_not_convert within awq_marlin (vllm-project#9895)

  Show description for 8f0a9ca
  mgoin

  authored
  8f0a9ca

  Copy full SHA for 8f0a9ca

Commits on Nov 1, 2024

• [CI/Build] Add Model Tests for PixtralHF (vllm-project#9813)

  mgoin

  authored
  30a2e80

  Copy full SHA for 30a2e80

• [Model] Support bitsandbytes for MiniCPMV (vllm-project#9891)

  Show description for 93a76dd
  mgoin

  authored
  93a76dd

  Copy full SHA for 93a76dd

• [Bugfix] Fix layer skip logic with bitsandbytes (vllm-project#9887)

  Show description for 37a4947
  mgoin

  authored
  37a4947

  Copy full SHA for 37a4947

Commits on Oct 31, 2024

• [Model] Support quantization of Qwen2VisionTransformer (vllm-project#9817)

  Show description for d087bf8
  mgoin

  authored
  d087bf8

  Copy full SHA for d087bf8

Commits on Oct 30, 2024

• [Bugfix][VLM] Make apply_fp8_linear work with >2D input (vllm-project#9812)

  mgoin

  authored
  226688b

  Copy full SHA for 226688b

Commits on Oct 29, 2024

• [Bugfix] Fix prefix strings for quantized VLMs (vllm-project#9772)

  mgoin

  authored
  bc73e98

  Copy full SHA for bc73e98

• [CI][Bugfix] Skip chameleon for transformers 4.46.1 (vllm-project#9808)

  mgoin

  authored
  ab6f981

  Copy full SHA for ab6f981

Commits on Oct 25, 2024

• [Bugfix] Fix compressed_tensors_moe bad config.strategy (vllm-project#9677)

  mgoin

  authored
  ca0d922

  Copy full SHA for ca0d922

Commits on Oct 24, 2024

• [Bugfix] Remove xformers requirement for Pixtral (vllm-project#9597)

  Show description for c91ed47
  mgoin

  authored
  c91ed47

  Copy full SHA for c91ed47

• [Log][Bugfix] Fix default value check for image_url.detail (vllm-project#9663)

  mgoin

  authored
  e26d37a

  Copy full SHA for e26d37a

• [Bugfix] Use "vision_model" prefix for MllamaVisionModel (vllm-project#9628)

  Show description for b7df53c
  mgoin

  authored
  b7df53c

  Copy full SHA for b7df53c

• [Bugfix][Model] Fix Mllama SDPA illegal memory access for batched multi-image (vllm-project#9626)

  Show description for bb01f29
  mgoin

  authored
  bb01f29

  Copy full SHA for bb01f29

Commits on Oct 23, 2024

• [Misc] Separate total and output tokens in benchmark_throughput.py (vllm-project#8914)

  mgoin

  authored
  fd0e2cf

  Copy full SHA for fd0e2cf

Commits on Oct 21, 2024

• [Model][Bugfix] Fix batching with multi-image in PixtralHF (vllm-project#9518)

  mgoin

  authored
  5241aa1

  Copy full SHA for 5241aa1

Commits on Oct 20, 2024

• [Model][Pixtral] Use memory_efficient_attention for PixtralHFVision (vllm-project#9520)

  mgoin

  authored
  962d2c6

  Copy full SHA for 962d2c6

Commits on Oct 19, 2024

• [Model][Pixtral] Optimizations for input_processor_for_pixtral_hf (vllm-project#9514)

  mgoin

  authored
  8e3e7f2

  Copy full SHA for 8e3e7f2

Commits on Oct 18, 2024

• [Model] Support Pixtral models in the HF Transformers format (vllm-project#9036)

  mgoin

  authored
  3921a2f

  Copy full SHA for 3921a2f

Pagination

Previous

Next