Commits

Branch selector

 lwilkinson/fix-mla-cpu

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 30, 2025

• fix mla cpu

  Show description for 22f7d6f
  LucasWilkinson

  committed
  22f7d6f

  Copy full SHA for 22f7d6f

• [Core] Prevent side-channel attacks via cache salting (#17045)

  Show description for 77073c7
  dr75

  authored
  77073c7

  Copy full SHA for 77073c7

• [TPU][V1][CI] Update regression test baseline for v6 CI (#17064)

  Show description for a7d5b01
  NickLucche

  authored
  a7d5b01

  Copy full SHA for a7d5b01

• [V1][Bugfix]: vllm v1 verison metric num_gpu_blocks is None (#15755)

  Show description for d803786
  lengrongfu

  authored
  d803786

  Copy full SHA for d803786

• [Misc] Remove deprecated files (#17447)

  Show description for 1534d38
  chaunceyjiang

  authored
  1534d38

  Copy full SHA for 1534d38

• Make the _apply_rotary_emb compatible with dynamo (#17435)

  houseroad

  authored
  ece5a8b

  Copy full SHA for ece5a8b

• [MODEL ADDITION] Ovis2 Model Addition (#15826)

  Show description for 54072f3
  

  mlinmg

  and

  Isotr0py

  authored
  54072f3

  Copy full SHA for 54072f3

• [Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434)

  Show description for be633fb
  chaunceyjiang

  authored
  be633fb

  Copy full SHA for be633fb

• [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444)

  Show description for ed6cfb9
  

  jikunshang

  and

  mayuyuace

  authored
  ed6cfb9

  Copy full SHA for ed6cfb9

• [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298)

  Show description for 6ed9f60
  jikunshang

  authored
  6ed9f60

  Copy full SHA for 6ed9f60

• Support LoRA for Mistral3 (#17428)

  Show description for a44c4f1
  mgoin

  authored
  a44c4f1

  Copy full SHA for a44c4f1

• Fix some speculative decode tests with tl.dot (#17371)

  Show description for 88fcf00
  huydhn

  authored
  88fcf00

  Copy full SHA for 88fcf00

• Fix call to `logger.info_once` (#17416)

  Show description for d1f569b
  hmellor

  authored
  d1f569b

  Copy full SHA for d1f569b

• Improve configs - `ModelConfig` (#17130)

  Show description for 13698db
  hmellor

  authored
  13698db

  Copy full SHA for 13698db

• Update PyTorch to 2.7.0 (#16859)

  huydhn

  authored
  2c4f59a

  Copy full SHA for 2c4f59a

• Truncation control for embedding models (#14776)

  Show description for 1c2bc7e
  

  gmarinho2

  and

  maxdebayser

  authored
  1c2bc7e

  Copy full SHA for 1c2bc7e

• [release] Always git fetch all to get latest tag on TPU release (#17322)

  khluu

  authored
  4055130

  Copy full SHA for 4055130

• [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702)

  Show description for 34120f5
  benchislett

  authored
  34120f5

  Copy full SHA for 34120f5

Commits on Apr 29, 2025

• Remove Bamba 9B from CI (#17407)

  Show description for 7489ec0
  hmellor

  authored
  7489ec0

  Copy full SHA for 7489ec0

• [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211)

  Show description for 70788bd
  luyuzhe111

  authored
  70788bd

  Copy full SHA for 70788bd

• Fix: Python package installation for opentelmetry (#17049)

  Show description for c9c1b59
  dilipgb

  authored
  c9c1b59

  Copy full SHA for c9c1b59

• Remove Falcon3 2x7B from CI (#17404)

  Show description for 0350809
  hmellor

  authored
  0350809

  Copy full SHA for 0350809

• Simplify (and fix) passing of guided decoding backend options (#17008)

  Show description for a6977db
  hmellor

  authored
  a6977db

  Copy full SHA for a6977db

• [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397)

  Show description for 2fa2a50
  Isotr0py

  authored
  2fa2a50

  Copy full SHA for 2fa2a50

• [CI/Build] Add retry mechanism for add-apt-repository (#17107)

  Show description for 08e15de
  

  reidliu41

  and

  reidliu41

  authored
  08e15de

  Copy full SHA for 08e15de

• [CI] Uses Python 3.11 for TPU (#17359)

  Show description for b37685a
  aarnphm

  authored
  b37685a

  Copy full SHA for b37685a

• [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374)

  Show description for 792595b
  NickLucche

  authored
  792595b

  Copy full SHA for 792595b

• [Doc][Typo] Fixing label in new model requests link in overview.md (#17400)

  casinca

  authored
  0c1c788

  Copy full SHA for 0c1c788

• [Docs] Propose a deprecation policy for the project (#17063)

  Show description for 56d64fb
  

  russellb

  and

  DarkLight1337

  authored
  56d64fb

  Copy full SHA for 56d64fb

• Enabling multi-group kernel tests. (#17115)

  Show description for 608968b
  Alexei-V-Ivanov-AMD

  authored
  608968b

  Copy full SHA for 608968b

• [Misc][ROCm] Exclude `cutlass_mla_decode` for ROCm build (#17289)

  Show description for 06ffc7e
  tywuAMD

  authored
  06ffc7e

  Copy full SHA for 06ffc7e

• fix gemma3 results all zero (#17364)

  Show description for d3cf61b
  mayuyuace

  authored
  d3cf61b

  Copy full SHA for d3cf61b

• [Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369)

  Show description for a39203f
  mofanke

  authored
  a39203f

  Copy full SHA for a39203f

• [V1] Remove num_input_tokens from attn_metadata (#17193)

  Show description for 24e6ad3
  heheda12345

  authored
  24e6ad3

  Copy full SHA for 24e6ad3

• Improve literal dataclass field conversion to argparse argument (#17391)

  Show description for 2ef5d10
  hmellor

  authored
  2ef5d10

  Copy full SHA for 2ef5d10

Pagination

Previous

Next