Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 8, 2025

• [Docs] Add Slides from Singapore Meetup (#16213)

  Show description for 995e3d1
  simon-mo

  authored
  995e3d1

  Copy full SHA for 995e3d1

• [Misc] Merge the logs of pp layers partitions (#16225)

  Show description for b4ac449
  kebe7jun

  authored
  b4ac449

  Copy full SHA for b4ac449

• [V1] Add `disable_chunked_mm_input` arg to disable partial mm input prefill (#15837)

  Show description for 8e5314a
  mgoin

  authored
  8e5314a

  Copy full SHA for 8e5314a

• [torch.compile][TPU] Make @support_torch_compile work for XLA backend (#15782)

  Show description for 87918e4
  

  lsy323

  and

  mgoin

  authored
  87918e4

  Copy full SHA for 87918e4

• [Bugfix] Fix and reorganize broken GGUF tests and bump gguf version (#16194)

  Show description for f6b32ef
  Isotr0py

  authored
  f6b32ef

  Copy full SHA for f6b32ef

• [Bugfix] Do not skip "empty" parts of chats that are parsable (#16219)

  Show description for b99733d
  mgoin

  authored
  b99733d

  Copy full SHA for b99733d

• Add warning for Attention backends that do not support irope yet (#16212)

  sarckk

  authored
  05a015d

  Copy full SHA for 05a015d

• [Bugfix] fix use-ep bug to enable ep by dp/tp size > 1 (#16161)

  zxfan-cpu

  authored
  ad971af

  Copy full SHA for ad971af

• [V1] Scatter and gather placeholders in the model runner (#16076)

  Show description for f2ebb6f
  

  4 peopleauthored
  f2ebb6f

  Copy full SHA for f2ebb6f

• Update BASE_IMAGE to 2.22 release of Neuron (#16218)

  aws-satyajith

  authored
  1d01211

  Copy full SHA for 1d01211

• [Misc] Update compressed-tensors to version 0.9.3 (#16196)

  Show description for f94ab12
  mlsw

  authored
  f94ab12

  Copy full SHA for f94ab12

• [core] do not send error across process (#16174)

  Show description for a865bc1
  youkaichao

  authored
  a865bc1

  Copy full SHA for a865bc1

• [ROCm][Bugfix][FP8] Make fp8 quant respect fused modules mapping (#16031)

  Show description for 21802c4
  mgoin

  authored
  21802c4

  Copy full SHA for 21802c4

Commits on Apr 7, 2025

• Torchao (#14231)

  Show description for 652907b
  drisspg

  authored
  652907b

  Copy full SHA for 652907b

• [Bugfix][V0] XGrammar structured output supports Enum (#15878)

  Show description for 24f1c01
  leon-seidel

  authored
  24f1c01

  Copy full SHA for 24f1c01

• [Misc] add description attribute in CLI (#15921)

  Show description for fad6e25
  reidliu41

  authored
  fad6e25

  Copy full SHA for fad6e25

• [V1][BugFix] Exit properly if engine core fails during startup (#16137)

  Show description for 7f6d47c
  njhill

  authored
  7f6d47c

  Copy full SHA for 7f6d47c

• [Bugfix] Fix guidance backend for Qwen models (#16210)

  Show description for 3147586
  benchislett

  authored
  3147586

  Copy full SHA for 3147586

• [Misc] Move Llama 4 projector call into encoder execution (#16201)

  ywang96

  authored
  ed636d9

  Copy full SHA for ed636d9

• [Misc] Human-readable `max-model-len` cli arg (#16181)

  Show description for 090c856
  

  NickLucche

  and

  DarkLight1337

  authored
  090c856

  Copy full SHA for 090c856

• Print the warning only once (#16193)

  Show description for ad434d4
  gshtras

  authored
  ad434d4

  Copy full SHA for ad434d4

• [V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158)

  Show description for 66d433b
  DarkLight1337

  authored
  66d433b

  Copy full SHA for 66d433b

• [Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187)

  Show description for 027b204
  DarkLight1337

  authored
  027b204

  Copy full SHA for 027b204

• Upstream Llama4 Support to Main (#16113)

  Show description for 55dcce9
  

  4 peopleauthored
  55dcce9

  Copy full SHA for 55dcce9

• [Doc]Update image to latest version (#16186)

  Show description for 8017c8d
  WangErXiao

  authored
  8017c8d

  Copy full SHA for 8017c8d

• [Misc] improve example mlpspeculator and llm_engine_example (#16175)

  Show description for dc3529d
  reidliu41

  authored
  dc3529d

  Copy full SHA for dc3529d

• [Model] Add Qwen3 and Qwen3MoE (#15289)

  Show description for 7699258
  

  YamPengLi

  and

  DarkLight1337

  authored
  7699258

  Copy full SHA for 7699258

• [V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148)

  Show description for e9ba99f
  shen-shanshan

  authored
  e9ba99f

  Copy full SHA for e9ba99f

• [VLM] Florence-2 supports online serving (#16164)

  Show description for 7c80368
  Isotr0py

  authored
  7c80368

  Copy full SHA for 7c80368

• doc: fix some typos in doc (#16154)

  Show description for 95d63f3
  yihong0618

  authored
  95d63f3

  Copy full SHA for 95d63f3

• [CI] Set max transformers version for Ultravox model test (#16149)

  Show description for bb8dab8
  ywang96

  authored
  bb8dab8

  Copy full SHA for bb8dab8

• [Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129)

  Show description for fc0f877
  Isotr0py

  authored
  fc0f877

  Copy full SHA for fc0f877

• [Misc] Update Mistral-3.1 example (#16147)

  Show description for 0a57386
  DarkLight1337

  authored
  0a57386

  Copy full SHA for 0a57386

• [V1][Minor] Minor simplification for get_computed_blocks (#16139)

  Show description for 3749e28
  WoosukKwon

  authored
  3749e28

  Copy full SHA for 3749e28

• [Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202)

  Show description for 86fc232
  yankay

  authored
  86fc232

  Copy full SHA for 86fc232

Pagination

Previous

Next