Commits

Branch selector

 master

User selector

rohithkrn

Datepicker

All time

Commit History

Commits on Jul 23, 2024

• fix typo in test name (#2224)

  rohithkrn

  authored
  05c9351

  Copy full SHA for 05c9351

Commits on Jul 22, 2024

• [post-7/22]Add chunked prefill support in vllm and lmi-dist (#2202)

  rohithkrn

  authored
  404918d

  Copy full SHA for 404918d

Commits on Jul 19, 2024

• Update max_model_len for llama-3 lora test (#2205)

  rohithkrn

  authored
  e884131

  Copy full SHA for e884131

Commits on Jun 6, 2024

• Add llama-3 lora test (#2027)

  rohithkrn

  authored
  b15f73e

  Copy full SHA for b15f73e

Commits on May 28, 2024

• fix t5 tokenizer and prompt token failures (#1966)

  rohithkrn

  authored
  714fabf

  Copy full SHA for 714fabf

Commits on May 24, 2024

• Add vllm and lmi-dist lora awq tests (#1937)

  rohithkrn

  authored
  030a745

  Copy full SHA for 030a745

Commits on May 16, 2024

• [BugFix] Fix bug when invalid adapters are passed (#1920)

  rohithkrn

  authored
  d386298

  Copy full SHA for d386298

Commits on May 3, 2024

• Use s3 models for llama gptq (#1872)

  rohithkrn

  authored
  6814626

  Copy full SHA for 6814626

Commits on Apr 11, 2024

• update lora test to tp=max and variable prompt lengths (#1766)

  rohithkrn

  authored
  a8f1e76

  Copy full SHA for a8f1e76

Commits on Apr 5, 2024

• [Docs]Add link to configuration in benchmarking doc (#1738)

  rohithkrn

  authored
  9ff8fea

  Copy full SHA for 9ff8fea

Commits on Apr 1, 2024

• Update lmi-dist docs v9 (#1706)

  rohithkrn

  authored
  eb02e37

  Copy full SHA for eb02e37

Commits on Mar 27, 2024

• [lmi-dist]validate usage lora and speculative together (#1684)

  rohithkrn

  authored
  3f1a854

  Copy full SHA for 3f1a854

• install huggingface_hub for lmi-dist lora test (#1679)

  rohithkrn

  authored
  b628083

  Copy full SHA for b628083

• Add lora support in lmi-dist (#1664)

  rohithkrn

  authored
  e3fb4f2

  Copy full SHA for e3fb4f2

Commits on Mar 19, 2024

• Update lmi-dist rolling batch to use rubikon engine (#1639)

  rohithkrn

  authored
  203f759

  Copy full SHA for 203f759

Commits on Mar 12, 2024

• Refactor vllm and rubikon engine rolling batch (#1623)

  rohithkrn

  authored
  f7aefee

  Copy full SHA for f7aefee

Commits on Mar 11, 2024

• Add handler for new lmi-dist (#1595)

  rohithkrn

  authored
  82d2bae

  Copy full SHA for 82d2bae

Commits on Feb 29, 2024

• Remove test as the model is incompatible with transformers upgrade (#1575)

  rohithkrn

  authored
  a35a1f0

  Copy full SHA for a35a1f0

Commits on Feb 22, 2024

• Update trt-llm docs (#1562)

  rohithkrn

  authored
  4de48df

  Copy full SHA for 4de48df

• [Docs]TRT-LLM user guide (#1546)

  rohithkrn

  authored
  456311a

  Copy full SHA for 456311a

Commits on Jan 22, 2024

• test different options of rolling batch option for trt-llm (#1504)

  rohithkrn

  authored
  300dc5e

  Copy full SHA for 300dc5e

• Fix trtllm check logic (#1501)

  rohithkrn

  authored
  e462106

  Copy full SHA for e462106

Commits on Jan 9, 2024

• downgrade pynvml version to be compatible with SM Hosts (#1467)

  rohithkrn

  authored
  be17dc1

  Copy full SHA for be17dc1

Commits on Jan 8, 2024

• [TRT-LLM] Update docs for newly added TRT-LLM build args in 0.7.1 (#1461)

  rohithkrn

  authored
  603caa7

  Copy full SHA for 603caa7

Commits on Jan 5, 2024

• disable mixtral custom all reduce flag (#1458)

  rohithkrn

  authored
  8b04931

  Copy full SHA for 8b04931

Commits on Jan 3, 2024

• parameterize trtllm version (#1441)

  rohithkrn

  authored
  698587f

  Copy full SHA for 698587f

Commits on Dec 13, 2023

• update models for TRT-LLM 0.6.1 (#1392)

  rohithkrn

  authored
  91c0e52

  Copy full SHA for 91c0e52

Commits on Nov 8, 2023

• formatPython (#1292)

  rohithkrn

  authored
  af7f369

  Copy full SHA for af7f369

• update smoothquant arg (#1291)

  rohithkrn

  authored
  7a276eb

  Copy full SHA for 7a276eb

Commits on Nov 7, 2023

• trtllm integ tests

  Show description for a3f1513
  

  rohithkrn

  authored and

  Qing Lan

  committed
  a3f1513

  Copy full SHA for a3f1513

Commits on Nov 6, 2023

• Add tokenizer check for triton repo (#1274)

  rohithkrn

  authored
  da40382

  Copy full SHA for da40382

• install datasets in trtllm container (#1270)

  rohithkrn

  authored
  c99e625

  Copy full SHA for c99e625

Commits on Nov 3, 2023

• update lora model id in correctness test (#1263)

  rohithkrn

  authored
  a6fa50e

  Copy full SHA for a6fa50e

• Update trtllm toolkit path (#1260)

  rohithkrn

  authored
  7660014

  Copy full SHA for 7660014

Commits on Nov 1, 2023

• Add trt-llm engine build step during model initialization (#1235)

  Show description for a58a735
  

  rohithkrn

  and

  zachgk

  authored
  a58a735

  Copy full SHA for a58a735

Pagination

Previous

Next