Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 26, 2024

• Merge pull request DefTruth#13 from HarryWu-CHN/kvcache-add

  Show description for a699eaf
  DefTruth

  authored
  a699eaf

• Merge pull request DefTruth#14 from Miroier/main

  Show description for 7c0c1a2
  DefTruth

  authored
  7c0c1a2

• Add Microbenchmark

  Show description for 4a51cde
  Miroier

  authored
  4a51cde

• add gear and keyformer's code

  HarryWu99

  authored
  52576d9

• Merge pull request DefTruth#12 from liyucheng09/main

  Show description for 567180c
  DefTruth

  authored
  567180c

• add SnapKV

  liyucheng09

  committed
  7d5664a

Commits on Apr 24, 2024

• 🔥🔥[RAGCache] RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation(@peking University&ByteDance Inc)

  DefTruth

  authored
  81d70b3

Commits on Apr 21, 2024

• 🔥[Chunked Prefills] SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills(@microsoft etc)

  DefTruth

  authored
  1aa836a

• Update README.md

  DefTruth

  authored
  005dd58

• Update README.md

  DefTruth

  authored
  891be64

• Update README.md

  DefTruth

  authored
  30dfce8

Commits on Apr 20, 2024

• 🔥🔥[Hidden Transfer] Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration(@pku.edu.cn etc)

  DefTruth

  authored
  082ea1f

Commits on Apr 19, 2024

• Merge pull request DefTruth#11 from liyucheng09/main

  Show description for 966a0d5
  DefTruth

  authored
  966a0d5

• LLMLingua-2

  liyucheng09

  committed
  474f38b

Commits on Apr 15, 2024

• [Infini-attention] Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention(@google)

  DefTruth

  authored
  3575822

Commits on Apr 14, 2024

• [Shared Prefixes] Hydragen: High-Throughput LLM Inference with Shared Prefixes

  DefTruth

  authored
  69219b6

• [SqueezeAttention] SQUEEZEATTENTION: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget(@lzu.edu.cn etc)

  DefTruth

  authored
  25cbc41

Commits on Apr 8, 2024

• Merge pull request DefTruth#9 from Mr-Philo/main

  Show description for 94435c0
  DefTruth

  authored
  94435c0

• typo

  Mr-Philo

  committed
  c59ccbd

• typo

  Mr-Philo

  committed
  7035452

• Add github link for paper FP8-Quantization[2202.08]

  Mr-Philo

  committed
  8649c25

Commits on Apr 5, 2024

• DEFT: FLASH TREE-ATTENTION WITH IO-AWARENESS FOR EFFICIENT TREE-SEARCH-BASED LLM INFERENCE

  DefTruth

  authored
  2772107

• Toward Inference-optimal Mixture-of-Expert Large Language Models(@uc San Diego etc)

  DefTruth

  authored
  a1d0f2e

Commits on Apr 1, 2024

• [Transformer-Lite] Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs(@oppo)

  DefTruth

  authored
  21c305e

Commits on Mar 29, 2024

• Merge pull request DefTruth#8 from Janghyun1230/main

  Show description for 854b7f5
  DefTruth

  authored
  854b7f5

• compressed context memory

  Janghyun1230

  committed
  335890a

Commits on Mar 28, 2024

• FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs(@Infinigence-AI)

  DefTruth

  authored
  fb70507

• [Sparsity-Aware KV Caching] ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching(@ucf.edu)

  DefTruth

  authored
  b873ae8

• FASTDECODE: High-Throughput GPU-Efficient LLM Serving using Heterogeneous(@tsinghua University)

  DefTruth

  authored
  0e40c95

Commits on Mar 26, 2024

• Update README.md

  DefTruth

  authored
  e77f813

• Update README.md

  DefTruth

  authored
  6b378bd

• remove un-need files

  DefTruth

  authored
  fb32ba4

• Delete Awesome-LLM-Inference-v0.2.pdf

  DefTruth

  authored
  921db68

• Delete Awesome-LLM-Inference-v0.1.pdf

  DefTruth

  authored
  815a5a8

Commits on Mar 25, 2024

• Update README.md

  DefTruth

  authored
  92acf39

Pagination

Previous

Next