Awesome-LLM-Application

Table of Content

---

• [Awesome-LLM-Application]
  • Input UI
  • Input Augment
  • Model Augment
  • RAG-system
  • LLM serving
  • LLM evaluate system

Input UI

---

Blogs

Trending Projects

• Flowise
• chainlit
• autogen-ui
• langui

Companys

Input Augment

---

Blogs

title	content	updated time
使用 Langchain 的 LLM 的对话记忆		25/06/2023

Model Augment

Blogs

title	content	domain	updated time
Calculate GPU Requirements for Your LLM Training		hardware	06/12/2023
Large Language Models - The Hardware Connection		hardware	03/10/2023

RAG System

---

Blogs

blog	content	updated time
The architecture of today’s LLM applications		30/10/2023
Building RAG-based LLM Applications for Production		25/10/2023

papers

Frameworks

companys

LLM Serving

---

Blogs

title	content	domain	updated time
A guide to LLM inference and performance		hardware	07/11/2023
A Comprehensive Guide to Selecting and Estimating GPUs for Serving ML Models		hardware	05/07/2023
7 Frameworks for Serving LLMs			31/7/2023
[Optimized large language model (LLM) serving
大语言模型的模型量化(INT8/INT4)技术		quant	6/7/2023
NVIDIA HPC Application Performance		hardware	/

Trending Frameworks

• Text Generation Inference
• vLLM
• OpenLLM
• mlc-llm
• ollama

papers

title	content	domain	conference	data
ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models			25/1/2024
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness			27/05/2023
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
Efficient memory management for large language model serving with pagedattention

Frameworks

LLM Evaluate

---

others

blogs