Pinned Loading

1. LlamaInfer LlamaInfer Public

   LLM Inference Engine: High-performance CUDA-accelerated framework for large language model inference A cutting-edge, open-source implementation of a large language model (LLM) inference engine, opt…

   C++ 7 1

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

3. verl verl Public

   Forked from volcengine/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python

4. BERT_TensorRT_Inference_Optimization BERT_TensorRT_Inference_Optimization Public

   Inference optimization of the BERT model using TensorRT, NVIDIA's high-performance deep learning inference platform. TensorRT is designed to maximize the efficiency of deep learning models during i…

   5

5. Distributed-PoW-based-Fault-Tolerant-Blockchain-System Distributed-PoW-based-Fault-Tolerant-Blockchain-System Public

   Proof-of-Work Blockchain Consensus System: A high-performance, modular implementation of a decentralized blockchain network This project is a robust and scalable implementation of a Proof-of-Work (…

   Go 1

6. CMU_Course_Notes CMU_Course_Notes Public

   This is the combined collection of the course notes for some of the computer science classes at CMU released online.

   63 16