MengqingCao
Follow
Starred repositories
MengqingCao / vllm
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
veRL: Volcano Engine Reinforcement Learning for LLM
Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
Utilities intended for use with Llama models.
A generative speech model for daily dialogue.
Port of OpenAI's Whisper model in C/C++
Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Inference and training library for high-quality TTS models.
mllm-npu: training multimodal large language models on Ascend NPUs
Accessible large language models via k-bit quantization for PyTorch.
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
A high-throughput and memory-efficient inference and serving engine for LLMs
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
libLBFGS: a library of Limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS)