Large Language Model Text Generation Inference
-
Updated
Dec 23, 2024 - Python
Large Language Model Text Generation Inference
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
A familiar HTTP Service Framework for Python.
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
🩹Editing large language models within 10 seconds⚡
🦙 Integrating LLMs into structured NLP pipelines
The simplest way to serve AI/ML models in production
🤖 A PyTorch library of curated Transformer models and their composable components
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
API spec validator and OpenAPI document generator for Python web frameworks.
💫 REST microservices for various spaCy-related tasks
Add a description, image, and links to the falcon topic page so that developers can more easily learn about it.
To associate your repository with the falcon topic, visit your repo's landing page and select "manage topics."