BrowserAI 🚀

BrowserAI: Run LLMs in the Browser - Simple, Fast, and Open Source!

🎥 Demo

Why BrowserAI?

• 🔒 Privacy First: All processing happens locally - your data never leaves the browser
• 💰 Cost Effective: No server costs or complex infrastructure needed
• 🌐 Offline Capable: Models work offline after initial download
• 🚀 Blazing Fast: WebGPU acceleration for near-native performance
• 🎯 Developer Friendly: Simple API, multiple engine support, ready-to-use models

🎯 Perfect For

• Web developers building AI-powered applications
• Companies needing privacy-conscious AI solutions
• Researchers experimenting with browser-based AI
• Hobbyists exploring AI without infrastructure overhead

✨ Features

• 🎯 Run AI models directly in the browser - no server required!
• ⚡ WebGPU acceleration for blazing fast inference
• 🔄 Seamless switching between MLC and Transformers engines
• 📦 Pre-configured popular models ready to use
• 🛠️ Easy-to-use API for text generation and more

🚀 Quick Start

bash
npm install @browserai/browserai

OR

bash
yarn add @browserai/browserai

Basic Usage

import { BrowserAI } from '@browserai/browserai';

const browserAI = new BrowserAI();

browserAI.loadModel('llama-3.2-1b-instruct');

const response = await browserAI.generateText('Hello, how are you?');
console.log(response);

📚 Examples

Text Generation with Custom Parameters

const ai = new BrowserAI();
await ai.loadModel('llama-3.2-1b-instruct', {
quantization: 'q4f16_1' // Optimize for size/speed
});
const response = await ai.generateText('Write a short poem about coding', {
temperature: 0.8,
maxTokens: 100
});

Speech Recognition

const ai = new BrowserAI();
await ai.loadModel('whisper-tiny-en');
const audioBlob = await ai.stopRecording();
const transcription = await ai.transcribeAudio(audioBlob);

Text-to-Speech

const ai = new BrowserAI();
const audioBuffer = await ai.textToSpeech('Hello, how are you today?');
// Play the audio...

🔧 Supported Models

More models will be added soon. Request a model by creating an issue.

MLC Models

• Llama-3.2-1b-Instruct
• SmolLM2-135M-Instruct
• SmolLM2-350M-Instruct

Transformers Models

• Llama-3.2-1b-Instruct
• Whisper-tiny-en (Speech Recognition)
• SpeechT5-TTS (Text-to-Speech)

🗺️ Enhanced Roadmap

Phase 1: Foundation

• 🎯 Simplified model initialization
• 📊 Basic monitoring and metrics
• 🔍 Simple RAG implementation
• 🛠️ Developer tools integration

Phase 2: Advanced Features

• 📚 Enhanced RAG capabilities
  • Hybrid search
  • Auto-chunking
  • Source tracking
• 📊 Advanced observability
  • Performance dashboards
  • Memory profiling
  • Error tracking

Phase 3: Enterprise Features

• 🔐 Security features
• 📈 Advanced analytics
• 🤝 Multi-model orchestration

🤝 Contributing

We welcome contributions! Feel free to:

1. Fork the repository
2. Create your feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

• MLC AI for their incredible mode compilation library and support for webgpu runtime and xgrammar
• Hugging Face for their Transformers.js library
• All our contributors and supporters!

---

Made with ❤️ for the AI community