demo.mp4

WebLLM Assistant brings the power of AI agent directly to your browser! Powered by WebGPU, WebLLM Assistant runs completely inside your browser and ensures 100% data privacy while providing seamless AI assistance as you browse the internet.

🚀 Features

• Private AI Chat: Engage with an AI about the webpage you're currently viewing without any data leaving your browser.
• Google Calendar Integration: View and create events on your Google Calendar directly through the assistant.
• Overleaf Document Editing: Modify your Overleaf documents with ease, all within your browser.

⚠️ Early Development Stage

Please note that WebLLM Assistant is in the early stages of development. While we're excited to share our progress, you may encounter bugs or incomplete features. We're actively working to improve and expand the assistant's capabilities.

Getting Started

1. Install Dependencies

Using your preferred JavaScript package manager to install the dependencies.

npm install
# or
yarn
# or
pnpm install

2. Build the Project

npm run build
# or
yarn build
# or
pnpm run build

3. Install the Chrome extension

Launch Google Chrome and navigate to the extensions page by entering chrome://extensions. Enable Developer Mode by clicking the toggle switch next to Developer mode. Click the Load unpacked button and select the dist directory.

Links

• You might want to check out our online public Machine Learning Compilation course for a systematic walkthrough of our approaches.
• WebLLM is a companion project using MLC LLM's WebGPU and WebAssembly backend.
• WebStableDiffusion is a companion project for diffusion models with the WebGPU backend.
• Icons from FlatIcon