Browser based ML Inference | OpenAI compliant | Run models like DeepSeek, Llama 3.2, NomicEmbed, KokoroTTS, and more
-
Updated
Mar 4, 2025 - TypeScript
#
inference-engine
Here are 8 public repositories matching this topic...
Wingman is the fastest and easiest way to run Llama models on your PC or Mac.
windows macos linux downloader ai local download gpu chatbot inference openai gpu-acceleration llama inference-server inference-engine gpu-monitoring llm chatgpt llamacpp
-
Updated
Jun 2, 2024 - TypeScript
run llms and slms on your hardware & browser
desktop-app webgl electron-app webgpu privacy-enhancing-technologies inference-engine ondeviceai ai-lab on-device-ai llamacpp local-ai ollama node-llama-cpp ollama-app quantizedai offline-inference privateai
-
Updated
Nov 11, 2025 - TypeScript
A knowledge graph based forward chain inferencing engine in typescript/node.
nodejs javascript framework typescript artificial-intelligence knowledge-graph inference-engine forward-chaining inferences
-
Updated
Jan 23, 2021 - TypeScript
(WIP) 🚀 High performance nerual network inference engine running on Web.
rust typescript web webassembly wasm multithreading simd webgpu webworker inference-engine onnx wgsl
-
Updated
May 21, 2022 - TypeScript
Filling in the missing gaps with langchain, and creating OO wrappers to simplify some workloads.
agent ai artificial-intelligence openai llama gpt language-model inference-engine gpt3 openai-api gpt4 llm llms langchain llmops cohereai llama-index llamacpp
-
Updated
May 7, 2023 - TypeScript
This is repo is tcontain series of file for the Expert system
data-science data ai agriculture modeling python-script expert-system inference-engine pest-control advisoryapplications croprecommendations smart-farmers-assistance-app
-
Updated
Mar 25, 2025 - TypeScript
An Open-Source web app for you to master Dou Dizhu!
-
Updated
Nov 28, 2025 - TypeScript
Improve this page
Add a description, image, and links to the inference-engine topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the inference-engine topic, visit your repo's landing page and select "manage topics."