vram

Hardware-accelerated Linux kernel block driver and multi-tier memory cascade (ZRAM ➔ PCIe VRAM ➔ NVMe). Opportunistically leases idle GPU memory as a zero-allocation, revocable swap cache with sub-millisecond latency, zero SSD wear, and crash-safety on Linux & WSL2.

Rust block device in userspace

The local-inference observability layer for your terminal: live tokens/sec, VRAM-spill & throttle warnings, the GPU metrics nvidia-smi can't show. Also a gorgeous htop/btop-class system monitor. Rust, zero deps.

Which local LLMs can your computer run? Hardware-aware CLI, TUI and GUI: yes/slow/no verdicts and tok/s from your GPU VRAM and RAM, then verified installs via Ollama, llama.cpp, MLX and LM Studio. Native Rust.

A high-performance local LLM inference engine written in Rust. Dynamically streams transformer layers to break VRAM limitations and run massive models on consumer hardware.

Zero-copy GPU video pipeline in Rust. Decode, filter, run neural nets, encode and stream - frame data never leaves VRAM.

VRAM priority for the focused window on GNOME, via dmem cgroups

Which language models will actually run well on your machine. Measured, not looked up. Free, offline, for Windows, macOS and Linux.

External RAM and VRAM measurement for Rust processes (Windows DXGI + NVML, Linux NVML).

VRAM priority for the focused window on the Umbriel compositor, via dmem cgroups

Deterministic model residency — keep declared models warm, and tell the truth about which ones are.

Local GPU capacity scheduler. One daemon owns the card; models pack, queue, or park in RAM

Intelligent GPU memory tiering for local LLM inference. When your model spills past VRAM, spill makes it fast. llama.cpp plugin.

GPU VRAM visualizer TUI for AMD UMA

GPU-aware system monitor for Windows. Per-process VRAM, dual GPU support, hardware controls. Single binary, Rust.

Rust + libcosmic system monitor for the COSMIC desktop: CPU, RAM, GPU/VRAM and power in the panel, one-hour history popup, vLLM and Ollama monitoring over a WebSocket agent, and a btop-like process manager with search, SIGTERM and SIGKILL.