vgpu.rs

vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust

Project Structure

This project is organized as a Cargo workspace containing multiple crates, each with specific responsibilities:

Crates

• hypervisor: The hypervisor implementation that monitors and manages GPU resources. It leverages NVML (NVIDIA Management Library) to track GPU utilization and optimize CUDA workload scheduling.

• cuda-limiter: A dynamic library that intercepts CUDA API calls to enforce resource limits and scheduling policies. Built as a cdylib that can be preloaded into CUDA applications to control their resource usage.

• add-path: A utility library that modifies environment variables like PATH, LD_PRELOAD, and LD_LIBRARY_PATH to ensure proper library loading and execution. Built as a cdylib for runtime loading.

• macro: Contains procedural macros that simplify common patterns used throughout the codebase, improving code readability and reducing boilerplate.

• utils: A collection of common utilities and helper functions shared across the project. Includes tracing, logging, and other infrastructure components.