llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
-
Updated
Jul 11, 2025 - Python
llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
Hands-on Machine Learning Infrastructure on Kubernetes. Using Microk8s/Ubuntu on Paperspace Cloud.
Evidence-driven PresentMon diagnostics and policy modeling paired with bounded owned-lab D3D11 runtime actuation.
Agent Skills and an MCP server for GPU performance profiling, benchmarking, optimization, and reporting, with an inference focus.
Comprehensive performance analysis of DeepSeek V3 quantization levels (FP16, Q8_0, Q4_0) on 16GB GPU environments.
Interactive theoretical Kimi-K3 inference roofline calculator for H200, B300, and GB300
Reproducible long-context inference benchmark comparing vLLM, SGLang, and TensorRT-LLM on NVIDIA GB10.
Python lab for exploring memory bandwidth, cache effects, and locality in accelerator workloads
Hybrid XGBoost + PyTorch ML system for semiconductor scaling analysis and real-time GPU FPS prediction with SHAP, LIME, and Scaling Integrated Gradients explainability.
Measured LLM inference studies on quantization, sparsity, GPU energy, KV-cache pruning, and vLLM serving.
Inference optimization experiments on Qwen2.5-3B with vLLM (throughput, latency, prefix cache exploration).
Reproducible H100 GPU-seconds/request study for 91 pinned Command A+ vLLM runs, with held-out evaluation, coverage diagnostics, and independent verification.
Comprehensive machine learning benchmarking framework for AMD MI300X GPUs on Dell PowerEdge XE9680 hardware. Supports both inference (vLLM) and training workloads with containerized test suites, hardware monitoring, and analysis tools for performance, power efficiency, and scalability research across the complete ML pipeline.
Reproducible CUDA kernel optimization and vLLM inference profiling on NVIDIA GPUs.
Trace a PyTorch fusion, verify Triton candidates against eager, and compare real T4 timings. failures recorded.
Correctness-first verification, profiling, and RL rewards for AI-written Triton kernels.
Adjust GPU core clock and memory speeds to improve frame rates and hardware performance in gaming applications.
To associate your repository with the gpu-performance topic, visit your repo's landing page and select "manage topics."