I am interested in building LLM inference platform and runtime at production scale. In my spare time, I like to build small tools for my hobbies: Music, Movie, and Board Games.
Selected projects:
-
vllm-neuron: Run vllm on AWS Neuron hardware
-
nano-kube-llm-server: A demo for running LLM inference server on Kubernetes cluster
-
Chord Master: Build your chord progression
-
Watch Together: Decide the next movie for your movie night with your best one
-
Meeple Mentor: Learn board games with interactive courses and LLM chat
-
Rush Rush Rush: A unity 3D-platformer game




