Skip to content

Add async background warmup to reduce first-kernel latency #721

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
KaanKesginLW wants to merge 7 commits into
base: main
Choose a base branch
from
+161 −4

Use Threads.@spawn instead of @async for warmup task

d4db4a1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Add async background warmup to reduce first-kernel latency #721

Use Threads.@spawn instead of @async for warmup task
d4db4a1
Select commit
Loading
Failed to load commit list.
benchmark
succeeded Dec 14, 2025 in 1h 12m 49s