Skip to content

Commit 298bb2f

Browse files
committed
Update blog
1 parent 1d77e94 commit 298bb2f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

content/blog/2025-10-10-1760088945.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ This could change in the future! The idea of a cross-vendor ML compiler is clear
2222

2323
## What's an ML compiler?
2424

25-
The basic idea of an ML compiler is to treat an ML model's execution graph as a program to compile, and to produce an optimized set of GPU-specific instructions. The compiler can optimize the execution graph by doing things like fusing operations together, parallelizing operations when possible, and even mapping groups of operators to GPU-specific instructions. It can use its knowledge of the target GPU architecture to optimize the memory layout and parallelism of operations. Basically what compilers already do for CPUs today, but for GPUs.
25+
It's a compiler for ML models (*not a compiler that uses ML to compile*). The basic idea of an ML compiler is to treat an ML model's execution graph as a program to compile, and to produce an optimized set of GPU-specific instructions. The compiler can optimize the execution graph by doing things like fusing operations together, parallelizing operations when possible, and even mapping groups of operators to GPU-specific instructions. It can use its knowledge of the target GPU architecture to optimize the memory layout and parallelism of operations. Basically what compilers already do for CPUs today, but for GPUs.
2626

2727
We already have a decent graph format: ONNX. Every model that I intend to support has ONNX exports available (and it's easy to export one, for new models).
2828

0 commit comments

Comments
 (0)