Support e4m3fn
KV cache (#2655)
#1547
Job | Run time |
---|---|
7m 45s | |
6m 24s | |
6m 31s | |
6m 11s | |
2m 8s | |
2m 47s | |
0s | |
53m 30s | |
1h 25m 16s |
e4m3fn
KV cache (#2655)
#1547
Job | Run time |
---|---|
7m 45s | |
6m 24s | |
6m 31s | |
6m 11s | |
2m 8s | |
2m 47s | |
0s | |
53m 30s | |
1h 25m 16s |