Skip to content

[SpecDecode][Kernel] Use Flashinfer for Rejection Sampling in Speculative Decoding #19163

[SpecDecode][Kernel] Use Flashinfer for Rejection Sampling in Speculative Decoding

[SpecDecode][Kernel] Use Flashinfer for Rejection Sampling in Speculative Decoding #19163

ruff (3.12)

succeeded Aug 31, 2024 in 9s