Skip to content

Commit 0cb91ea

Browse files
authored
Add more videos (#1011)
1 parent 0ffbf85 commit 0cb91ea

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

README.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -170,14 +170,19 @@ For *most* developers you probably want to skip building custom C++/CUDA extensi
170170
USE_CPP=0 pip install -e .
171171
```
172172

173-
## Integrations
173+
## OSS Integrations
174174

175175
We're also fortunate to be integrated into some of the leading open-source libraries including
176176
1. Hugging Face transformers with a [builtin inference backend](https://huggingface.co/docs/transformers/main/quantization/torchao) and [low bit optimizers](https://github.com/huggingface/transformers/pull/31865)
177-
2. Hugging Face diffusers best practices with torch.compile and torchao [standalone repo](https://github.com/sayakpaul/diffusers-torchao)
177+
2. Hugging Face diffusers best practices with torch.compile and torchao in a standalone repo [diffusers-torchao](https://github.com/sayakpaul/diffusers-torchao)
178178
3. Mobius HQQ backend leveraged our int4 kernels to get [195 tok/s on a 4090](https://github.com/mobiusml/hqq#faster-inference)
179+
4. [TorchTune](https://github.com/pytorch/torchtune) for our QLoRA and QAT recipes
180+
5. [torchchat](https://github.com/pytorch/torchtune) for post training quantization
181+
6. [SGLang](https://github.com/sgl-project/sglang/pull/1341) for LLM inference quantization
179182

180183
## Videos
184+
* [Keynote talk at GPU MODE IRL](https://youtu.be/FH5wiwOyPX4?si=VZK22hHz25GRzBG1&t=1009)
185+
* [Low precision dtypes at PyTorch conference](https://youtu.be/xcKwEZ77Cps?si=7BS6cXMGgYtFlnrA)
181186
* [Slaying OOMs at the Mastering LLM's course](https://www.youtube.com/watch?v=UvRl4ansfCg)
182187
* [Advanced Quantization at CUDA MODE](https://youtu.be/1u9xUK3G4VM?si=4JcPlw2w8chPXW8J)
183188
* [Chip Huyen's GPU Optimization Workshop](https://www.youtube.com/live/v_q2JTIqE20?si=mf7HeZ63rS-uYpS6)

0 commit comments

Comments
 (0)