Code

Fp8 e4m3_fnuz support for rocm#2588

Code

Merged

danieldk merged 5 commits intomainhuggingface/text-generation-inference:mainfrom rocm-fp8huggingface/text-generation-inference:rocm-fp8Copy head branch name to clipboardOct 16, 2024

+211-37

Commits

Commits on Sep 30, 2024

• (feat) fp8 fnuz support for rocm

  mht-sharma

  committed
  f772856

Commits on Oct 14, 2024

• (review comments) Fix compression_config load, type hints

  mht-sharma

  committed
  7a7cd5f

Commits on Oct 15, 2024

• (bug) update all has_tensor

  mht-sharma

  committed
  b2b5024

• (review_comments) fix typo and added comments

  mht-sharma

  committed
  1de9627

• (nit) improved comment

  mht-sharma

  committed
  689aa26