Code

[FIX] Make flash_attn optional#3269

Code

Merged

WoosukKwon merged 5 commits intomainvllm-project/vllm:mainfrom revert-favllm-project/vllm:revert-faCopy head branch name to clipboardMar 8, 2024

+41-78

Commits

Commits on Mar 8, 2024

• Revert "Separate attention backends (#3005)"

  Show description for 5c6c40f
  WoosukKwon

  committed
  5c6c40f

  Copy full SHA for 5c6c40f

• Keep XFormers backend

  WoosukKwon

  committed
  cc11b04

  Copy full SHA for cc11b04

• yapf

  WoosukKwon

  committed
  c77e5d7

  Copy full SHA for c77e5d7

• Add back FlashAttentionBackend

  WoosukKwon

  committed
  17eea51

  Copy full SHA for 17eea51

• Optionally use FlashAttentionBackend

  WoosukKwon

  committed
  be749df

  Copy full SHA for be749df