Commits

Branch selector

 main

User selector

fmassa

Datepicker

All time

Commit History

Commits on Aug 27, 2024

• Deprecate xformers.components (fairinternal/xformers#1210)

  Show description for 2bc3175
  

  fmassa

  authored and

  xFormers Bot

  committed
  2bc3175

  Copy full SHA for 2bc3175

Commits on Aug 26, 2024

• Remove HOWTO.md and remove legacy info from README.md (fairinternal/xformers#1206)

  Show description for 616e5bd
  

  fmassa

  authored and

  xFormers Bot

  committed
  616e5bd

  Copy full SHA for 616e5bd

Commits on Aug 8, 2024

• Remove dependency on triton.ops.blocksparse (fairinternal/xformers#1179)

  Show description for 2bcbc55
  

  fmassa

  authored and

  xFormers Bot

  committed
  2bcbc55

  Copy full SHA for 2bcbc55

Commits on Jul 2, 2024

• Fix SAC for older PyTorch (fairinternal/xformers#1146)

  Show description for 691b03d
  

  fmassa

  authored and

  xFormers Bot

  committed
  691b03d

  Copy full SHA for 691b03d

Commits on Jun 24, 2024

• Update SAC to work with latest PyTorch (fairinternal/xformers#1138)

  Show description for cca3421
  

  fmassa

  authored and

  xFormers Bot

  committed
  cca3421

  Copy full SHA for cca3421

• Remove legacy triton operators (fairinternal/xformers#1140)

  Show description for 9ed9561
  

  fmassa

  authored and

  xFormers Bot

  committed
  9ed9561

  Copy full SHA for 9ed9561

Commits on Mar 11, 2024

• Make checkpoint work with compile in no_grad mode (fairinternal/xformers#1049)

  Show description for f4e487c
  

  fmassa

  authored and

  xFormers Bot

  committed
  f4e487c

  Copy full SHA for f4e487c

Commits on Mar 5, 2024

• Fix selective activation checkpointing with random ops (fairinternal/xformers#1045)

  Show description for 5c8b7c9
  

  fmassa

  authored and

  xFormers Bot

  committed
  5c8b7c9

  Copy full SHA for 5c8b7c9

Commits on Jan 30, 2024

• Make selective_checkpoint_wrapper work within torch.compile (fairinternal/xformers#1015)

  Show description for e6e6695
  

  fmassa

  authored and

  xFormers Bot

  committed
  e6e6695

  Copy full SHA for e6e6695

Commits on Sep 26, 2023

• Move selective checkpoint to open-source (fairinternal/xformers#808)

  Show description for 48a6ef9
  

  fmassa

  authored and

  xFormers Bot

  committed
  48a6ef9

  Copy full SHA for 48a6ef9

Commits on Sep 6, 2023

• Deprecate xformers/factory (facebookresearch#850)

  Show description for 4e096c4
  fmassa

  authored
  4e096c4

  Copy full SHA for 4e096c4

• Remove experimental folder (facebookresearch#851)

  Show description for 0e520d2
  fmassa

  authored
  0e520d2

  Copy full SHA for 0e520d2

Commits on Sep 5, 2023

• Remove NVFuser from xFormers (facebookresearch#843)

  Show description for e831335
  fmassa

  authored
  e831335

  Copy full SHA for e831335

Commits on Jul 31, 2023

• Add varying sequence length support to Split KV MHA (fairinternal/xformers#736)

  Show description for 82254f4
  

  fmassa

  authored and

  xFormers Bot

  committed
  82254f4

  Copy full SHA for 82254f4

Commits on Mar 31, 2023

• Update xFormers to use nightly triton (fairinternal/xformers#532)

  Show description for 986a3e0
  

  fmassa

  authored and

  xFormers Bot

  committed
  986a3e0

  Copy full SHA for 986a3e0

Commits on Dec 15, 2022

• Let flash-attention go through the PyTorch Dispatcher (fairinternal/xformers#401)

  Show description for 89177a9
  

  fmassa

  authored and

  xFormers Bot

  committed
  89177a9

  Copy full SHA for 89177a9

Commits on Nov 29, 2022

• FlashAttention needs contiguous gradients (facebookresearch#548)

  Show description for c733c99
  fmassa

  authored
  c733c99

  Copy full SHA for c733c99

Commits on Aug 26, 2022

• Raise early errors if submodules not available (facebookresearch#370)

  fmassa

  authored
  bfbd373

  Copy full SHA for bfbd373

Commits on Aug 25, 2022

• More attention kernels to its own folder (facebookresearch#368)

  fmassa

  authored
  096e8ef

  Copy full SHA for 096e8ef

• Use cutlass for memory-efficient attention (facebookresearch#362)

  Show description for 5958b18
  

  fmassa

  and

  danthe3rd

  authored
  5958b18

  Copy full SHA for 5958b18

Commits on May 10, 2022

• Fix sddmm2 when nnz=0 (facebookresearch#300)

  Show description for bcedfaf
  fmassa

  authored
  bcedfaf

  Copy full SHA for bcedfaf

• [fix] Remove double dropout in global attention (facebookresearch#301)

  fmassa

  authored
  72f969f

  Copy full SHA for 72f969f

Commits on Apr 26, 2022

• Handle non-contiguous grad_out and add checks for qkv (facebookresearch#282)

  Show description for 7f24711
  fmassa

  authored
  7f24711

  Copy full SHA for 7f24711

Commits on Apr 25, 2022

• Memory efficient attention - backward pass (facebookresearch#281)

  Show description for a0fb375
  fmassa

  authored
  a0fb375

  Copy full SHA for a0fb375

Commits on Apr 12, 2022

• Memory-efficient attention - forward pass (facebookresearch#267)

  Show description for f78ba0a
  fmassa

  authored
  f78ba0a

  Copy full SHA for f78ba0a

Commits on Feb 9, 2022

• Make triton optional in BlockSparseTensor (facebookresearch#214)

  fmassa

  authored
  6c4cfbe

  Copy full SHA for 6c4cfbe

Commits on Feb 8, 2022

• Fix causal flag on softmax Triton on CPU (facebookresearch#212)

  fmassa

  authored
  31c2292

  Copy full SHA for 31c2292

Commits on Feb 7, 2022

• [feat] Add nd-tensor support for triton softmax (facebookresearch#210)

  Show description for aa6c77f
  fmassa

  authored
  aa6c77f

  Copy full SHA for aa6c77f

• Cleanup sparse tests (facebookresearch#208)

  Show description for b160b05
  fmassa

  authored
  b160b05

  Copy full SHA for b160b05

Commits on Feb 6, 2022

• Create BlockSparse Tensor (facebookresearch#202)

  Show description for 1ba0f5c
  fmassa

  authored
  1ba0f5c

  Copy full SHA for 1ba0f5c

Commits on Jan 28, 2022

• Optimize sparse transpose (facebookresearch#199)

  fmassa

  authored
  4acffd4

  Copy full SHA for 4acffd4

Commits on Dec 20, 2021

• [doc] Improve installation instructions on OSX (facebookresearch#159)

  fmassa

  authored
  5148844

  Copy full SHA for 5148844

Commits on Dec 2, 2021

• Introduce SparseCSRTensor as a replacement for SparseCS (facebookresearch#124)

  Show description for cbcd0f9
  fmassa

  authored
  cbcd0f9

  Copy full SHA for cbcd0f9

Commits on Nov 10, 2021

• [CI] Automate binary releases (facebookresearch#84)

  Show description for c92931b
  fmassa

  authored
  c92931b

  Copy full SHA for c92931b