Add USE_FLASH_ATTENTION flag to setup.py (pytorch#92903)

# Summary Adds documentation to setup.py for USE_FLASH_ATTENTION=0 disabling to decrease build times. Pull Request resolved: pytorch#92903 Approved by: https://github.com/cpuhrsch, https://github.com/bdhirsh
Mookel · Jan 24, 2023 · 4bc0491 · 4bc0491
1 parent bf1ff49
commit 4bc0491
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/setup.py b/setup.py
@@ -95,6 +95,9 @@
 #   USE_FFMPEG
 #     enables use of ffmpeg for additional operators
 #
+#   USE_FLASH_ATTENTION=0
+#     disables building flash attention for scaled dot product attention
+#
 #   USE_LEVELDB
 #     enables use of LevelDB for storage
 #