Skip to content

Commit

Permalink
FP16 is supported in CM=6.0 (ggml-org#2177)
Browse files Browse the repository at this point in the history
* FP16 is supported in CM=6.0

* Building PTX code for both of 60 and 61

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
  • Loading branch information
howard0su and JohannesGaessler authored Jul 12, 2023
1 parent 2b5eb72 commit 4e7464e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -272,7 +272,7 @@ if (LLAMA_CUBLAS)

if (NOT DEFINED CMAKE_CUDA_ARCHITECTURES)
if (LLAMA_CUDA_DMMV_F16)
set(CMAKE_CUDA_ARCHITECTURES "61") # needed for f16 CUDA intrinsics
set(CMAKE_CUDA_ARCHITECTURES "60;61") # needed for f16 CUDA intrinsics
else()
set(CMAKE_CUDA_ARCHITECTURES "52;61") # lowest CUDA 12 standard + lowest for integer intrinsics
endif()
Expand Down

0 comments on commit 4e7464e

Please sign in to comment.