Skip to content

Commit 408c78e

Browse files
committed
Revert "musa: update compile flags (ggml-org#16265)"
This reverts commit 91a2a56.
1 parent 502cc58 commit 408c78e

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

ggml/src/ggml-cuda/fattn-vec.cuh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -535,6 +535,8 @@ void ggml_cuda_flash_attn_ext_vec_case(ggml_backend_cuda_context & ctx, ggml_ten
535535
float logit_softcap;
536536
memcpy(&logit_softcap, (const float *) KQV->op_params + 2, sizeof(float));
537537

538+
const int cc = ggml_cuda_info().devices[ggml_cuda_get_device()].cc;
539+
538540
if (Q->ne[1] == 1) {
539541
constexpr int cols_per_block = 1;
540542
if (logit_softcap == 0.0f) {

0 commit comments

Comments
 (0)