Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metal : enable shader debugging (cmake option) #4705

Merged
merged 11 commits into from
Jan 2, 2024
+329 −230
Merged

metal : enable shader debugging (cmake option) #4705

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
75c14f2
ggml : disable fast-math for Metal (cmake build only)
ggerganov Dec 30, 2023
515cfec
metal : fix Metal API debug warnings
ggerganov Dec 30, 2023
a184e10
cmake : add -fno-inline for Metal build (#4545)
ggerganov Dec 30, 2023
1580805
metal : fix API debug warnings
ggerganov Dec 30, 2023
b14b5a9
metal : fix compile warnings
ggerganov Dec 31, 2023
4c054d9
metal : use uint64_t for strides
ggerganov Dec 31, 2023
6435a3d
cmake : rename option to LLAMA_METAL_SHADER_DEBUG
ggerganov Dec 31, 2023
ad7cf37
metal : fix mat-vec Q8_0 kernel for BS > 1
ggerganov Dec 31, 2023
049a32f
metal : normalize mat-vec kernel signatures
ggerganov Dec 31, 2023
a8b9bb4
cmake : respect LLAMA_QKK_64 option
ggerganov Dec 31, 2023
dd59578
metal : fix mat-vec Q4_K kernel for QK_K == 64
ggerganov Dec 31, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
metal : use uint64_t for strides
  • Loading branch information
@ggerganov
ggerganov committed Dec 31, 2023
commit 4c054d98d4dd70141fb779b47d7b887b63efda02
Loading
Loading