Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Metal doesn't work in x86 macos #6975

Closed
qq249356520 opened this issue Apr 29, 2024 · 1 comment · Fixed by #7940
Closed

Metal doesn't work in x86 macos #6975

qq249356520 opened this issue Apr 29, 2024 · 1 comment · Fixed by #7940
Labels
bug-unconfirmed stale

Comments

@qq249356520
Copy link

qq249356520 commented Apr 29, 2024 •
edited
Loading

MacOS CPU:Intel Core i7
GPU:AMD Radeon Pro 5500 XT 8 GB
memory:32G

When I open metal in this mac to run " ./main -m "./Meta-Llama-3-8B.Q4_0.gguf" -p "Hi you how are you" -n 50 -e -ngl 33 -t 4 "

the error occured :
image

If I close the metal, it worked. How to fix it in X86 cpu?
@arnfaldur
Copy link

Which version of llama.cpp are you using?

The ggml-metal.metal file that's being reported as missing should be in the root of the repo. Make sure you are running the latest version and that it is there.

@github-actions github-actions bot added the stale label Jun 14, 2024
olexiyb added a commit to Sanctum-AI/llama.cpp that referenced this issue Jun 14, 2024
@olexiyb
On april 2 github macos-latest became arm https://github.com/action…
2f08455 
…s/runner-images/pull/9601/files

In order to use old `macos-latest` we should use `macos-12`

Potentially will fix: ggerganov#6975
@olexiyb olexiyb mentioned this issue Jun 14, 2024
Merged
2 tasks
ggerganov pushed a commit that referenced this issue Jun 14, 2024
@olexiyb
ci : fix macos x86 build (#7940)
f8ec887 
In order to use old `macos-latest` we should use `macos-12`

Potentially will fix: #6975
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug-unconfirmed stale
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix macos x86 build Sanctum-AI/llama.cpp
2 participants
@arnfaldur @qq249356520