Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metal : fix flash attention kernel requirements #7169

Merged
merged 2 commits into from
May 10, 2024
Merged

Conversation

ggerganov
Copy link
Owner

fix #7085

@mofosyne mofosyne added bugfix fixes an issue or bug Review Complexity : High Generally require indepth knowledge of LLMs or GPUs need feedback Testing and feedback with results are needed labels May 9, 2024
@mofosyne
Copy link
Collaborator

gg waiting for confirmation by @Animaxx if this fixes the problem he is observing in #7085 before merging

@mofosyne mofosyne self-assigned this May 10, 2024
@mofosyne mofosyne self-requested a review May 10, 2024 06:01
@Animaxx
Copy link

Animaxx commented May 10, 2024

just verified It works for my iOS devices, thanks!

@ggerganov ggerganov merged commit 18e4376 into master May 10, 2024
66 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix fixes an issue or bug need feedback Testing and feedback with results are needed Review Complexity : High Generally require indepth knowledge of LLMs or GPUs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Unable to load on iOS device after update - Compiler encountered an internal error
3 participants