Skip to content

RoPE: fix back, CUDA support for back + noncont. #327

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jan 14, 2025
Merged

RoPE: fix back, CUDA support for back + noncont. #327

merged 1 commit into from
Jan 14, 2025

Conversation

@Nexesenex
Copy link
Owner

No description provided.

@Nexesenex Nexesenex merged commit 956090a into Nexesenex:lcpp_pr_cuda_rope_fix_back Jan 14, 2025
3 checks passed
Nexesenex added a commit that referenced this pull request May 20, 2025
@Nexesenex
Improved IQ1_M quantization #327
6c77a05
Nexesenex added a commit that referenced this pull request May 20, 2025
@Nexesenex
Improved IQ1_M quantization #327
ed8744c
Nexesenex added a commit that referenced this pull request May 20, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
60f5ca2 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request May 21, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
6a0c0a7 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex pushed a commit that referenced this pull request May 24, 2025
@ikawrakow
Improved IQ1_M quantization (#327)
d210661 
* Much faster and it looks like better iq1_m quantiation

* Cleanup

* Minor

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 8, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
12175fe 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 8, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
b991f25 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 8, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
c802479 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 8, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
f506409 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 9, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
a6e54b9 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 9, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
136f5b9 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 10, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
76a094b 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 11, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
c303006 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 12, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
15c485a 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 12, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
68d3874 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 13, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
336de1e 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 14, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
68697f1 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
f3a7708 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
01aed3d 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
5cd5e25 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
a11a720 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
0d7181a 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 15, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
35b0e88 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 18, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
b566301 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Aug 21, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
5f39fd6 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 5, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
6d4ee97 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 7, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
13c0032 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 7, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
b83e8e0 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 9, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
ebfdc08 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 9, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
ad348e8 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 11, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
d08fe71 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 11, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
b7c23e5 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 11, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
33dac8e 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 11, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
bd1fc72 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 12, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
281e4d4 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 13, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
c4f4e44 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 13, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
7eb8f33 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 16, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
274be31 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 16, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
cb7a76e 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 18, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
3db612e 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 19, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
fe1a4da 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 20, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
e3ae632 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 21, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
c754937 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 21, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
48efc14 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 21, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
a51405c 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 22, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
0517ab2 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 22, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
42ad55a 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 22, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
7d3d973 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 23, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
e8dbbb0 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 24, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
33550dc 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 25, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
9a28abc 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 25, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
35e3b3c 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 25, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
5343af3 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 27, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
17b98d3 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Nexesenex added a commit that referenced this pull request Oct 28, 2025
@Nexesenex @ikawrakow
Improved IQ1_M quantization #327
591a7e5 
Co-Authored-By: Kawrakow <iwankawrakow@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ggml Nvidia GPU testing

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Nexesenex @JohannesGaessler