Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cuda source cleanup , refactor and fixes #1328

Merged

Conversation

abhilash1910
Copy link
Contributor

This is a draft Pr for cleanup of cuda kernels, refactor template assignments and fix some AOT issues.
The cuda kernels have some scope of cleanup in terms of redundant code pathways and unused methods.
cc @matthewdouglas , @Titus-von-Koeller
@TimDettmers (pinging for awareness).

@abhilash1910 abhilash1910 marked this pull request as draft August 20, 2024 14:57
@matthewdouglas
Copy link
Member

Thanks! We actually just recently were discussing some cleanup here so this fits nicely timing-wise!

@matthewdouglas matthewdouglas self-assigned this Aug 20, 2024
@Titus-von-Koeller
Copy link
Collaborator

@abhilash1910

Thanks for the PR, really appreciate the pro-activity in helping us clean things up!

I just had a chat with Tim and he reviewed the PR and said everything looks good to him.

I see you put the PR as draft, are there any more changes coming or can wrap things up?

@abhilash1910
Copy link
Contributor Author

Hi @Titus-von-Koeller , I am planning to wrap this up in a couple of hours from now.
Will ping you . Thanks

@abhilash1910 abhilash1910 marked this pull request as ready for review August 21, 2024 20:06
@abhilash1910
Copy link
Contributor Author

abhilash1910 commented Aug 21, 2024

@Titus-von-Koeller this is ready for review now, thanks.
Some changes since last review : quantize 2d is a generic method over unused quantize quadrant, some rearrangements of template classes, removal of unused functions

@abhilash1910 abhilash1910 changed the title [WIP] Cuda source cleanup , refactor and fixes Cuda source cleanup , refactor and fixes Aug 21, 2024
Copy link
Member

@matthewdouglas matthewdouglas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thanks!

@matthewdouglas matthewdouglas merged commit 6bef412 into bitsandbytes-foundation:main Aug 26, 2024
28 checks passed
matthewdouglas pushed a commit to matthewdouglas/bitsandbytes that referenced this pull request Oct 28, 2024
Cuda source cleanup , refactor and fixes (bitsandbytes-foundation#1328)

* remove kcompress

* fix initial template call

* fix function name

* remove vector load

* cleanup reduce  & rearrange

* format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants