Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create NNlibCUDA sub-package #286

Merged
merged 17 commits into from
Mar 12, 2021
Merged

create NNlibCUDA sub-package #286

merged 17 commits into from
Mar 12, 2021

Conversation

CarloLucibello
Copy link
Member

@CarloLucibello CarloLucibello commented Mar 6, 2021

Follow up to discussion in JuliaGPU/CUDA.jl#738 and on zulip.
The idea is to create a package within the same repo of NNlib.jl to make maintenance easier.

This a port and factorization of the nnlib.jl file and related in CUDA.jl, so that CUDA.jl can drop the NNlib dependence (pr JuliaGPU/CUDA.jl#753)

Besides this PR, Flux.jl should remove the dependence on CUDA.batchnorm and use the new cudnn wrapper interface.

The CI pipeline is copied from https://github.com/JuliaGPU/KernelAbstractions.jl

cc @maleadt @denizyuret

THINGS TO DO AFTER MERGE:

  • Test Flux against this and CUDA master
  • Tag a release
  • Benchmark softmax, see if we want to keep the cudnn version or the native one. Same for batchnorm.

@CarloLucibello
Copy link
Member Author

@DhairyaLGandhi could you add buildkite to the repo and get rid of AppVeyor?

@CarloLucibello
Copy link
Member Author

CarloLucibello commented Mar 8, 2021

Tests are passing locally on top of JuliaGPU/CUDA.jl#753. This is pretty much done. Before merging, we should test it against JuliaGPU/CUDA.jl#753 (once it is merged in master) using buildkite (bump on @DhairyaLGandhi for activating it)

@CarloLucibello
Copy link
Member Author

CUDA master removed NNlib, we should hurry up with this. @DhairyaLGandhi can you activate buildkite for this repo?

@maleadt
Copy link
Contributor

maleadt commented Mar 11, 2021

https://buildkite.com/julialang/nnlib-dot-jl

.ci/test_nnlibcuda.jl Outdated Show resolved Hide resolved
@DhairyaLGandhi DhairyaLGandhi deleted the libcuda branch April 14, 2021 20:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants