-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ADD] support Distributed Data Parallel #137
Commits on Jan 29, 2023
-
initial data_parallel code based on colossalai code but it needs to b…
…e updated more. (remove unnecssary code)
dongsung kim committedJan 29, 2023 Configuration menu - View commit details
-
Copy full SHA for f04471e - Browse repository at this point
Copy the full SHA f04471eView commit details
Commits on Feb 12, 2023
-
take out the code from _coloddp, _coloddp will be removed soon
dongsung kim committedFeb 12, 2023 Configuration menu - View commit details
-
Copy full SHA for b15e42c - Browse repository at this point
Copy the full SHA b15e42cView commit details
Commits on Feb 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0aa7020 - Browse repository at this point
Copy the full SHA 0aa7020View commit details
Commits on Feb 20, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 3eba4a1 - Browse repository at this point
Copy the full SHA 3eba4a1View commit details
Commits on Feb 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f89e22a - Browse repository at this point
Copy the full SHA f89e22aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d45e029 - Browse repository at this point
Copy the full SHA d45e029View commit details -
Configuration menu - View commit details
-
Copy full SHA for 80f0970 - Browse repository at this point
Copy the full SHA 80f0970View commit details
Commits on Mar 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 315e5f8 - Browse repository at this point
Copy the full SHA 315e5f8View commit details
Commits on Mar 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e9f8b0b - Browse repository at this point
Copy the full SHA e9f8b0bView commit details -
[Refactor] Refactor backward interface in DP (#141)
## Title Refactor backward in DP ## Description Followed https://github.com/KKIEEK/oslo/blob/3ca6b1aa0d87688af891f12b22837d89847680e9/oslo/torch/nn/parallel/data_parallel/distributed_data_parallel.py#L96. And committed as KKIEEK for the code ownership. Co-authored-by: KKIEEK <ethan9867@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for b49092c - Browse repository at this point
Copy the full SHA b49092cView commit details -
## Title Deleted legacy code. ## Description Only newly added code written by jinwonkim93 remains. --------- Co-authored-by: KKIEEK <ethan9867@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 20c0d10 - Browse repository at this point
Copy the full SHA 20c0d10View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5079773 - Browse repository at this point
Copy the full SHA 5079773View commit details -
Update oslo/torch/nn/parallel/data_parallel/data_parallel.py
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for f9097f0 - Browse repository at this point
Copy the full SHA f9097f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 28e474a - Browse repository at this point
Copy the full SHA 28e474aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5401fa1 - Browse repository at this point
Copy the full SHA 5401fa1View commit details -
Configuration menu - View commit details
-
Copy full SHA for fe9ff2f - Browse repository at this point
Copy the full SHA fe9ff2fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c581c8 - Browse repository at this point
Copy the full SHA 1c581c8View commit details -
Update oslo/torch/nn/parallel/data_parallel/data_parallel.py
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for cc0e6a8 - Browse repository at this point
Copy the full SHA cc0e6a8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7494c9c - Browse repository at this point
Copy the full SHA 7494c9cView commit details
Commits on Mar 3, 2023
-
[Fix] Support long tensor for DDP backward (#146)
Related to #137 For now, our implementation of DDP does not support long tensor input, so I fixed it. --------- Co-authored-by: Hakjin Lee <nijkah@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for a5e0c9c - Browse repository at this point
Copy the full SHA a5e0c9cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 894d66d - Browse repository at this point
Copy the full SHA 894d66dView commit details
Commits on Mar 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 4b14253 - Browse repository at this point
Copy the full SHA 4b14253View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b72f4d - Browse repository at this point
Copy the full SHA 8b72f4dView commit details
Commits on Mar 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 313d325 - Browse repository at this point
Copy the full SHA 313d325View commit details
Commits on Mar 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 50814c3 - Browse repository at this point
Copy the full SHA 50814c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2282de - Browse repository at this point
Copy the full SHA b2282deView commit details -
Configuration menu - View commit details
-
Copy full SHA for 32dd163 - Browse repository at this point
Copy the full SHA 32dd163View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8a61b92 - Browse repository at this point
Copy the full SHA 8a61b92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78f003a - Browse repository at this point
Copy the full SHA 78f003aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 520eb53 - Browse repository at this point
Copy the full SHA 520eb53View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2408bf0 - Browse repository at this point
Copy the full SHA 2408bf0View commit details
Commits on Mar 9, 2023
-
Update oslo/torch/nn/parallel/data_parallel/zero/sharded_optim/bookke…
…eping/__init__.py Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 697653b - Browse repository at this point
Copy the full SHA 697653bView commit details