Skip to content

Conversation

@H-Huang
Copy link
Contributor

@H-Huang H-Huang commented Mar 10, 2025

Update local sgd tests to train the model on GPU and uses ProcessGroupBabyNCCL for synchronization

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Mar 10, 2025
@H-Huang H-Huang requested review from d4l3k and fegin March 10, 2025 22:51
@H-Huang H-Huang changed the title Add GPU tests for local_sgd Add GPU tests for local sgd / diloco Mar 10, 2025
Copy link
Member

@d4l3k d4l3k left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@H-Huang H-Huang merged commit 88cba6a into meta-pytorch:main Mar 12, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants