Skip to content

Navigation Menu

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

microsoft / DeepSpeed Public

Notifications You must be signed in to change notification settings
Fork 4.2k
Star 36k

Code
Issues 993
Pull requests 123
Discussions
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security
Insights

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeepSpeed Communication Profiling and Logging #2012

Merged

jeffra merged 54 commits into master from staging-comms-logging-v1

Jul 25, 2022

Conversation 21 Commits 54 Checks 0 Files changed

Merged

DeepSpeed Communication Profiling and Logging #2012

Changes from 2 commits

Commits

Show all changes

Select commit Hold shift + click to select a range

Staging comms v1 (#301)

Quentin-Anthony May 27, 2022

Delete stage1.py

awan-10 May 27, 2022

Delete distributed.py

awan-10 May 27, 2022

revert deepspeed/__init__.py logging calls

Quentin-Anthony May 28, 2022

Quentin-Anthony May 28, 2022

Update comments and move custom comm ops to internal functions

Quentin-Anthony May 28, 2022

Merge branch 'staging-comms-next' of https://github.com/microsoft/Dee…

Quentin-Anthony May 28, 2022

Remove unnecessary print and update backend description

Quentin-Anthony May 28, 2022

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO 1

Quentin-Anthony May 31, 2022

Simplify ZeRO stage 1 check for previous commit

Quentin-Anthony May 31, 2022

Remove misleading world_size prints

Quentin-Anthony May 31, 2022

Add commslogger class, and introduce rough prototype comms logging

Quentin-Anthony Jun 1, 2022

Clean up logger

Quentin-Anthony Jun 1, 2022

Add more robust arg checks

Quentin-Anthony Jun 3, 2022

Add labels to common collective calls for logger

Quentin-Anthony Jun 3, 2022

Add more annotations

Quentin-Anthony Jun 3, 2022

Fix up log_summary_new and fix logging bug for barrier

Quentin-Anthony Jun 7, 2022

Clean up arg sweep logic and add isend/irecv

Quentin-Anthony Jun 7, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jun 13, 2022

Clean up logging branch

Quentin-Anthony Jun 13, 2022

Unify naming and fix circular import

Quentin-Anthony Jun 13, 2022

Fix deepspeed comm imports for logging.py

Quentin-Anthony Jun 13, 2022

Added comms config support, removed some log names

Quentin-Anthony Jun 14, 2022

Add comms config file

Quentin-Anthony Jun 14, 2022

Add pydantic to requirements

Quentin-Anthony Jun 14, 2022

Add configure non-op to old torch

Quentin-Anthony Jun 14, 2022

Update logging call for old torch

Quentin-Anthony Jun 14, 2022

Add log_name placeholder args for old torch

Quentin-Anthony Jun 14, 2022

Add basic verbosity setup

Quentin-Anthony Jun 15, 2022

Complete verbosity setup

Quentin-Anthony Jun 18, 2022

move comms logging to separate file and clean up

Quentin-Anthony Jun 18, 2022

Change debug message design

Quentin-Anthony Jun 25, 2022

refactor debug helper and clean up

Quentin-Anthony Jun 25, 2022

Refactor a bit and clean up prints

Quentin-Anthony Jun 25, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jun 25, 2022

config docs, remove old log_summary func, fix imports

Quentin-Anthony Jun 25, 2022

Finished docs, added import, fixed non-debug calls

Quentin-Anthony Jun 25, 2022

Quentin-Anthony Jun 25, 2022

Removed old comments

Quentin-Anthony Jun 25, 2022

Updated fn signatures for torch1.2

Quentin-Anthony Jun 27, 2022

Remove lingering prof arg

Quentin-Anthony Jun 27, 2022

Merge branch 'master' into staging-comms-logging-v1

jeffra Jun 29, 2022

Update logging tutorial

Quentin-Anthony Jun 29, 2022

Removed unnecessary imports and cleaned up comments

Quentin-Anthony Jun 30, 2022

Take master's cleaner comms init logic

Quentin-Anthony Jun 30, 2022

Fixed bw calculations and made all logging calls blocking

Quentin-Anthony Jul 20, 2022

Added comms logging synch disclaimer

Quentin-Anthony Jul 20, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jul 21, 2022

Added using_mpi flag for logging

Quentin-Anthony Jul 22, 2022

Quentin-Anthony Jul 22, 2022

Merge branch 'master' of https://github.com/microsoft/DeepSpeed into …

Quentin-Anthony Jul 22, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jul 22, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jul 25, 2022

Merge branch 'master' into staging-comms-logging-v1

Quentin-Anthony Jul 25, 2022

File filter

Filter by extension

Filter by extension .py (1) All 1 file type selected

Deleted files Viewed files

Conversations

Failed to load comments.

Loading

Jump to

Jump to file

Failed to load files.

Loading

Diff view

Unified

Split

Hide whitespace

Diff view

Unified

Split

Hide whitespace

There are no files selected for viewing

47 changes: 0 additions & 47 deletions 47 tests/comm/test.py

Show comments

View file

Open in desktop

This file was deleted.

Oops, something went wrong.

Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.

Footer

© 2024 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.