Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Control ds_report output #1622

Merged
merged 2 commits into from
Dec 9, 2021
Merged

Control ds_report output #1622

merged 2 commits into from
Dec 9, 2021

Conversation

tjruwase
Copy link
Contributor

@tjruwase tjruwase commented Dec 8, 2021

Add two flags to help control ds_report out:

  1. --hide_operator_status
  2. --hide_errors_and_warnings

Separate cli and function entry points into ds_report

Should fix #1541.

…rrors_and_warnings

Separate cli and function entry points to ds_report
@tjruwase
Copy link
Contributor Author

tjruwase commented Dec 8, 2021

@stas00, FYI

@jeffra
Copy link
Collaborator

jeffra commented Dec 8, 2021

@stas00 on the Megatron-DeepSpeed/BigScience side (once this PR is merged) we'll need to pass the appropriate flags (hide_operator_status and hide_errors_and_warnings) here: https://github.com/microsoft/Megatron-DeepSpeed/blob/acc3e9b5fab400912107c33fbcc9e0d02809dd6e/pretrain_gpt.py#L209

@stas00
Copy link
Collaborator

stas00 commented Dec 9, 2021

Perfect, thank you gentleman!

@tjruwase tjruwase merged commit 91e1559 into master Dec 9, 2021
@mrwyattii mrwyattii deleted the olruwase/ds_report_control branch July 7, 2023 02:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] async-io-related warnings at start time when nvme is not configured to be used
3 participants