Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gradients stats aggregation #3979

Merged
merged 13 commits into from
Dec 7, 2020
Merged

Conversation

liujuncheng
Copy link
Collaborator

No description provided.

@liujuncheng liujuncheng requested review from oneflow-ci-bot and removed request for oneflow-ci-bot December 6, 2020 06:51
@oneflow-ci-bot oneflow-ci-bot removed their request for review December 6, 2020 07:57
@liujuncheng liujuncheng requested review from oneflow-ci-bot and removed request for oneflow-ci-bot December 6, 2020 10:42
@liujuncheng liujuncheng requested review from oneflow-ci-bot and removed request for oneflow-ci-bot December 6, 2020 11:46
@oneflow-ci-bot oneflow-ci-bot removed their request for review December 6, 2020 12:14
@oneflow-ci-bot oneflow-ci-bot removed their request for review December 6, 2020 12:56
@liujuncheng liujuncheng requested review from oneflow-ci-bot and removed request for oneflow-ci-bot December 6, 2020 15:16
@oneflow-ci-bot oneflow-ci-bot removed their request for review December 6, 2020 17:33
@liujuncheng liujuncheng merged commit 00e9613 into master Dec 7, 2020
@liujuncheng liujuncheng deleted the dev_gradients_stats_aggregation branch December 7, 2020 00:20
liujuncheng added a commit that referenced this pull request Jun 3, 2021
* Add multi_square_sum op

* fix sbp

* fix cpu

* fix

* ForEachAggregatedParamGroup

* refine

* scale before stats

* fix op name

Co-authored-by: guo ran <360112263@qq.com>
Former-commit-id: 00e9613
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants