Skip to content

update tutorials #420

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jun 19, 2023
Merged

update tutorials #420

merged 8 commits into from
Jun 19, 2023

Conversation

Songyuanwei
Copy link
Collaborator

Thank you for your contribution to the MindOCR repo.
Before submitting this PR, please make sure:

Motivation

(Write your motivation for proposed changes here.)

Test Plan

(How should this PR be tested? Do you require special setup to run the test or repro the fixed bug?)

Related Issues and PRs

(Is this PR part of a group of changes? Link the other relevant PRs and Issues here. Use https://help.github.com/en/articles/closing-issues-using-keywords for help on GitHub syntax)

@SamitHuang SamitHuang self-requested a review June 16, 2023 09:21
#### 梯度累积

梯度累积可以有效解决内存限制问题,允许**使用大的全局批量进行训练**。可以通过在yaml配置中将`train.gradient_accumulation_steps` 设置为大于1的值来使用梯度累积功能。
以下为计算公式:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

启用后,等效的全局batch为:

@HaoyangLee HaoyangLee merged commit a3acac7 into mindspore-lab:main Jun 19, 2023
@Songyuanwei Songyuanwei deleted the branch_2 branch June 21, 2023 06:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants