Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support for dadapaption V3 #530

Merged
merged 13 commits into from
May 25, 2023
Merged

support for dadapaption V3 #530

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
47ca358
Update train_util.py for DAdaptLion
sdbds May 7, 2023
7ea8da5
Update train_README-zh.md for dadaptlion
sdbds May 7, 2023
9040b11
Update train_README-ja.md for DAdaptLion
sdbds May 7, 2023
8e0ebc7
add DAdatpt V3
sdbds May 8, 2023
557fd11
Alignment
sdbds May 8, 2023
a47bfc0
Update train_util.py for experimental
sdbds May 8, 2023
3a984e5
Update train_util.py V3
sdbds May 8, 2023
b6ba4ca
Merge pull request #528 from kohya-ss/dev
kohya-ss May 22, 2023
fdfe6db
Merge branch 'kohya-ss:main' into DAdapt
sdbds May 22, 2023
a2b3f85
Update train_README-zh.md
sdbds May 22, 2023
8be7374
Update train_README-ja.md
sdbds May 22, 2023
342e253
Update train_util.py fix
sdbds May 23, 2023
522eeea
Update train_util.py
sdbds May 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update train_README-zh.md
  • Loading branch information
@sdbds
sdbds authored May 22, 2023
commit a2b3f8591b72d55c0b847d51deeab49197f56d02
4 changes: 3 additions & 1 deletion docs/train_README-zh.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -551,9 +551,11 @@ masterpiece, best quality, 1boy, in business suit, standing at street, looking b
- 与过去版本中指定的 --use_lion_optimizer 相同
- SGDNesterov : [torch.optim.SGD](https://pytorch.org/docs/stable/generated/torch.optim.SGD.html), nesterov=True
- SGDNesterov8bit : 参数同上
- DAdaptation : https://github.com/facebookresearch/dadaptation
- DAdaptation(DAdaptAdamPreprint) : https://github.com/facebookresearch/dadaptation
- DAdaptAdam : 参数同上
- DAdaptAdaGrad : 参数同上
- DAdaptAdan : 参数同上
- DAdaptAdanIP : 引数は同上
- DAdaptLion : 参数同上
- DAdaptSGD : 参数同上
- AdaFactor : [Transformers AdaFactor](https://huggingface.co/docs/transformers/main_classes/optimizer_schedules)
Expand Down