Skip to content

support feature extraction of mindcv backbone: resnet and mobiletnet v3 #213

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 26, 2023

Conversation

zhtmike
Copy link
Collaborator

@zhtmike zhtmike commented Apr 25, 2023

Support intermediate feature extractions using backbones from mindcv (resnet and mobilenetv3).
It is migrated fro this PR
You need to add features_only and out_indices in backbone configuration, to extract the feature pyramid. The examples is shown in the modified db_r50_icdar15.yaml

Thank you for your contribution to the MindOCR repo.
Before submitting this PR, please make sure:

Motivation

(Write your motivation for proposed changes here.)

Test Plan

(How should this PR be tested? Do you require special setup to run the test or repro the fixed bug?)

Related Issues and PRs

(Is this PR part of a group of changes? Link the other relevant PRs and Issues here. Use https://help.github.com/en/articles/closing-issues-using-keywords for help on GitHub syntax)

@zhtmike zhtmike requested review from SamitHuang and hadipash April 25, 2023 06:55
@zhtmike zhtmike changed the title support feature extraction of middcv backbone: resnet and mobiletnet v3 support feature extraction of mindcv backbone: resnet and mobiletnet v3 Apr 25, 2023
@zhtmike
Copy link
Collaborator Author

zhtmike commented Apr 25, 2023

由mindcv backbone 生成的model可能无法跟旧有的checkpoint兼容,因此不改动原有config配置。用mindcv backbone产生文件的实例可参考第一个commit

@HaoyangLee HaoyangLee merged commit e9eeffe into mindspore-lab:main Apr 26, 2023
@zhtmike zhtmike deleted the feature branch April 28, 2023 08:41
colawyee pushed a commit that referenced this pull request Jan 2, 2024
… pass on 910b (#213)

* add script

* Change softmax, sigmoid to compute in FP32, config lora scale for CLI

* fix format

* Update lora_finetune.md

* add file

* allow more config in args

* lora finetune ok now on MS2.2.1.20231028+CANN-7.0.0.6.220

* sd1.5 vanilla train ok when all fusion pass off

* rm debug log

* fix format

* allow upcate attention and sigmoid compute type to fp32

* fix format

* del file

* rename

* fix typo

---------

Co-authored-by: root <root@localhost.localdomain>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants