-
Notifications
You must be signed in to change notification settings - Fork 18
Open
Milestone
Description
This is currently blocked by an exception, but we should try to reimplement it.
so we need to first:
- fine-tune on task A and save the model
- re-run train_system where we load the task A model with AutoModel but delete the feature transform and classifier layers
- re-save that model to a temporary path with the layers deleted
- create a new CnlpConfig based on the task B command line parameters
- create a new model that takes the temporary path from 3 and the config from 4 using the CnlpModelForClassification constructor
we need to replace this constructor call with an automodel call: https://github.com/Machine-Learning-for-Medical-Language/cnlp_transformers/blob/main/src/cnlpt/train_system.py#L461
3 is done here: https://github.com/Machine-Learning-for-Medical-Language/cnlp_transformers/blob/main/src/cnlpt/train_system.py#L471
-
can look something like this: https://github.com/Machine-Learning-for-Medical-Language/cnlp_transformers/blob/main/src/cnlpt/train_system.py#L493
-
can look like this: https://github.com/Machine-Learning-for-Medical-Language/cnlp_transformers/blob/main/src/cnlpt/train_system.py#L504, using the newly created config
Metadata
Metadata
Assignees
Labels
No labels