Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about Model Configuration and Checkpoint Availability in Zero-Shot Setting #8

Open
wdkhuans opened this issue Mar 29, 2024 · 0 comments

Comments

@wdkhuans
Copy link

Hello,

Thanks for your great work! I have a couple of questions regarding the model configurations and checkpoint availability in the context of the UniTS_zeroshot_newdata.sh script.

1. Model Dimensionality in Zero-Shot Setting:
Why is the d_model parameter set to 64 for the zero-shot setting, while in the original multi-task pretraining setting, it is set to 128? Is there a specific reason behind this choice, or is it related to the performance or efficiency considerations?

2. Checkpoint Availability:
I greatly appreciate the series of checkpoints you've provided in Pretrained weights. However, is it possible to make the checkpoint in the zero-shot setting publicly available?

Thank you for your time and assistance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant