Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Confirm the random seed numbers #3

Open
SEONHOK opened this issue Dec 3, 2023 · 2 comments
Open

Confirm the random seed numbers #3

SEONHOK opened this issue Dec 3, 2023 · 2 comments

Comments

@SEONHOK
Copy link

SEONHOK commented Dec 3, 2023

Hi! The results in your paper are obtained from the random seeds "0 21 42 81 100"? As I saw the code, there are random seeds numbers "0 21 42 81 100". I just wonder whether it is correct or not.

I really appreciate any help you can provide!
@telxt
Copy link
Collaborator

telxt commented Dec 3, 2023

Hi! You're right. We did use those five random seeds across all the experiments that required replication.
Please don't hesitate to contact us if you have further questions or need more assistance!

@SEONHOK
Copy link
Author

SEONHOK commented Dec 3, 2023

Thanks for the prompt reply! I have a few quick questions!

  1. I wonder whether you measure the performance of SoRA by the best performance over the checkpoints (in several check points M's in algorithm 1)
  2. Also, in algorithm 1, how do you measure "TrainUntilConvergence"? Is there any specific metric for this?

Many thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@SEONHOK @telxt