Not possible to tune adam_beta1 and adam_beta2 parameters using simple transformers, yet there are available to tune using huggingface

[anaconda121]

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Refer to title^^

Describe the solution you'd like
A clear and concise description of what you want to happen.
Make it possible for the parameters adam_beta1 and adam_beta2 to be added to the list of parameters for ClassifcationArgs(). The pull request (huggingface/transformers#5592) addressed these feature in hugging face.

Additional context
Add any other context or screenshots about the feature request here.

I attempted to add adam_beta1 and adam_beta2 to ClassificationArgs(), but as expected, I got an error saying they weren't defined. Image below:

[anaconda121]

Just put up some PRs to fix this issue. For some reason when I made edits to multiple files it created different PRs, apologies for any inconveniencies this may cause. Let me know what you think!

#1424
#1425

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.