-
Notifications
You must be signed in to change notification settings - Fork 3
Restructure pr curves notebook #15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Restructure pr curves notebook #15
Conversation
* finish download module changes * download notebook * rerun split data module * rerun download module * rerun train_model * rerun evaluation module * rerun interpretation module * combine datasets * combine datasets * split changes * update format * format update * format * finish split data * combine datasets, remove holdout * formatting * rerun pipelines * remove folded class * rerun pipeline * Update utils/download_utils.py Co-authored-by: Dave Bunten <ekgto445@gmail.com> * PR fixes * module docstrings Co-authored-by: Dave Bunten <ekgto445@gmail.com>
d33bs
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work! I left a few suggestions but didn't see anything that would prevent a merge as-is.
One follow up I wasn't sure about:
- I noticed your mention about using one
.tsvbut saw there were.pngimages which were also removed. Should these images be replaced by anything new?
|
Thanks for the review! These images should not be replaced by anything new. The format for the |
This PR is ready for review!
In this PR, the class PR curves notebook is restructured to follow the structure of the evaluate notebooks.
This means all the models are evaluated on each data subset and the resulting data are saved in one compiled `.tsv. file.