Skip to content

Comments

Reduce logging#248

Merged
crangelsmith merged 2 commits intodevelopfrom
reduce_logging
Nov 2, 2023
Merged

Reduce logging#248
crangelsmith merged 2 commits intodevelopfrom
reduce_logging

Conversation

@crangelsmith
Copy link
Collaborator

Reduce logging to epoch level to accelerate run.

If we want to log at batch level, we can use the debug flag.

Copy link
Collaborator

@jolaem jolaem left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does the print actually affect the execution speed?

@crangelsmith
Copy link
Collaborator Author

Does the print actually affect the execution speed?

I think makes it a bit slower because it has to write to disk in the log file. With a very big dataset that is a looot of prints per epoch.

@jolaem
Copy link
Collaborator

jolaem commented Nov 2, 2023

Ok cool, just tested this with 20k data points and it produced a 3 second difference per epoch which with 2000 epochs is well over an hour!

@crangelsmith
Copy link
Collaborator Author

I'll merge this now.

@crangelsmith crangelsmith merged commit 82f4fb2 into develop Nov 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants