Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix samples_seen logging #483

Merged
merged 4 commits into from
Oct 26, 2023
Merged

Fix samples_seen logging #483

merged 4 commits into from
Oct 26, 2023

Conversation

callumm-graphcore
Copy link
Collaborator

@callumm-graphcore callumm-graphcore commented Oct 26, 2023

Changelogs

  • Account for deviceIterations in logging of samples_seen

Checklist:

  • Was this PR discussed in an issue? It is recommended to first discuss a new feature into a GitHub issue before opening a PR.
  • Add tests to cover the fixed bug(s) or the new introduced feature(s) (if appropriate).
  • Update the API documentation is a new function is added, or an existing one is deleted.
  • Write concise and explanatory changelogs above.
  • If possible, assign one of the following labels to the PR: feature, fix or test (or ask a maintainer to do it for you).

discussion related to that PR

@callumm-graphcore callumm-graphcore changed the title Fix samples_seen logging WIP: Fix samples_seen logging Oct 26, 2023
@codecov
Copy link

codecov bot commented Oct 26, 2023

Codecov Report

Merging #483 (cc6adba) into main (983bf6c) will decrease coverage by 1.81%.
The diff coverage is 63.15%.

@@            Coverage Diff             @@
##             main     #483      +/-   ##
==========================================
- Coverage   71.45%   69.64%   -1.81%     
==========================================
  Files          93       93              
  Lines        8512     8519       +7     
==========================================
- Hits         6082     5933     -149     
- Misses       2430     2586     +156     
Flag Coverage Δ
unittests 69.64% <63.15%> (-1.81%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
ipu 29.75% <ø> (-19.40%) ⬇️

Copy link
Collaborator

@kerstink-GC kerstink-GC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@@ -70,15 +70,12 @@ def get_replication_factor(cfg):


def get_gradient_accumulation_factor(cfg):
"""
WARNING: This MUST be called after accelerator overrides have been applied
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you specify what is the accelerator overrides? Is this a function? Where is it?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are applied in load_accelerator, I'll clarify the comment

@callumm-graphcore callumm-graphcore changed the title WIP: Fix samples_seen logging Fix samples_seen logging Oct 26, 2023
@callumm-graphcore callumm-graphcore merged commit e5fa686 into main Oct 26, 2023
5 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants