Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Access] Adjust logging in checkpoint loading #4797

Merged
merged 1 commit into from
Oct 5, 2023

Conversation

peterargue
Copy link
Contributor

The indexing batch of leaf nodes message is very noisy and generally not needed.

@peterargue peterargue self-assigned this Oct 5, 2023
@codecov-commenter
Copy link

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (0bdbb8e) 55.82% compared to head (0d60429) 65.52%.
Report is 5 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4797      +/-   ##
==========================================
+ Coverage   55.82%   65.52%   +9.69%     
==========================================
  Files         939      192     -747     
  Lines       86905    20010   -66895     
==========================================
- Hits        48513    13111   -35402     
+ Misses      34739     5927   -28812     
+ Partials     3653      972    -2681     
Flag Coverage Δ
unittests 65.52% <ø> (+9.69%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 753 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

batch := b.db.NewBatch()
defer batch.Close()

b.log.Trace().Int("batch_size", len(leafNodes)).Msg("indexing batch of leaf nodes")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this is to monitor the progress.

Actually, OpenAndReadLeafNodesFromCheckpointV6 is already doing that, since it's logging the percentage of reading the trie, and is blocked if database is not storing the registers fast enough, which means if the log shows the reading percentage is going up, it means leaf nodes are being indexed properly.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yea, exactly. the checkpoint loader also logs based on % progress, resulting in much fewer messages

@peterargue peterargue added this pull request to the merge queue Oct 5, 2023
Merged via the queue into master with commit 9c6f9ff Oct 5, 2023
36 checks passed
@peterargue peterargue deleted the petera/adjust-checkpoint-bootstrap-logging branch October 5, 2023 18:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants