Skip to content

Conversation

nikooo777
Copy link
Member

@nikooo777 nikooo777 commented Jun 10, 2022

This PR adds support for lbcd so that lbrycrd can be forgotten.
Additionally this PR:

  • improves sync times
  • fixes claimtrie sync job (that could not run at all if syncing for the first time)
  • adds more jobs that can be run manually
  • fixes a lot of random bugs
  • drops unused or redundant columns
  • updates sqlboiler to latest supported version
  • requires mysql8 for new data type (such as JSON)
  • updates old dependencies

Todo list:

This is a work in progress still, but it works!

warning: it's not recommended to run this against a production instance because the migrations included in this PR will take over 24 hours to run and can fail if not enough disk space is available (up to the same size of the biggest table on disk)

additionally, a few fields were missing or were incorrect due to bugs in the code and the migration doesn't aim at correcting those gaps. A full resync is ideal if running this one.

nikooo777 added 30 commits May 25, 2022 01:09
lbcd compatibility
fix block reprocessing
fix issue with claimtriesync
try other values for claimtriesync
temporarily disable first section of claimtriesync
again temporarily skip a part of it
remove unused code
introduce channel based processing of "updated" claims
WiP
improve error logging in claimtriesync
add index to support table
make use of json type in mysql 8
update go to 1.17
remove lbry.go v1
update go-bindata
maybe fix build pt2
improve block processing
fix build pt3
improve logging
fix issue with next block hash
streamline transaction insertion and update
improve logs
improve transaction processing
drop unused columns
drop useless triggers
fix random bugs
@nikooo777 nikooo777 marked this pull request as ready for review June 20, 2022 13:05
@nikooo777 nikooo777 requested a review from tiger5226 July 8, 2022 13:47
@nikooo777
Copy link
Member Author

this runs in production so we should merge it

@nikooo777 nikooo777 force-pushed the lbcd branch 2 times, most recently from 13154fb to 3190a98 Compare March 8, 2023 04:08
@nikooo777 nikooo777 merged commit 068c29e into master Mar 8, 2023
@nikooo777 nikooo777 deleted the lbcd branch March 8, 2023 04:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants