-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merk hash scheme migration #338
Open
MavenRain
wants to merge
120
commits into
liftedinit:main
Choose a base branch
from
MavenRain:merk-migration
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 1 commit
Commits
Show all changes
120 commits
Select commit
Hold shift + click to select a range
9c39f12
Very rough draft of merk key migration
MavenRain 6569168
Branch broken due to Bazel problem
MavenRain 7534813
New migration type
MavenRain 015478f
Lock file changes
MavenRain 9fc967a
Lock file changes
MavenRain 186091b
fix: alias many-ledger test
fmorency df8814b
Factor complex type
MavenRain 7091a87
Add hash migration to json config
MavenRain cd7c4b7
Fixed storage error by sorting batch in ledger tokens section
MavenRain f18d6dd
Remove unused imports
MavenRain b074ef0
cargo fmt
MavenRain 1332d87
Lock file changes
MavenRain de63140
Lock file changes
MavenRain 18f16ea
Lock file changes
MavenRain b9f0110
Flop over to v2 for idstore export
MavenRain c5a75b8
To merk v2 for ledger db CLI
MavenRain 9cc2dcb
Choose v1 or v2 storage opening in ledger based on migration
MavenRain cac41ce
Storage opening in ledger dependent on hash migration
MavenRain 2a3767b
KvStore only uses v2 storage
MavenRain d33d246
On write, all operations take merk version into account
MavenRain 71adc6b
Use v2 merk error for KvStoreIterator
MavenRain 9cb3ebe
Corrected some storage operations in the main ledger storage file
MavenRain 907d5d7
Stub for hash migration resiliency test
MavenRain e2bb5e6
Rectify clippy errors
MavenRain 050e039
Add setup/teardown for migration resiliency test
MavenRain 0478be6
Fix bug causing staging e2e failure
MavenRain 46b9aac
Some ledger main.rs cleanup
MavenRain 7e6c718
More ledger main.rs cleanup
MavenRain 1b4b088
Add initial consistency check to hash migraton resiliency test
MavenRain ca5814b
Edit toml files to remove redundant license fields
MavenRain 8a22532
Cargo Bazel lock changes
MavenRain da1bf32
Fix imports in ledger main
MavenRain dffa8b4
Overcome clippy errors
MavenRain d3ca797
Completed hash migration resiliency test
MavenRain 81a556c
Try hardcoded temp file for v2 storage
MavenRain 42e5bc6
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain 252fef6
look for migrations config file in the right place
MavenRain 6997d20
cargo fmt
MavenRain 58ce7b0
Debugging commit for deserialization error in hash migration
MavenRain 014067d
Rectified merge with main
MavenRain 17a4709
Now debugging unexpected transport error
MavenRain 2554e03
Attempt to print send envelope message before response is returned
MavenRain 5fbcb2d
Print respone before failed attempt to deserialize
MavenRain 3bed6b3
Log requests before cose packaging
MavenRain e745b8f
Instrument ledger.info call
MavenRain 912620d
Capture response from client call to ledger.info
MavenRain 0a18e90
Fix clippy error
MavenRain eb17ffd
Remove some debugging logs to restore webauthn bats tests
MavenRain da72e3f
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain c02b7fc
Remove send_message logging
MavenRain d0f0510
Debugging symbols function
MavenRain dae0b50
RUST_BACKTRACE=1 to get backtrace
MavenRain bcbc627
Try to get backtrace to work
MavenRain ff4fbed
Get error for status from the response in the client call
MavenRain b7a4c0c
Attempt to log incoming request on server side
MavenRain 90eebbc
Examine reqwest call in send_envelope
MavenRain fc8b0e9
cargo fmt
MavenRain da64fba
Log response again
MavenRain f575b00
Change transport error to unknown error
MavenRain 2c0c000
Further scrutinize response
MavenRain cea55b6
Print response result
MavenRain a5572bf
Use modified reqwest repo for further debugging
MavenRain 1033b96
Error for status
MavenRain b01dd7c
Error surfaced earlier
MavenRain d6291a5
Restore error conversion after error-for-status
MavenRain 86712ac
Some error-handling in many main
MavenRain b1f5f84
Debug SYMBOLS_ROOT through migration
MavenRain a1de093
Now try to decode symbols into map during migration
MavenRain 1acb6ae
Format change of symbol root log
MavenRain 30346d2
Possible moment-of-truth: replacing to_vec with minicbor::to_vec
MavenRain 042e192
Debug update_at_height
MavenRain 162676e
Simply into replacing cbor (double?) encoding
MavenRain 6183734
Try just migrating objects with known iterators
MavenRain 78cf28c
Fix needless borrow
MavenRain 28f30c9
multisig bug in migration fix
MavenRain 03dd4d1
Specifically add symbols table
MavenRain def4139
Possible solution to iterate-all problem
MavenRain 6500bf4
Cleanup of unwraps post debugging
MavenRain 174c927
reqwest response handling cleanup
MavenRain 60385a4
Refactor update_at_height call post hardcoding path for new storage
MavenRain bd74390
Refactor replacement from function pointer to more general closure
MavenRain 6eefbd1
Fix clippy errors and remove unwraps post debugging
MavenRain e2c4f17
Refactoring of LedgerStorage::commit
MavenRain bc7493b
Overcome clippy error
MavenRain 63b2ce4
Remove println statements post-debugging
MavenRain cf3d3c2
More migration related cleanup
MavenRain 490f6f7
Introduce forests
MavenRain 183715b
Return error message in payload with 500 from server
MavenRain caca26c
Fix clippy error
MavenRain 5632885
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain 76ff5af
Deleting more debugging code and import formats
MavenRain 702cf18
Remove dead code allowance
MavenRain f513be6
Restore dead code allowance temporarily
MavenRain 74fb305
Now try to write to same v2 path as v1 path
MavenRain baa1f16
Merge branch 'detached-state' into merk-migration
MavenRain bc17301
Fix migration e2e tests
MavenRain eba86ea
Trying to destroy old v1 merk copy properly
MavenRain 0b58318
Debugging new migration flow
MavenRain 894bee5
Add another unwrapping
MavenRain ce75813
Straight unwrappings trip a clippy error
MavenRain c24902a
Debugging update_at_height
MavenRain a0eb7ba
Debugging initialize function
MavenRain 35aec13
Propagate Debug requirements for error types
MavenRain 3da8121
Further initialize debugging
MavenRain 2639e9f
Inline initialize method for further debugging
MavenRain 3fc1954
Move initialize inlining
MavenRain d66869b
Debug into hash migration initialization
MavenRain b70771e
Change to random file name inside created merk temporary operation
MavenRain 95bce1e
Temp directory fixed and debugging removed
MavenRain cfdb514
Small migration error-handling edit and removing dead code annotation…
MavenRain f4fa962
Midstep to removing replacement argument of migration initializer
MavenRain 986290c
Remove replacement field from hash migration function type
MavenRain 24f91db
Abstract from PathBuf to Path in function signatures
MavenRain a83ff7d
Fix unnecessary to_owned
MavenRain 0ca8182
Batch processing refactor
MavenRain e9d67c7
Fix clippy errors
MavenRain e62de6c
Test consuming db file path from extra config
MavenRain b3c8986
Add db file to migrations config
MavenRain fa7ad3a
Convert entry to PathBuf
MavenRain db0f739
Print and pass error in AbciCommitInfo
MavenRain File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Flop over to v2 for idstore export
- Loading branch information
commit b9f01109194fdd29425bceb01a7281d54d165ac3
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure how you got this refactor... We don't use a
use { /* all imports */ }
pattern anywhere else, so if you could revert this that would be great.