Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merk hash scheme migration #338

Open
wants to merge 120 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
120 commits
Select commit Hold shift + click to select a range
9c39f12
Very rough draft of merk key migration
MavenRain Mar 21, 2023
6569168
Branch broken due to Bazel problem
MavenRain Mar 21, 2023
7534813
New migration type
MavenRain Mar 21, 2023
015478f
Lock file changes
MavenRain Mar 21, 2023
9fc967a
Lock file changes
MavenRain Mar 22, 2023
186091b
fix: alias many-ledger test
fmorency Mar 22, 2023
df8814b
Factor complex type
MavenRain Mar 22, 2023
7091a87
Add hash migration to json config
MavenRain Mar 23, 2023
cd7c4b7
Fixed storage error by sorting batch in ledger tokens section
MavenRain Mar 27, 2023
f18d6dd
Remove unused imports
MavenRain Mar 27, 2023
b074ef0
cargo fmt
MavenRain Mar 27, 2023
1332d87
Lock file changes
MavenRain Mar 27, 2023
de63140
Lock file changes
MavenRain Mar 27, 2023
18f16ea
Lock file changes
MavenRain Mar 27, 2023
b9f0110
Flop over to v2 for idstore export
MavenRain Mar 27, 2023
c5a75b8
To merk v2 for ledger db CLI
MavenRain Mar 27, 2023
9cc2dcb
Choose v1 or v2 storage opening in ledger based on migration
MavenRain Mar 29, 2023
cac41ce
Storage opening in ledger dependent on hash migration
MavenRain Mar 29, 2023
2a3767b
KvStore only uses v2 storage
MavenRain Mar 29, 2023
d33d246
On write, all operations take merk version into account
MavenRain Mar 30, 2023
71adc6b
Use v2 merk error for KvStoreIterator
MavenRain Mar 30, 2023
9cb3ebe
Corrected some storage operations in the main ledger storage file
MavenRain Mar 30, 2023
907d5d7
Stub for hash migration resiliency test
MavenRain Mar 30, 2023
e2bb5e6
Rectify clippy errors
MavenRain Mar 30, 2023
050e039
Add setup/teardown for migration resiliency test
MavenRain Mar 30, 2023
0478be6
Fix bug causing staging e2e failure
MavenRain Mar 30, 2023
46b9aac
Some ledger main.rs cleanup
MavenRain Mar 30, 2023
7e6c718
More ledger main.rs cleanup
MavenRain Mar 30, 2023
1b4b088
Add initial consistency check to hash migraton resiliency test
MavenRain Mar 30, 2023
ca5814b
Edit toml files to remove redundant license fields
MavenRain Mar 30, 2023
8a22532
Cargo Bazel lock changes
MavenRain Mar 30, 2023
da1bf32
Fix imports in ledger main
MavenRain Mar 30, 2023
dffa8b4
Overcome clippy errors
MavenRain Mar 30, 2023
d3ca797
Completed hash migration resiliency test
MavenRain Mar 30, 2023
81a556c
Try hardcoded temp file for v2 storage
MavenRain Apr 3, 2023
42e5bc6
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain Apr 3, 2023
252fef6
look for migrations config file in the right place
MavenRain Apr 3, 2023
6997d20
cargo fmt
MavenRain Apr 3, 2023
58ce7b0
Debugging commit for deserialization error in hash migration
MavenRain Apr 4, 2023
014067d
Rectified merge with main
MavenRain Apr 4, 2023
17a4709
Now debugging unexpected transport error
MavenRain Apr 4, 2023
2554e03
Attempt to print send envelope message before response is returned
MavenRain Apr 4, 2023
5fbcb2d
Print respone before failed attempt to deserialize
MavenRain Apr 4, 2023
3bed6b3
Log requests before cose packaging
MavenRain Apr 4, 2023
e745b8f
Instrument ledger.info call
MavenRain Apr 4, 2023
912620d
Capture response from client call to ledger.info
MavenRain Apr 4, 2023
0a18e90
Fix clippy error
MavenRain Apr 4, 2023
eb17ffd
Remove some debugging logs to restore webauthn bats tests
MavenRain Apr 4, 2023
da72e3f
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain Apr 4, 2023
c02b7fc
Remove send_message logging
MavenRain Apr 4, 2023
d0f0510
Debugging symbols function
MavenRain Apr 4, 2023
dae0b50
RUST_BACKTRACE=1 to get backtrace
MavenRain Apr 4, 2023
bcbc627
Try to get backtrace to work
MavenRain Apr 4, 2023
ff4fbed
Get error for status from the response in the client call
MavenRain Apr 4, 2023
b7a4c0c
Attempt to log incoming request on server side
MavenRain Apr 5, 2023
90eebbc
Examine reqwest call in send_envelope
MavenRain Apr 5, 2023
fc8b0e9
cargo fmt
MavenRain Apr 5, 2023
da64fba
Log response again
MavenRain Apr 5, 2023
f575b00
Change transport error to unknown error
MavenRain Apr 5, 2023
2c0c000
Further scrutinize response
MavenRain Apr 5, 2023
cea55b6
Print response result
MavenRain Apr 5, 2023
a5572bf
Use modified reqwest repo for further debugging
MavenRain Apr 5, 2023
1033b96
Error for status
MavenRain Apr 5, 2023
b01dd7c
Error surfaced earlier
MavenRain Apr 5, 2023
d6291a5
Restore error conversion after error-for-status
MavenRain Apr 5, 2023
86712ac
Some error-handling in many main
MavenRain Apr 5, 2023
b1f5f84
Debug SYMBOLS_ROOT through migration
MavenRain Apr 5, 2023
a1de093
Now try to decode symbols into map during migration
MavenRain Apr 5, 2023
1acb6ae
Format change of symbol root log
MavenRain Apr 5, 2023
30346d2
Possible moment-of-truth: replacing to_vec with minicbor::to_vec
MavenRain Apr 5, 2023
042e192
Debug update_at_height
MavenRain Apr 5, 2023
162676e
Simply into replacing cbor (double?) encoding
MavenRain Apr 5, 2023
6183734
Try just migrating objects with known iterators
MavenRain Apr 5, 2023
78cf28c
Fix needless borrow
MavenRain Apr 5, 2023
28f30c9
multisig bug in migration fix
MavenRain Apr 5, 2023
03dd4d1
Specifically add symbols table
MavenRain Apr 5, 2023
def4139
Possible solution to iterate-all problem
MavenRain Apr 5, 2023
6500bf4
Cleanup of unwraps post debugging
MavenRain Apr 6, 2023
174c927
reqwest response handling cleanup
MavenRain Apr 6, 2023
60385a4
Refactor update_at_height call post hardcoding path for new storage
MavenRain Apr 6, 2023
bd74390
Refactor replacement from function pointer to more general closure
MavenRain Apr 6, 2023
6eefbd1
Fix clippy errors and remove unwraps post debugging
MavenRain Apr 6, 2023
e2c4f17
Refactoring of LedgerStorage::commit
MavenRain Apr 6, 2023
bc7493b
Overcome clippy error
MavenRain Apr 6, 2023
63b2ce4
Remove println statements post-debugging
MavenRain Apr 6, 2023
cf3d3c2
More migration related cleanup
MavenRain Apr 6, 2023
490f6f7
Introduce forests
MavenRain Apr 6, 2023
183715b
Return error message in payload with 500 from server
MavenRain Apr 6, 2023
caca26c
Fix clippy error
MavenRain Apr 6, 2023
5632885
Merge https://github.com/liftedinit/many-rs into merk-migration
MavenRain Apr 6, 2023
76ff5af
Deleting more debugging code and import formats
MavenRain Apr 6, 2023
702cf18
Remove dead code allowance
MavenRain Apr 10, 2023
f513be6
Restore dead code allowance temporarily
MavenRain Apr 10, 2023
74fb305
Now try to write to same v2 path as v1 path
MavenRain Apr 10, 2023
baa1f16
Merge branch 'detached-state' into merk-migration
MavenRain Apr 10, 2023
bc17301
Fix migration e2e tests
MavenRain Apr 10, 2023
eba86ea
Trying to destroy old v1 merk copy properly
MavenRain Apr 10, 2023
0b58318
Debugging new migration flow
MavenRain Apr 11, 2023
894bee5
Add another unwrapping
MavenRain Apr 11, 2023
ce75813
Straight unwrappings trip a clippy error
MavenRain Apr 11, 2023
c24902a
Debugging update_at_height
MavenRain Apr 11, 2023
a0eb7ba
Debugging initialize function
MavenRain Apr 11, 2023
35aec13
Propagate Debug requirements for error types
MavenRain Apr 11, 2023
3da8121
Further initialize debugging
MavenRain Apr 11, 2023
2639e9f
Inline initialize method for further debugging
MavenRain Apr 11, 2023
3fc1954
Move initialize inlining
MavenRain Apr 11, 2023
d66869b
Debug into hash migration initialization
MavenRain Apr 11, 2023
b70771e
Change to random file name inside created merk temporary operation
MavenRain Apr 11, 2023
95bce1e
Temp directory fixed and debugging removed
MavenRain Apr 11, 2023
cfdb514
Small migration error-handling edit and removing dead code annotation…
MavenRain Apr 11, 2023
f4fa962
Midstep to removing replacement argument of migration initializer
MavenRain Apr 12, 2023
986290c
Remove replacement field from hash migration function type
MavenRain Apr 12, 2023
24f91db
Abstract from PathBuf to Path in function signatures
MavenRain Apr 12, 2023
a83ff7d
Fix unnecessary to_owned
MavenRain Apr 12, 2023
0ca8182
Batch processing refactor
MavenRain Apr 17, 2023
e9d67c7
Fix clippy errors
MavenRain Apr 17, 2023
e62de6c
Test consuming db file path from extra config
MavenRain Apr 19, 2023
b3c8986
Add db file to migrations config
MavenRain Apr 19, 2023
fa7ad3a
Convert entry to PathBuf
MavenRain Apr 19, 2023
db0f739
Print and pass error in AbciCommitInfo
MavenRain Apr 21, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: alias many-ledger test
  • Loading branch information
fmorency committed Mar 22, 2023
commit 186091bb1f3cd36e49308869e9fc2d8684ace12b
1 change: 1 addition & 0 deletions src/many-ledger/BUILD.bazel
Original file line number Diff line number Diff line change
Expand Up @@ -113,6 +113,7 @@ rust_library(

rust_test(
name = "many-ledger-test",
aliases = aliases(),
crate = ":many-ledger-lib-for-test",
data = ["//staging:ledger-staging"],
)
Expand Down