Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Merged by Bors] - Builder Specs v0.2.0 #3134

Closed
Closed
Show file tree
Hide file tree
Changes from 250 commits
Commits
Show all changes
297 commits
Select commit Hold shift + click to select a range
f34cace
Fix route
macladson Apr 5, 2022
24cdb2b
Return correct `execution_optimistic` values for api queries by state
macladson Apr 6, 2022
15e5f87
Updated api client functions
macladson Apr 6, 2022
39b645d
Refactor HTTP API tests
macladson Apr 8, 2022
e951612
Return 404 when requested root is 0x000..000
macladson Apr 8, 2022
8ecfead
Tidy up
macladson Apr 11, 2022
92c38bc
Avoid recomputing head
macladson Apr 12, 2022
8444e2d
More improvements
macladson Apr 14, 2022
a67381d
Use head when computing status for slot
macladson May 10, 2022
0faf026
Rebase on unstable
macladson May 13, 2022
7240b4d
Add tests
macladson May 17, 2022
469e931
Fix conflicts
macladson May 23, 2022
e3a7033
fix signing
realbigsean May 23, 2022
7f7fe9c
Merge branch 'register-validator-api' of https://github.com/realbigse…
realbigsean May 23, 2022
ca73387
make sure post to validator registration endpoint expects no response
realbigsean May 23, 2022
a6949bf
allow mock el dead code
realbigsean May 23, 2022
62a6cd8
allow mock el dead code
realbigsean May 23, 2022
a275fb3
wrap the payload header in a bid
realbigsean May 23, 2022
b1e8e1b
fix query path
realbigsean May 23, 2022
0f65967
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean May 24, 2022
6669a57
fix bid deserialization
realbigsean May 24, 2022
291895d
Update beacon_node/http_api/tests/tests.rs
realbigsean May 24, 2022
885819b
Update consensus/types/src/chain_spec.rs
realbigsean May 24, 2022
edc8dce
Update validator_client/src/preparation_service.rs
realbigsean May 24, 2022
b20d7fb
Update validator_client/src/preparation_service.rs
realbigsean May 24, 2022
ca567fd
Update validator_client/src/preparation_service.rs
realbigsean May 24, 2022
b3ee9b8
actually do bitmask operation in test
realbigsean May 24, 2022
bdbe795
don't double publish changed keys on epoch boundary
realbigsean May 24, 2022
3f66349
only start the registration service if we have the private transactio…
realbigsean May 24, 2022
ae061f0
publish registrations regardless of how close we are to the merge
realbigsean May 24, 2022
b759e8d
fix lints, commented out tests for future web3signer addition
realbigsean May 24, 2022
054aa0f
supress lint
realbigsean May 25, 2022
4553bf9
Merge branch 'register-validator-api' of https://github.com/realbigse…
realbigsean May 25, 2022
8a7586e
add timeout to the builder client header endpoint
realbigsean May 25, 2022
911ef90
batched validator registration data
realbigsean May 25, 2022
ebb43e8
add mock builder
realbigsean May 27, 2022
7273ea7
Merge branch 'ex-opt-api' of https://github.com/macladson/lighthouse …
realbigsean May 27, 2022
a7443ce
add builder to api tests
realbigsean May 27, 2022
860784f
fix signing in test
realbigsean May 27, 2022
210a998
context dep public
realbigsean May 27, 2022
eefba72
context dep public
realbigsean May 27, 2022
7be55a3
logs for debugging
realbigsean May 31, 2022
ccba070
logs for debugging
realbigsean May 31, 2022
a52c424
sign builder bids in mock builder
realbigsean May 31, 2022
d613609
key payload cache by tree hash root not tx root
realbigsean May 31, 2022
9657ae8
key payload cache by tree hash root not tx root
realbigsean May 31, 2022
a82dbec
sign builder bids in mock builder
realbigsean May 31, 2022
8f83d2e
sign builder bids in mock builder
realbigsean May 31, 2022
3f0f8da
debug logs
realbigsean May 31, 2022
16142ec
fix prev randao in mock builder
realbigsean May 31, 2022
1677d92
fix randao in mock builder
realbigsean May 31, 2022
7f5bd59
json serde mock builder payloads
realbigsean May 31, 2022
ef78655
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jun 1, 2022
3fe4aed
logging updates
realbigsean Jun 1, 2022
337e06e
fix typo
realbigsean Jun 1, 2022
c7304f4
improve local testing
realbigsean Jun 2, 2022
90fd5fc
cago fmt, cargo fix, cargo generate-lockfile
realbigsean Jun 3, 2022
5f17141
fix ports in tests
realbigsean Jun 3, 2022
d38714b
Validate some fields vs a local payload
realbigsean Jun 8, 2022
cd362d2
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jun 8, 2022
2a2be0a
fmt and remove reference
realbigsean Jun 8, 2022
39046cc
fix pre-TTD block proposals
realbigsean Jun 13, 2022
c25e8ee
fix fix
realbigsean Jun 13, 2022
3c77574
pawan > me
realbigsean Jun 13, 2022
ec590c8
start docs
realbigsean Jun 14, 2022
9639d5d
start docs
realbigsean Jun 15, 2022
ab6887a
update docker version
realbigsean Jun 16, 2022
c5e17ce
lints
realbigsean Jun 16, 2022
83fe495
cargo fmt
realbigsean Jun 16, 2022
c41b73e
pin deps
realbigsean Jun 17, 2022
ec4676b
Revert "pin deps"
realbigsean Jun 17, 2022
7dc5d41
pin deps
realbigsean Jun 17, 2022
d12d03b
Revert "pin deps"
realbigsean Jun 17, 2022
ec5f058
Squash previous works
macladson Mar 10, 2022
61ff3b5
Resolve `BeaconChain` compile errors
paulhauner May 30, 2022
4fa5be6
Revert `common/eth2` to `unstable`
paulhauner May 30, 2022
ac01a7e
Fix `http_api` to pass `make lint`
paulhauner Jun 7, 2022
8ade87e
Remove old fork choice functions
paulhauner May 30, 2022
b00c0db
Fix compile errors in HTTP tests
paulhauner May 31, 2022
095ff72
Wrap harness in Arc
paulhauner May 31, 2022
211e4cc
Start *horrific* async test refactor
paulhauner May 31, 2022
3438ac2
More test fixes
paulhauner May 31, 2022
9aa796f
Make tests *finally* compile with async FC
paulhauner Jun 1, 2022
87b4760
Add progress on async block import
paulhauner Jun 2, 2022
3cbffa4
Solve `StoreOp` lifetime problem
paulhauner Jun 2, 2022
ac35a43
Reinstate panda banner
paulhauner Jun 4, 2022
2d0f5b9
Partially add `PayloadNotifier`
paulhauner Jun 4, 2022
4597d24
Start Arc-ifying SignedBeaconBlock
paulhauner Jun 5, 2022
0a6b9ae
Arc-ification of networking crate
paulhauner Jun 6, 2022
3e21adb
Fix http_api, `make lint` passes
paulhauner Jun 6, 2022
689f3e6
Refactor exec payload "prepare payload"
paulhauner Jun 6, 2022
59351d2
Make block production async (make lint passing)
paulhauner Jun 6, 2022
f9634a6
Fix test compilation errors
paulhauner Jun 6, 2022
dc4c7b6
Fix justified checkpoint getter
paulhauner Jun 6, 2022
d21536e
Remove deadlock from block import
paulhauner Jun 7, 2022
f452bd8
Fix clippy lint
paulhauner Jun 7, 2022
49fce95
Update test for finalized_checkpoint event
paulhauner Jun 7, 2022
11a3eaa
Fix MSRV issue
paulhauner Jun 7, 2022
d305f49
Fix failing network tests
paulhauner Jun 7, 2022
c3d04bd
Remove HeadSafetyStatus
paulhauner Jun 7, 2022
b7bee40
Remove unused error
paulhauner Jun 7, 2022
2e9a8c0
Fix compile errors in beacon chain tests
paulhauner Jun 7, 2022
5be6374
Simplify chain segment processing
paulhauner Jun 8, 2022
1bcf234
Remove some blocking methods
paulhauner Jun 8, 2022
7b7b356
Fix missing `!`
paulhauner Jun 8, 2022
2296643
Fix failing payload_invalidation tests
paulhauner Jun 10, 2022
a6a6aae
Fix store test
paulhauner Jun 10, 2022
a861777
Remove commented-out code
paulhauner Jun 10, 2022
93864b8
Fix weak subjectivity test
paulhauner Jun 10, 2022
ab4e1e8
Move EL update spawning
paulhauner Jun 10, 2022
1faf17a
Fix http_api compile error
paulhauner Jun 11, 2022
52bbd94
Fix compile error in client builder
paulhauner Jun 11, 2022
81d7fc7
Remove genesis alias workaround from EF tests
paulhauner Jun 11, 2022
cb8677c
Remove `block_on` from EL
paulhauner Jun 11, 2022
706e385
Remove block_on for blinded blocks in HTTP API
paulhauner Jun 11, 2022
67fd2a4
Disable rayon for fork choice tests
paulhauner Jun 14, 2022
de8482d
Simplify getting for active val count
paulhauner Jun 14, 2022
8f24eb1
Make block_on_dangerous respect exit, metrics
paulhauner Jun 14, 2022
1a3070f
Patch and unify status_message
paulhauner Jun 14, 2022
5cda3ee
Move recompute_head into canonical_head
paulhauner Jun 14, 2022
67ca5d7
Remove head_proposer_shuffling_decision_root
paulhauner Jun 14, 2022
ccdc74d
Arc-ify BeaconSnapshot
paulhauner Jun 15, 2022
be38daa
Spawn new task for after_finalization
paulhauner Jun 15, 2022
90730a7
Provide different state root to db migrator
paulhauner Jun 15, 2022
d84550f
Don't log crit when tokio stops block import
paulhauner Jun 15, 2022
0ab1b64
Add back warning for opt head
paulhauner Jun 15, 2022
4badadf
Remove debug formatting for roots
paulhauner Jun 15, 2022
98bed99
Raise gossip block log levels
paulhauner Jun 15, 2022
52cb170
Revert "Remove debug formatting for roots"
paulhauner Jun 15, 2022
6426347
Add weight logging
paulhauner Jun 15, 2022
1603b44
Drop txn_lock
paulhauner Jun 15, 2022
5b2f46a
Compute state root in spawned function
paulhauner Jun 15, 2022
7552f9a
Use state roots iter directly
paulhauner Jun 15, 2022
888b278
Avoid blocking async on canon head lock
paulhauner Jun 16, 2022
161c923
Add fast canonical head
paulhauner Jun 16, 2022
1a4bb67
Remove inconsistent head errors
paulhauner Jun 16, 2022
7f2db8e
Update fast head earlier
paulhauner Jun 16, 2022
1d67297
Ensure FFG checkpoints are consistent with head
paulhauner Jun 16, 2022
4ffdb41
Do timeout lock for beacon state metrics
paulhauner Jun 16, 2022
7199425
Use fast head in http_api
paulhauner Jun 16, 2022
7a44522
Use fast head in notifier
paulhauner Jun 16, 2022
611db3a
Split head and FC locks
paulhauner Jun 17, 2022
79aab62
Get make lint passing
paulhauner Jun 17, 2022
5d4ad4e
Tidy, add comments
paulhauner Jun 17, 2022
65ead81
Tidy comments
paulhauner Jun 17, 2022
7cc0d27
Switch to `Arc<Snapshot>` for `CachedHead`
paulhauner Jun 20, 2022
dbde4bf
Expose fork choice locks
paulhauner Jun 20, 2022
08082fb
Tidy
paulhauner Jun 20, 2022
82d8068
Fix test compile errors
paulhauner Jun 20, 2022
858db36
Update Cargo.lock
paulhauner Jun 20, 2022
b5043b9
Unify is_optimistic_candidate_block
paulhauner Jun 20, 2022
44a75e7
Fix flipped bool
paulhauner Jun 20, 2022
7c5ea7a
Revert changes to clippy.toml
paulhauner Jun 21, 2022
01e760f
Revert changes to beacon_chain Cargo.toml
paulhauner Jun 21, 2022
459c677
Refactor head accessor methods
paulhauner Jun 21, 2022
2905a9d
Fix broken store test
paulhauner Jun 21, 2022
fcbe53f
Fix state_advance_timer TODO
paulhauner Jun 21, 2022
0d8a9d8
Refactor `BeaconChain::best_slot`
paulhauner Jun 21, 2022
b5388ae
Fix conflict in `state_advance_timer`
paulhauner Jun 21, 2022
2b1bb42
Use blocking task for FC notifier tx
paulhauner Jun 21, 2022
57d62f1
Update opt sync error message
paulhauner Jun 21, 2022
9d73de2
Remove commented-out code from beacon_processor
paulhauner Jun 21, 2022
343aa37
Add comments to `TaskSpawner`
paulhauner Jun 21, 2022
6de54f1
Reduce duplicate code in sync_methods
paulhauner Jun 21, 2022
934a147
Add comment about val count caches
paulhauner Jun 21, 2022
9ca7d49
Update block_on_dangerous comments
paulhauner Jun 21, 2022
42af8db
Remove phantom block_efficiency file
paulhauner Jun 21, 2022
219327b
Remove parking lot from ef_tests
paulhauner Jun 21, 2022
836ac1c
Use rayon in ef_tests by default
paulhauner Jun 21, 2022
19870a8
Remove erroneous log for opt transition block
paulhauner Jun 22, 2022
6b3b2b7
Tidy
paulhauner Jun 22, 2022
2afe98d
Undo changes to `BeaconChain::import_block`
paulhauner Jun 22, 2022
f3ac736
Reduce diff for attestation production
paulhauner Jun 22, 2022
de9a72e
Reduce chain segment diff
paulhauner Jun 22, 2022
74f8e0b
Tidy
paulhauner Jun 22, 2022
b46088d
Tidy
paulhauner Jun 22, 2022
5f67350
Tidy
paulhauner Jun 22, 2022
733192a
Apply suggestions from code review
paulhauner Jun 22, 2022
acc9aac
Use fc write lock for restore
paulhauner Jun 23, 2022
011818f
Address review comments from @realbigsean
paulhauner Jun 23, 2022
6313d63
Apply suggestions from code review
paulhauner Jun 28, 2022
b31bc91
Fix bad comment
paulhauner Jun 28, 2022
423c128
Merge branch 'nfd-2' of https://github.com/paulhauner/lighthouse into…
realbigsean Jun 29, 2022
f4f1dde
cargo lock
realbigsean Jun 29, 2022
a478c92
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jun 29, 2022
f8ad9ee
remove duplicate dep
realbigsean Jun 29, 2022
d0ba45d
fix compile errors after merging
realbigsean Jun 29, 2022
14005f4
fix lints in tests
realbigsean Jun 30, 2022
882b8fa
fix tests and handle 204
realbigsean Jul 1, 2022
3fb17f7
Update HTTP API to include `execution_optimistic` flag in responses
macladson Mar 10, 2022
0b7aaa2
Fix tests and apply suggestions
macladson Jul 11, 2022
5bd566b
Get blinded blocks where possible
macladson Jul 12, 2022
4000c34
Missed one
macladson Jul 12, 2022
be1e2e2
Merge branch 'unstable' of https://github.com/sigp/lighthouse into ex…
realbigsean Jul 13, 2022
203cc5e
Merge branch 'ex-opt-unstable' of https://github.com/realbigsean/ligh…
realbigsean Jul 13, 2022
4c32194
fix merge issues
realbigsean Jul 14, 2022
c13f69d
lints
realbigsean Jul 14, 2022
7aa2a74
enable validator registration web3signer tests
realbigsean Jul 15, 2022
c7f1935
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jul 15, 2022
44a88e7
add flag that enables users to override the builder registration time…
ciaranmcveigh5 Jul 18, 2022
a5ecf63
Update HTTP API to include `execution_optimistic` flag in responses
macladson Mar 10, 2022
0bda4bb
Fix tests and apply suggestions
macladson Jul 11, 2022
64ed23c
Get blinded blocks where possible
macladson Jul 12, 2022
36704fd
Missed one
macladson Jul 12, 2022
ff17b4b
Implement suggestions
macladson Jul 19, 2022
af67927
Wrap execution_optimistic in an Option
macladson Jul 20, 2022
1801b19
[builder API] Verify builder signature (#3334)
realbigsean Jul 21, 2022
a9d37ef
[builder API] Add/update relay timeouts (#3333)
realbigsean Jul 21, 2022
58b784c
[builder API] Chain health checks before using builder API (#3356)
realbigsean Jul 21, 2022
ffd11fa
[builder API] Make gas limit configurable, and add per-validator buil…
realbigsean Jul 21, 2022
b6a98a9
Merge branch 'unstable' of https://github.com/sigp/lighthouse into bu…
realbigsean Jul 21, 2022
5762cdb
merge with unstable
realbigsean Jul 21, 2022
0e6ffcd
Undo regression
macladson Jul 22, 2022
3bc29f0
fix tests and block hash check
realbigsean Jul 22, 2022
b5a905c
Merge branch 'ex-opt-api' of https://github.com/macladson/lighthouse …
realbigsean Jul 22, 2022
1dfb2ae
lint
realbigsean Jul 22, 2022
cdec472
lint
realbigsean Jul 22, 2022
a6973bb
Merge branch 'unstable' of https://github.com/sigp/lighthouse into bu…
realbigsean Jul 22, 2022
cca72dc
query v1 blinded blocks endpoint as per beacon apis spec
realbigsean Jul 22, 2022
bf41da2
fix fee recipient condition
realbigsean Jul 22, 2022
ea04ee9
add more builder validation tests
realbigsean Jul 22, 2022
7224220
fix test
realbigsean Jul 22, 2022
bebca91
fix cli tests
realbigsean Jul 25, 2022
9a084ba
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jul 25, 2022
d1ccbe5
fix merge with unstable issues
realbigsean Jul 25, 2022
8163dd5
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jul 26, 2022
b2607b6
fix merge with unstable
realbigsean Jul 26, 2022
301b1e2
git commit -am "self-review fixes"
realbigsean Jul 26, 2022
e36d88e
make sure PATCH to validator def updates initialized validators
realbigsean Jul 26, 2022
6e49531
improve logging, separate blinded and full block request metrics for …
realbigsean Jul 27, 2022
6e1349d
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jul 28, 2022
a15a0d5
- batch validator registration POST's
realbigsean Jul 28, 2022
eb25b5e
Merge branch 'unstable' of https://github.com/sigp/lighthouse into pr…
realbigsean Jul 28, 2022
a945498
fix merge with unstable
realbigsean Jul 28, 2022
8fc8b71
Update beacon_node/beacon_chain/src/beacon_chain.rs
realbigsean Jul 29, 2022
ae1a500
epochs_since_finalization typo
realbigsean Jul 29, 2022
56d4316
Update beacon_node/beacon_chain/src/chain_config.rs
realbigsean Jul 29, 2022
164e507
Update beacon_node/beacon_chain/src/chain_config.rs
realbigsean Jul 29, 2022
0dd3ff1
Update consensus/types/src/chain_spec.rs
realbigsean Jul 29, 2022
8419a58
Update validator_client/src/validator_store.rs
realbigsean Jul 29, 2022
78a1237
use method during block reconstruction
realbigsean Jul 29, 2022
6093f99
fix line breaks on logs and comments
realbigsean Jul 29, 2022
5ad7632
lockfile update
realbigsean Jul 29, 2022
4c67d7d
fix some more log line lengths
realbigsean Jul 29, 2022
5f6dc08
make sure skips serializing optional fields
realbigsean Jul 29, 2022
eda5a5c
update lockfile
realbigsean Jul 29, 2022
84e7f53
docs
realbigsean Jul 29, 2022
755b017
Misc doc suggestions
paulhauner Jul 29, 2022
97dc8b6
update cli help
realbigsean Jul 29, 2022
6eca16a
fix cli whitespace
realbigsean Jul 29, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 18 additions & 2 deletions .github/workflows/local-testnet.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,13 +40,29 @@ jobs:
run: make && make install-lcli

- name: Start local testnet
run: ./start_local_testnet.sh
run: ./start_local_testnet.sh && sleep 60
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the sleep necessary?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(don't mind if it stays)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had to dig into this again because it's been a while since I added that. I think we do need this.

If you check out the logs in some CI runs on other branches we never get past this log line, even though the print_logs.sh it looks like we should be dumping the whole file.

Jul 22 01:12:04.334 INFO Starting from known genesis state service: beacon

So I think what happens is we kick off all the processes and shut them down before they are fully initialized.

working-directory: scripts/local_testnet

- name: Print logs
run: ./print_logs.sh
run: ./dump_logs.sh
working-directory: scripts/local_testnet

- name: Stop local testnet
run: ./stop_local_testnet.sh
working-directory: scripts/local_testnet

- name: Clean-up testnet
run: ./clean.sh
working-directory: scripts/local_testnet

- name: Start local testnet with blinded block production
run: ./start_local_testnet.sh -p && sleep 60
working-directory: scripts/local_testnet

- name: Print logs for blinded block testnet
run: ./dump_logs.sh
working-directory: scripts/local_testnet

- name: Stop local testnet with blinded block production
run: ./stop_local_testnet.sh
working-directory: scripts/local_testnet
Loading