-
Notifications
You must be signed in to change notification settings - Fork 784
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Deneb #4054
Merged
Merged
Deneb #4054
Changes from 6 commits
Commits
Show all changes
672 commits
Select commit
Hold shift + click to select a range
a3862e4
Revert "Clean capella (#4019)"
divagant-martian 6fb1681
Merge branch 'unstable-up-to-clean-capella' into eip4844
divagant-martian f16e82a
Merge branch 'unstable' into eip4844
divagant-martian 56841bc
fix gitignore
divagant-martian 91a8d45
add missing eip4844 core topics placeholder
divagant-martian 39d4f0a
Add BlobSidecar type
pawanjay176 bf40acd
adjust constant to spec values and names
divagant-martian 75a0d52
get back the Blobs pub use to fix compilation issues
divagant-martian 63011c5
fmt
divagant-martian 545532a
fix rpc types to free the blobs (#4059)
divagant-martian 3898cf7
Modify `lighthouse_network` gossip types to free the blobs (#4064)
divagant-martian 140bdd3
update code paths in the `network` crate (#4065)
divagant-martian 203a9e5
Merge branch 'unstable' into eip4844
divagant-martian fe421f7
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian ae3e5f7
fmt
divagant-martian 61b12c2
bump up recursion limits by a lot
divagant-martian 9e30c3c
new lints
divagant-martian ea23d55
more lints
divagant-martian 0ae3078
bump up recursion limits in the sim bin
divagant-martian 6ec0ce6
Implement get validator block endpoint for EIP-4844
jimmygchen e81a502
Update SignedBlobSidecar container
jimmygchen 9ba390f
Merge branch 'update-signed-blob-sidecar' into post-block-and-blobs
jimmygchen a8978a5
Implement publish block and blobs endpoint (WIP)
jimmygchen 76f49bd
Update kzg interface (#4077)
pawanjay176 7f2e9b8
Merge branch 'unstable' into eip4844
divagant-martian 9974dfe
fix merge mistake
divagant-martian e4608d4
Merge branch 'deneb-free-blobs' into get-validator-block-and-blobs
jimmygchen 62627d9
Comment out code that fails to compile
jimmygchen 02a88f0
Add KZG proof and blob validation
jimmygchen 5887c8f
Update commented code to use todo!
jimmygchen 775ca89
Add blobs publishing
jimmygchen fa9baab
Temporarily allow Rust check warnings on 4844 branch. (#4088)
jimmygchen 2ef3ebb
Update SignedBlobSidecar container (#4078)
jimmygchen 2c9477d
Fix block and blob coupling in the network context (#4086)
divagant-martian 3d99e1f
move block contents to api crate, rename blob sidecars list
realbigsean 2e075c0
Merge pull request #4091 from realbigsean/get-validator-block-and-blobs
realbigsean 4a39e43
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian 91a06ba
Merge pull request #4083 from jimmygchen/post-block-and-blobs
realbigsean 34cea6d
fmt
divagant-martian b303d2f
lints
realbigsean fb7d729
migrate types to API crate
realbigsean cf4285e
compile tests
realbigsean 1a87222
Merge pull request #4094 from realbigsean/free-blob-lints
realbigsean 3c18e1a
thread blocks and blobs to sync (#4100)
divagant-martian 1301c62
Validator blob signing for the unblinded flow (#4096)
jimmygchen 607242c
Merge branch 'unstable' into eip4844
divagant-martian 7841433
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian b40dcea
Update get blobs endpoint to return a list of BlobSidecars (#4109)
jimmygchen d1e653c
Update Blob Storage Structure (#4104)
ethDreamer 7fad926
Merge commit '65a5eb829264cb279ed66814c961991ae3a0a04b' into eip4844
divagant-martian 1b9cfcc
Merge branch 'unstable' into eip4844
divagant-martian 1093ba1
revert change to ef_tests
divagant-martian 25a2d8f
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian b276af9
Rework block processing (#4092)
pawanjay176 d84117c
Removed TODO (#4128)
ethDreamer a5addf6
Rename eip4844 to deneb (#4129)
realbigsean af974dc
use block wrapper in sync pairing (#4131)
realbigsean f580863
Add simple pruning to data availability checker (#4132)
realbigsean da7fab5
Ef test version update (#4142)
realbigsean d24e5cc
clean up blobs by range response (#4137)
realbigsean deec9c5
clean up blob by root response (#4136)
realbigsean ffefd20
Block processing cleanup (#4153)
pawanjay176 3a21317
Unified Availability Cache into One (#4161)
ethDreamer 9053223
Merge commit '036b797b2c1831352f937356576b3c78c65220ad' into eip4844
divagant-martian 9558c18
Merge commit 'c5383e393acee152e92641ce4699d05913953e70' into eip4844
divagant-martian 3c1a22c
Merge commit '1e029ce5384e911390a513e2d1885532f34a8b2b' into eip4844
divagant-martian cb81815
Merge branch 'unstable' into eip4844
divagant-martian 32f9ba0
fix merge conflict
divagant-martian 1b8225c
Revert upgrade to tokio utils to reprocessing queue (#4167)
pawanjay176 911a635
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian df1da10
Merge branch 'unstable' into eip4844
divagant-martian f6f63b1
Merge branch 'eip4844' into deneb-free-blobs
divagant-martian fca8559
Update kzg to get windows going, expose blst features (#4177)
divagant-martian 9dee718
Remove unused blob endpoint and types (#4209)
jimmygchen 2d08343
Switch blob tx type to 0x03 (#4186)
jimmygchen a6335eb
bump ef tests version (#4217)
realbigsean e6b033a
update blob transaction (#4218)
realbigsean 895bbd6
Gossip conditions deneb (#4164)
pawanjay176 689c0f7
Merge branch 'unstable' into eip4844
pawanjay176 b2ccc82
Fix compiler issues
pawanjay176 b6c0e91
Merge branch 'eip4844' into deneb-free-blobs
pawanjay176 7a36d00
Subscribe blob topics (#4224)
pawanjay176 cbe2e47
update blobs by range protocol name (#4229)
realbigsean a632969
Gossip verification cleanup (#4219)
pawanjay176 cbe4880
Fix deneb doppelganger tests (#4124)
pawanjay176 aa34339
Rename to MIN_EPOCHS_FOR_BLOB_SIDECARS_REQUESTS (#4206)
jtraglia c1d47da
Update `engine_api` to latest version (#4223)
ethDreamer 9db6b39
fix check on max request size (#4250)
realbigsean a22e4bf
Implement KZG EF Tests (#4274)
ethDreamer 46db304
Implement Overflow LRU Cache for Pending Blobs (#4203)
ethDreamer c4b2f1c
fix count usage in blobs by range (#4289)
realbigsean 9b55d74
fix db startup (#4298)
realbigsean 70c4ae3
Merge branch 'unstable' into deneb-free-blobs
jimmygchen 81c9af5
Use patched versions of common libraries
jimmygchen 1834723
Fix failing tests
jimmygchen c406305
Update testnet ETH1_BLOCK_HASH value
jimmygchen 65a2ae3
Fix failing tests (workaround)
jimmygchen 00ffd18
Empty commit.
jimmygchen e8f1d53
Merge pull request #4349 from jimmygchen/deneb-merge-from-unstable-20…
realbigsean a227959
Merge branch 'unstable' of https://github.com/sigp/lighthouse into de…
realbigsean 6adb68c
fix compile after merge
realbigsean 7a4be59
Merge pull request #4367 from realbigsean/merge-unstable-to-deneb
realbigsean ceaa740
Validate & Store Blobs During Backfill (#4307)
ethDreamer aef232c
Remove Unnecessary Option in Blob Pruning (#4363)
ethDreamer 72d6cda
Revert "Temporarily allow Rust check warnings on 4844 branch. (#4088)…
realbigsean ec1b364
update automatic docker builds for the correct branch (#4375)
realbigsean 0a2a00a
Update max blobs per block (#4391)
pawanjay176 801bf59
Merge branch 'unstable' into deneb-merge-from-unstable-20230613
jimmygchen 5428e68
Merge pull request #4392 from jimmygchen/deneb-merge-from-unstable-20…
realbigsean a62e52f
Single blob lookups (#4152)
realbigsean e1af24b
Add more comments to overflow LRU cache (#4406)
ethDreamer 97c4660
Merge branch 'unstable' into deneb-merge-from-unstable-20230627
jimmygchen d062f61
Fix failing tests after merge
jimmygchen cc03ba4
Merge branch 'unstable' into deneb-merge-from-unstable-20230627
jimmygchen 56caccb
Added a few fixes from merge
jimmygchen dfbe4b1
Add missing Cargo.lock changes (`ssz_types` patch)
jimmygchen d1146ec
Sync finalized sync to 2 epochs + 1 slot past our peer's finalized sl…
jimmygchen 5c4485e
Merge branch 'deneb-merge-from-unstable-20230627' of github.com:jimmy…
jimmygchen 68140fa
Update max block request limit to `MAX_REQUEST_BLOCKS_DENEB` to ensur…
jimmygchen 03a17a8
Update `handle_rpc_response` blobs match arms to be consistent with b…
jimmygchen 5b85aec
Add BlobSidecar encode & decode test and fix `RpcLimit` for `BlobsByR…
jimmygchen 4c9fcf1
Merge pull request #4432 from jimmygchen/deneb-merge-from-unstable-20…
realbigsean adbb62f
Devnet6 (#4404)
realbigsean 4a79328
update clang in cross docker (#4451)
realbigsean d9254b7
update get blobs endpoint name from blobs to blob_sidecars (#4467)
realbigsean d41193c
fix failing network tests (#4472)
realbigsean af4a668
remove clang from Dockerfile (#4471)
realbigsean ba65812
remove patched dependencies (#4470)
realbigsean c3ef84b
remove uninlined arg lint suppression (#4469)
realbigsean 246d52d
remove into gossip verified block
realbigsean cfe2452
Merge branch 'remove-into-gossip-verified-block' of https://github.co…
realbigsean c4da1ba
resolve merge issues
realbigsean 6fd2ef4
Revert "remove into gossip verified block"
realbigsean 782a53a
fix compile
realbigsean 57bb1d9
fix progressive balance slashing tests
realbigsean 1599487
fix tests
realbigsean c016f5d
gossip validate blobs prior to publish
realbigsean a6f48f5
Merge branch 'unstable' of https://github.com/sigp/lighthouse into me…
realbigsean 2b93c0e
remove spec minimal feature gating in tests (#4468)
realbigsean 42f54ee
fix merge conflict issues
realbigsean 405e95b
fix merge
realbigsean 1876082
Fix beta compiler warnings
pawanjay176 b96db45
Merge branch 'unstable' of https://github.com/sigp/lighthouse into me…
realbigsean 0f514cb
fixes after merge
realbigsean a618830
fix smol lint
realbigsean aeee5be
smol fixes
realbigsean 597389c
Merge branch 'merge-unstable-deneb-june-6th' of https://github.com/re…
realbigsean 27a9901
Merge pull request #38 from realbigsean/merge-unstable-deneb-jul-14
realbigsean 382b5ab
Merge branch 'deneb-free-blobs' into merge-unstable-deneb-june-6th
pawanjay176 e1d0724
Fix more beta compiler warnings
pawanjay176 cffa562
cargo fmt
realbigsean f98671f
Merge pull request #4477 from realbigsean/merge-unstable-deneb-june-6th
realbigsean f1f04bc
Add Changes to BlobSidecars Endpoint (#4455)
Gua00va 4ca101e
Merge branch 'unstable' into deneb-free-blobs
jimmygchen 54c6e1d
Fix compilation
jimmygchen fe94a05
Fix lint
jimmygchen 3735450
Merge pull request #4533 from jimmygchen/deneb-free-blobs
realbigsean 33dd13c
Refactor deneb block processing (#4511)
realbigsean 8c341bb
cargo fmt (#4541)
realbigsean 97bffd0
handle empty blocks gracefully
qu0b 1be4d54
remove option & remove block check
qu0b 28de041
cargo fmt & lint-fix
qu0b c991516
fix CI errors
qu0b e021575
formatting
qu0b 9c75d80
Merge pull request #4535 from qu0b/blob/empty
jimmygchen a36e34e
Fix todos in deneb code (#4547)
pawanjay176 c8ea3e1
Fix small bug in test utils (#4570)
ethDreamer 731b7e7
Refactor deneb networking (#4561)
realbigsean ec416df
Merge branch 'unstable' into merge-unstable-to-deneb-20230808
jimmygchen d401633
Add same error handling for blob signing when pubkey is missing
jimmygchen 3ba9047
Fix release tests
jimmygchen efbf906
Merge pull request #4578 from jimmygchen/merge-unstable-to-deneb-2023…
realbigsean 02c7a2e
Improve single block/blob logging (#4579)
realbigsean 12b5e9a
Merge branch 'unstable' of https://github.com/sigp/lighthouse into me…
realbigsean c3ced28
cargo fmt
realbigsean 4da6ca7
fix imports
realbigsean 9e8a289
fix blobs by range test
realbigsean 2b5385f
Changes for `devnet-8` (#4518)
ethDreamer fddd4e4
Merge pull request #4591 from realbigsean/merge-unstable-deneb-aug-9
realbigsean 0b7a426
Builder flow for Deneb & Blobs (#4428)
jimmygchen 8d81f1b
self hosted docker builds
realbigsean 754ce5e
remove self hosted runner check where it might not be needed
realbigsean 1440dc0
Merge pull request #4599 from realbigsean/self-hosted-docker-deneb
realbigsean 87b165c
bump clang in cross.toml (#4602)
realbigsean 11027e3
self hosted docker builds attempted fix (#4603)
realbigsean ab37f02
Fix env var references (#4604)
realbigsean 7f7ad79
Fix manifest lists (#4605)
realbigsean ff792d9
Merge branch 'unstable' into merge-unstable-to-deneb-20230816
jimmygchen e1991e7
Merge pull request #4628 from jimmygchen/merge-unstable-to-deneb-2023…
realbigsean ba66623
Update docs to remove `lighthouse/database/historical_blocks` (remove…
jimmygchen 0e04f36
Add Test for deneb Block Hash Calculation (#4621)
ethDreamer c280b48
Add back mplex
pawanjay176 f031a57
Merge pull request #4632 from jimmygchen/revive-mplex-deneb
jimmygchen 4898430
Add Deneb builder test & update mock builder (#4607)
jimmygchen 7d468cb
More deneb cleanup (#4640)
realbigsean 63b876b
fix beacon chain tests (#4645)
realbigsean 49d7fdf
Fix proposer cache miss in blob verification (#4646)
jimmygchen 8a6f171
Merge branch 'unstable' into merge-unstable-to-deneb-20230822
jimmygchen 7138763
Empty commit
jimmygchen 03c610e
Fix release test compilation error
jimmygchen 609c2c2
Update ckzg to latest version with blst 0.3.11
jimmygchen 4bd5275
Fix failing beacon chain tests and remove unnecessary blob clone
jimmygchen 2553944
Merge pull request #4649 from jimmygchen/merge-unstable-to-deneb-2023…
realbigsean 8ed77d4
Merge branch 'unstable' of https://github.com/sigp/lighthouse into me…
realbigsean f90b190
Merge branch 'unstable' of https://github.com/sigp/lighthouse into me…
realbigsean 42b34db
cargo fmt
realbigsean ce824e0
Merge pull request #4658 from realbigsean/merge-unstable-deneb-aug-24
realbigsean 5ea38d9
Pin foundry toolchain version to fix stuck CI jobs (#4682)
jimmygchen e783a40
Deneb review suggestions (#4678)
paulhauner 0bfc933
Deneb review suggestions (2) (#4680)
paulhauner 2550170
Deneb review suggestions (3) (#4694)
paulhauner 1360653
Simplifications for ./crypto (#4677)
michaelsproul f9bea3c
Deneb review `common/eth2` (#4698)
jimmygchen 8db44de
Fix `parent_beacon_block_root` during proposer prep (#4703)
michaelsproul 87ec759
Fix duplicate geth startup command in doppelganger_protection.sh (#4713)
jimmygchen 50bf40b
Update `GET config/spec` endpoint to support Deneb config (#4708)
jimmygchen 1db7394
Update `BlindedBlobsBundle` SSZ list max length and update builder te…
jimmygchen 6771954
Merge `unstable` 20230911 into `deneb-free-blobs`.
jimmygchen d4aedab
Fix some compilation errors in tests
jimmygchen 58cd506
fix the missing components response code for block publish (#4721)
realbigsean 8e7b57a
Merge pull request #4719 from jimmygchen/deneb-merge-from-unstable-20…
realbigsean 4a31e36
increase the max topic subscriptions #4581 (#4588)
qu0b 2cfcb51
Blob references in ckzg (#4723)
pawanjay176 5f98a7b
Deneb PR feedback updates (#4716)
realbigsean 665334e
Implement SSZ decoding for `SignedBlockContents` (#4744)
jimmygchen 5c5afaf
Update Deneb to 1.4.0-beta.2 (devnet-9) (#4735)
dapplion 9244f7f
Improvements to Deneb `store` upon review (#4693)
michaelsproul c0b6b92
Merge `unstable` 20230925 into `deneb-free-blobs`.
jimmygchen 7a3cb13
Fix tests and add `BlockContents` decoding. Remove unused `builder_th…
jimmygchen 1458394
Fix compilation issues after merging `unstable`.
jimmygchen 8f07a96
Fix failing tests.
jimmygchen a642bd7
Merge pull request #4781 from jimmygchen/merge-unstable-to-deneb-2023…
realbigsean 9f37d6d
reduce blob prune logging in forward sync (#4779)
realbigsean 57edc0f
Add `serde(default)` to `max_per_epoch_activation_churn_limit` in spe…
jimmygchen 67aeb6b
insert cached child at the front of a chain of parent lookups (#4780)
realbigsean c7ddf1f
add processing and processed caching to the DA checker (#4732)
realbigsean c5c84f1
Merge branch 'unstable' into merge-unstable-to-deneb-20231005
jimmygchen 72563ff
Fix CI tests
jimmygchen 3692622
Merge branch 'unstable' into merge-unstable-to-deneb-20231005
jimmygchen a96963f
Re-commit corrupted key files
jimmygchen 203ac65
Merge pull request #4808 from jimmygchen/merge-unstable-to-deneb-2023…
realbigsean 4ad7e15
Address Clippy 1.73 lints on Deneb branch (#4810)
jimmygchen 8660043
Prevent Overflow LRU Cache from Exploding (#4801)
ethDreamer d9acee5
Delete unused ssz_types file (#4824)
michaelsproul 4555e33
Remove serde derive references (#4830)
realbigsean 38e7172
Add `blob_sidecar` event to SSE (#4790)
jimmygchen 2d662f7
Use Deneb fork in generate_genesis_header
michaelsproul cf544b3
Very minor own nitpicks (#4845)
AgeManning ba0567d
Merge remote-tracking branch 'origin/unstable' into deneb-free-blobs
michaelsproul 283ec8c
Deneb pr updates 2 (#4851)
realbigsean File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I notice that this will return an empty list for pre-Deneb blocks when I think we'd usually expect
None
. I don't know of any issues with this, but it's something to consider. Feel free to resolve this if you consider it considered :)There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, so this originally returned an
Option
, but we removed it in this PR: #4535It seemed like the place where the
Option
was primarily useful was in the beacon API because for blocks it dictates whether we should return a 404, but for the blobs endpoint, the 404 is determined by whether we have the corresponding block (not blobs) so theOption
here didn't end up useful.Wouldn't be opposed to adding it back, but it has been considered :)