Skip to content

Conversation

@mattevans
Copy link
Member

@mattevans mattevans commented Dec 18, 2025

  • Adds a new int_engine_new_payload transformation table that captures and enriches engine_newPayload observations
  • Joins raw Engine API data from consensus_engine_api_new_payload with block metadata from fct_block_head
  • Introduces a node_class derived column for classifying nodes (e.g., eip7870-block-builder)
  • Includes projections for efficient queries by slot and duration_ms

@mattevans mattevans self-assigned this Dec 18, 2025
@mattevans mattevans requested a review from Savid as a code owner December 18, 2025 03:00
…al table

feat(transformations): derive node_class from client name to tag EIP-7870 block builders
* master:
  chore: regen proto
  feat: replace status_hourly/daily tables with _by_el_client_hourly variants
  sane defaults and bump clickhouse mem to 20gb per query (#177)
  feat(models): refactor storage slot expiry to waterfall system (#174)
…trics

Introduce new local and distributed ClickHouse tables to store
engine_newPayload observations. The schema captures timing, block
identifiers, gas usage, validation status, client metadata, and
enriched block size/status from fct_block. Includes projections
for efficient querying by slot and duration.
Replace fct_block dependency with fct_block_head to avoid
canonicalization status that is not available at head time.
Remove block_status from table, transformation model, and Go
proto query builder to keep the interface consistent.

refactor(proto): remove block_status field from IntEngineNewPayload and ListIntEngineNewPayloadRequest

fix(proto): remove deprecated block_status field from int_engine_new_payload.proto
feat(proto): add new geo fields for autonomous system number & organization

feat(proto): add geo-location and autonomous system filters
Introduce new fields for client geo latitude, longitude, autonomous
system number and organization to enable geo-based filtering and
analysis.

fix(proto): remove deprecated block_status filter from ListIntEngineNewPayloadRequest

refactor(proto): remove block_status field from int_engine_new_payload

The block_status field is no longer needed as the enrichment source
changed from fct_block to fct_block_head, which does not provide
status information. This simplifies the schema and reduces storage
overhead.

test: add pectra test assertions for int_engine_new_payload
…w_payload_local

These settings were causing excessive merges and disk pressure.
Removing them lets ClickHouse use its defaults, which are more
conservative and better suited to the current ingestion load.
@mattevans mattevans merged commit 56d9a7d into master Dec 19, 2025
4 checks passed
@mattevans mattevans deleted the feat/int_engine_new_payload branch December 19, 2025 05:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants