Skip to content

Per-originating-node transaction log partitioning (dependent on new transaction log format) #192

Description

@kriszyp

Maintain a per-originating-node-id partition within the transaction log, so replicated writes from node A and writes originating on the local node are tracked in separate sequences.

Why

  • Per-node transaction logs enable efficient selective catch-up: a new or restarting node can request only the transactions it missed from a specific origin, rather than scanning a global log.
  • Conflict detection and resolution can be scoped to per-node streams.
  • Per-node audit trails are cleaner for debugging replication issues.

Design note (from Jira)

"This may only be feasible in our new transaction log system with rocksdb-js."

This is gated on the new transaction log format being built in CORE-2992 ("Create new transaction entry format"). File this to be scheduled once that lands.

Acceptance criteria (once gate is met)

  • Each replication transaction carries its originating node ID.
  • The transaction log can be queried/iterated per-origin node.
  • cluster_status / replication sync check can use per-node log position.

Status

Not Ready — dependent on CORE-2992 completing.


Jira fields: Feature Type: Tech Debt · Business Impact: Operational efficiency (both suggested)

🤖 Filed by Claude on behalf of Kris.

Activity

  1. added
    enhancementNew feature or request
    area:replicationReplication, cluster sync, peer connections
    from-jiraMigrated or originated from a Jira ticket
    on May 21, 2026
  2. modified the milestone: v5.2 on May 21, 2026
  3. kriszyp commented on Jul 7, 2026

    @kriszyp
    MemberAuthor

    Appears to be a duplicate of / consolidate under #434 — per-origin txn-log partitioning — folded into replication epic W4.

    — Claude (Opus 4.8), issue-backlog triage

  4. added
    duplicateThis issue or pull request already exists
    on Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:replicationReplication, cluster sync, peer connectionsduplicateThis issue or pull request already existsenhancementNew feature or requestfrom-jiraMigrated or originated from a Jira ticket

    Type

    No type

    Fields

    Priority

    P2

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions