Skip to content

HIVE-29450: Iceberg: Multi-table, multi-statement txn support#6310

Open
deniskuzZ wants to merge 4 commits intoapache:masterfrom
deniskuzZ:multi-table_multi_statement_txn_support
Open

HIVE-29450: Iceberg: Multi-table, multi-statement txn support#6310
deniskuzZ wants to merge 4 commits intoapache:masterfrom
deniskuzZ:multi-table_multi_statement_txn_support

Conversation

@deniskuzZ
Copy link
Member

@deniskuzZ deniskuzZ commented Feb 9, 2026

What changes were proposed in this pull request?

The commit introduces an atomic multi-table commit path for Iceberg tables through HMS. The flow:

  1. HiveIcebergOutputCommitter stages Iceberg snapshots via HiveTxnCoordinator instead of committing individually
  2. HiveTxnCoordinator.commit() gathers all staged metadata, acquires locks, and performs a single updateTableParams RPC
  3. A new thrift endpoint update_table_params atomically updates params for multiple tables with CAS (compare-and-swap) semantics
  4. DbTxnManager is extended with a pluggable TxnCoordinator abstraction

Why are the changes needed?

Enables multi-table, multi-statement transactions support

Does this PR introduce any user-facing change?

No

How was this patch tested?

mvn test -Dtest=TestIcebergCliDriver -Dqfile=iceberg_multi_table_txn.q

@deniskuzZ deniskuzZ force-pushed the multi-table_multi_statement_txn_support branch from 2341278 to 7b1a732 Compare February 9, 2026 21:53
@deniskuzZ deniskuzZ marked this pull request as draft February 9, 2026 21:57
@deniskuzZ deniskuzZ changed the title [DRAFT] Iceberg: Multi-table, multi-statement txn support [WIP] Iceberg: Multi-table, multi-statement txn support Feb 9, 2026
@deniskuzZ deniskuzZ changed the title [WIP] Iceberg: Multi-table, multi-statement txn support [WIP] HIVE-29450: Iceberg: Multi-table, multi-statement txn support Feb 9, 2026
@deniskuzZ deniskuzZ force-pushed the multi-table_multi_statement_txn_support branch from 7b1a732 to a529120 Compare February 11, 2026 19:46
@deniskuzZ deniskuzZ force-pushed the multi-table_multi_statement_txn_support branch 8 times, most recently from 270b905 to e892e6e Compare February 11, 2026 21:07
@deniskuzZ deniskuzZ force-pushed the multi-table_multi_statement_txn_support branch from e892e6e to f3dd6b3 Compare February 12, 2026 20:32
@sonarqubecloud
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants