Pauseless Consumption#14460

Closed

9aman wants to merge 31 commits intoapache:masterfrom

9aman:feature_pauseless

Commits on Nov 15, 2024

Adding major changes on the server and controller side to allow existing and pauseless flow

Aman Khanchandani
authored and
9aman
committed
Adding pauseless flag for commit end path:
9aman
committed
Resolving Checkstyle issues
9aman
committed
Adding pauseless to the stream config
9aman
committed
fixing a test case
9aman
committed
Adding checks to ensure the stream config is not null
9aman
committed
Adding support for legacy table configs
9aman
committed
Revert "Group commit IdealState updates (#13976)"
9aman
committed
synchronising calls for ideal state updates
9aman
committed
Setting a fixed time for the download to happen
9aman
committed
Fixing minor bug in timeout
9aman
committed
The changes prevent the server from trying indefinitely in case there is a controller failure.
9aman
committed
Fixing state machine issues that we encountered for lease extension during build
9aman
committed
Changes to allow extending RealtimeSegmentValidationManager and PinotLLC
9aman
committed
Introduce an API to upload and update the metadata for a failed segment
9aman
committed
Reverting changes to helix helper in order to use IdealState group commit
9aman
committed
Adding changes for group commit in base controller starter
9aman
committed
Minor linting issues
9aman
committed
reverting changes in PinotHelixResourceManager.java to allow group commit usage
9aman
committed
Removing changes that conflict with the group commit changes
9aman
committed
Minor additional reversals related to PinotHelixResourceManager
9aman
committed
reverting synchronization changes in PinotLLCRealtimeSegmentManager
9aman
committed
fixing minor issues in the code
9aman
committed
Improving the download logic a bit
9aman
committed
WIP: Fixing minor issues in the code
9aman
committed
Fixing issues in the PinotHelixResourcemanager
9aman
committed
Improving upload segment API to return segment ZK metadata instead of just download url
9aman
committed
Adding flags in table config to inject failures
9aman
committed
Adding support for pauselessConsumptionEnabled in TableConfigBuilder
9aman
committed
Reverting unncessary changes to the branch
9aman
committed
Reverting failure scenarios
9aman
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Pauseless Consumption#14460

Pauseless Consumption#14460
9aman wants to merge 31 commits intoapache:masterfrom
9aman:feature_pauseless

Commits on Nov 15, 2024

Adding major changes on the server and controller side to allow existing and pauseless flow

Adding pauseless flag for commit end path:

Resolving Checkstyle issues

Adding pauseless to the stream config

fixing a test case

Adding checks to ensure the stream config is not null

Adding support for legacy table configs

Revert "Group commit IdealState updates (#13976)"

synchronising calls for ideal state updates

Setting a fixed time for the download to happen

Fixing minor bug in timeout

The changes prevent the server from trying indefinitely in case there is a controller failure.

Fixing state machine issues that we encountered for lease extension during build

Changes to allow extending RealtimeSegmentValidationManager and PinotLLC

Introduce an API to upload and update the metadata for a failed segment

Reverting changes to helix helper in order to use IdealState group commit

Adding changes for group commit in base controller starter

Minor linting issues

reverting changes in PinotHelixResourceManager.java to allow group commit usage

Removing changes that conflict with the group commit changes

Minor additional reversals related to PinotHelixResourceManager

reverting synchronization changes in PinotLLCRealtimeSegmentManager

fixing minor issues in the code

Improving the download logic a bit

WIP: Fixing minor issues in the code

Fixing issues in the PinotHelixResourcemanager

Improving upload segment API to return segment ZK metadata instead of just download url

Adding flags in table config to inject failures

Adding support for pauselessConsumptionEnabled in TableConfigBuilder

Reverting unncessary changes to the branch

Reverting failure scenarios