All pull requests

Pull requests

• [CELEBORN-XXXX] Fix memory leak of committedFileInfos when graceful shutdown is disabled

  correctnessmodule:worker
  #3860·SoulKyu opened Oct 5, 2026·1 of 2 tasks·

  ·
  3

• [CELEBORN-XXXX] Skip memory file storage for replica partitions

  kind:documentationmodule:commonmodule:worker
  #3859·venkata91 opened Sep 29, 2026·1 of 2 tasks·

  ·

• [CELEBORN-2469] Add worker stats collection and reporting for autoscaling

  kind:documentationmodule:commonmodule:mastermodule:worker
  #3858·Kalvin2077 opened Sep 24, 2026Contributor·1 of 2 tasks·

  ·
  4

• [CELEBORN-2468] Support pluggable transport authentication and authorization

  correctnesskind:documentationmodule:clientmodule:commonmodule:flinkmodule:mastermodule:worker
  #3857·Kalvin2077 opened Sep 23, 2026Contributor·2 tasks done·

  ·
  15

• [CELEBORN-2470] Add backoff with jitter to push retries and log hard split once per file

  kind:documentationmodule:clientmodule:commonmodule:worker
  #3856·venkata91 opened Sep 20, 2026·

  ·
  8

• [CELEBORN-2466] Support per-zone worker StatefulSets and autoscaling in the Helm chart

  kind:deploy
  #3855·strelok89 opened Sep 17, 2026Contributor·1 of 2 tasks·

  ·
  20

• [CELEBORN-2464] Wire Kubernetes health probes into the Helm chart

  kind:deploystale
  #3854·strelok89 opened Sep 17, 2026Contributor·1 of 2 tasks·

  ·
  6

• [CELEBORN-2465][SPARK] Proactively unregister shuffles on SQL query completion

  kind:documentationmodule:clientmodule:commonmodule:sparkmodule:tests
  #3853·yew1eb opened Sep 17, 2026Contributor·

  ·
  16

• [CELEBORN-2463] Add ManuallyExcludedWorkerCount metric to distinguish manually excluded workers

  kind:documentationmodule:master
  #3848·yew1eb opened Sep 15, 2026Contributor·1 of 2 tasks·

  ·
  1

• [CELEBORN-2462][WORKER] Reduce misleading WARN/ERROR logs during decommission shutdown

  module:worker
  #3847·yew1eb opened Sep 14, 2026Contributor·2 tasks·

  ·
  2

• [CELEBORN-2460] Reply SHUFFLE_EXPIRED for a released shuffle instead of an empty file group

  correctnessmodule:clientmodule:commonmodule:tests
  #3845·shlomitubul opened Sep 10, 2026Contributor·1 of 2 tasks·

  ·
  11

• [CELEBORN-2459] Fix race causing DataPusher to accept data during termination and drop it

  correctnessmodule:clientstale
  #3844·rjvkr2021 opened Sep 9, 2026·1 task done·

  ·
  18

• [CELEBORN-2457][CIP-24] Adaptive partition write parallelism

  kind:documentationmodule:clientmodule:commonmodule:testsmodule:worker
  #3843·yew1eb opened Sep 8, 2026Contributor·1 of 2 tasks·

  ·
  1

• [CELEBORN-2458] Invalidate transport client after push timeout

  module:commonmodule:testsmodule:workerstale
  #3842·venkata91 opened Sep 7, 2026·

  ·
  11

• [CELEBORN-2451] Make DRA safe under AUTO fallback by tying supportsReliableStorage to fallback policy

  correctnesskind:documentationmodule:clientmodule:spark
  #3834·venkata91 opened Aug 31, 2026·2 tasks done·

  ·
  14

• [CELEBORN-2445] Support overriding decommission forceExitTimeout via the worker exit API

  kind:documentationmodule:climodule:openapimodule:servicemodule:worker
  #3828·cxzl25 opened Aug 26, 2026Contributor·2 tasks·

  ·
  18

• [CELEBORN-2429][CIP-23] Batch worker/application heartbeats into aggregated raft log entries

  kind:documentationmodule:commonmodule:master
  #3810·yew1eb opened Aug 19, 2026Contributor·2 tasks·

  ·
  9

• [CELEBORN-2403] Add worker metrics for disk status and unhealthy disk count

  kind:deploykind:documentationmodule:worker
  #3782·yew1eb opened Aug 4, 2026Contributor·1 of 2 tasks·

  ·
  7

• [CELEBORN-2391] Eliminate intermediate byte[] allocation in Encoders.Strings via Netty ByteBufUtil

  kind:buildmodule:common
  #3769·yew1eb opened Jul 26, 2026Contributor·

  ·
  15

• [CELEBORN-2388] Decouple inter-master Ratis TLS into its own SSL module

  module:commonmodule:master
  #3767·shellfish007 opened Jul 23, 2026·

  ·
  9

• [CELEBORN-2389] Track S3 resource consumption in per-app/per-user metrics

  module:commonmodule:mastermodule:worker
  #3766·shellfish007 opened Jul 23, 2026·

  ·
  3

• [CELEBORN-2387] Add ReserveSlotsFailCount worker metric

  module:worker
  #3765·shellfish007 opened Jul 23, 2026·

  ·
  6

• [CELEBORN-2386] Pass peer hostname to SSLEngine for SNI support

  module:common
  #3764·shellfish007 opened Jul 23, 2026·

  ·
  4

• [CELEBORN-194] Introduce client side metrics for celeborn

  kind:deploykind:documentationmodule:clientmodule:commonmodule:master
  #3740·AmandeepSingh285 opened Jun 15, 2026Contributor·2 tasks·

  ·
  93

• [CIP-14][CELEBORN-2220] Support Slow Start Push in C++ Client

  module:cpp
  #3730·afterincomparableyum opened Jun 12, 2026Contributor·2 tasks·

  ·
  9