[Feature] Add Redis Scheduler #1343
Conversation
There was a problem hiding this comment.
Reviewable status: 0 of 1 LGTMs obtained, and 0 of 18 files reviewed, and pending CI: Analyze (javascript-typescript), Analyze (python), Bazel Dev / ubuntu-22.04, Cargo Dev / macos-13, Cargo Dev / ubuntu-22.04, Docs Deployment / macos-14, Docs Deployment / ubuntu-24.04, Installation / macos-13, Installation / macos-14, Installation / ubuntu-22.04, Local / ubuntu-22.04, NativeLink.com Cloud / Remote Cache (Legacy Dockerfile Test), Publish image, Publish nativelink-worker-init, Publish nativelink-worker-lre-cc, Remote / large-ubuntu-22.04, asan / ubuntu-22.04, docker-compose-compiles-nativelink (22.04), integration-tests (22.04), macos-13, pre-commit-checks, ubuntu-20.04 / stable, ubuntu-22.04, ubuntu-22.04 / stable, vale, windows-2022 / stable (waiting on @adam-singer)
Adds an experimental redis scheduler that can be used as a distributed state-persistent scheduler backend. This scheduler is optimized to have each worker be its own scheduler or many small schedulers. closes: TraceMachina#359
allada
force-pushed
the
new-redis-scheduler
branch
from
b6f7905
to
3917a90
Compare
There was a problem hiding this comment.
Reviewed 19 of 19 files at r1, all commit messages.
Reviewable status:complete! 1 of 1 LGTMs obtained, and all files reviewed
Adds an experimental redis scheduler that can be used as a distributed state-persistent scheduler backend. This scheduler is optimized to have each worker be its own scheduler or many small schedulers.
closes: #359
This change is