Multi-GPU FSDP Support#175

Open

humaira-rf wants to merge 51 commits intomainfrom

feature/multi-gpu

Commits on Sep 26, 2025

Scheduler: update to new scheduler that uses Monte Carlo simulations, update test cases
pradyumna-rfai
committed
Scheduler: updated scemantics to schedule runs by min chunks-visited, renamed terms
pradyumna-rfai
committed
Db: updated db to include req_workers, estimated_runtime in runs table
pradyumna-rfai
committed
AutoML: update linting
pradyumna-rfai
committed
AutoML: add num_gpus in model_config
pradyumna-rfai
committed
Db: add set_estimated_runtime func
pradyumna-rfai
committed
Scheduler: expose monto carlo simulations as a param in experiment run_fit
pradyumna-rfai
committed
Db: add multi_worker_details as a field in Worker task table
pradyumna-rfai
committed

Commits on Sep 27, 2025

Controller, Worker: update run_fit logic for multi-node training in Controller and Worker
pradyumna-rfai
committed
Scheduler: modify scheduler to be fair round robin with Monte Carlo
pradyumna-rfai
committed
fsdp initial changes

humaira-rf
authored and
pradyumna-rfai
committed
full model fixes

humaira-rf
authored and
pradyumna-rfai
committed
fixed gpu ids

humaira-rf
authored and
pradyumna-rfai
committed
notebook params

humaira-rf
authored and
pradyumna-rfai
committed
notebooks for qlora

humaira-rf
authored and
pradyumna-rfai
committed
error handling

humaira-rf
authored and
pradyumna-rfai
committed
Revert "error handling"

humaira-rf
authored and
pradyumna-rfai
committed
full model changes

humaira-rf
authored and
pradyumna-rfai
committed
Updated warm_started_from to warm_started (bool)
pradyumna-rfai
committed
Controller: minor fixes from rebase
pradyumna-rfai
committed
Scheduler: restored scheduler from before rebase
pradyumna-rfai
committed
Scheduler: removed start_chunk_id from scheduler
pradyumna-rfai
committed
Scheduler: updated minor comment
pradyumna-rfai
committed
Worker: fixed runtime code, minor updates
pradyumna-rfai
committed
Misc: dist_utils formatting changes
pradyumna-rfai
committed
Scheduler: minor changes to scheduler, added tests
pradyumna-rfai
committed

Commits on Oct 1, 2025

Commits on Oct 2, 2025

Commits on Oct 3, 2025

Commits on Jan 29, 2026

temp changes to multi-gpu
humaira-rf
committed

Commits on Feb 2, 2026

Commits on Feb 3, 2026

scheduler fixes for single gpu
humaira-rf
committed

Commits on Feb 4, 2026

Commits on Feb 6, 2026

Commits on Feb 10, 2026

notebooks updated
humaira-rf
committed