Revert "[RLlib] Add option for APPO/IMPALA to change number of GPU-lo…#50063

Draft

jjyao wants to merge 2 commits intoray-project:masterfrom jjyao:jjyao/lllleak

+18-12

Commits on Feb 6, 2025

Revert "[RLlib] Old API stack IMPALA/APPO: Re-introduce mixin-replay-buffer pass, even if replay-ratio=0 (fixes a memory leak). (ray-project#49964 )"
jjyao
committed
fix
jjyao
committed