RL Base Classes - PPO SB3 based classes; non-camera, loading and saving model for our parent classes;#12

Open

Luxaris wants to merge 15 commits intomainfrom

prnv/rl-base-classes

Commits on Jan 17, 2026

Defining the holding folders
Luxaris
committed

Commits on Jan 18, 2026

Added some of the structure of this base classes. Need to add some envs.
Pranav Rajesh Krishnan
committed
Defined a bunch of agents, adapters, core programs, envs and scripts. Need heavy modifications though
Pranav Rajesh Krishnan
committed

Commits on Jan 26, 2026

PPO Agent added! Base classes added in rl_agent in rl_autonomy. Also defined module for Gymnasium env wrapping. Also have a zip with a trained model. Camera needs some work now.
Luxaris
committed

Commits on Feb 1, 2026

Commits on Feb 3, 2026

Docker for windows is complete. README tells how to use it
Pranav Rajesh Krishnan
committed
evaluate_render.py includes a method on how to render it using VcXsrv
Pranav Rajesh Krishnan
committed
Current models updated for Windows Docker code
Pranav Rajesh Krishnan
committed

Commits on Feb 6, 2026

Buncha changes committed before fixing RoboSuite submodule.
Pranav Rajesh Krishnan
committed
Added updates to render so that the new robot is loaded, and just merging Docker branch's version of this file. Also added sac_train and corresponding trained model! Also updated just sac_train so …
Pranav Rajesh Krishnan
committed
Sample model trained in the zip file
Pranav Rajesh Krishnan
committed

Commits on Feb 7, 2026

Some changes
Pranav Rajesh Krishnan
committed

Commits on Feb 8, 2026

Updated SAC python to be an IPYNB file with all the code with comments for better readability
Pranav Rajesh Krishnan
committed
Adding the actual files that are NOT TO BE MERGED later on
Pranav Rajesh Krishnan
committed