Skip to content

Conversation

MurphyZhao04
Copy link
Collaborator

@MurphyZhao04 MurphyZhao04 commented Jun 15, 2025

This PR fixesthe RL infra bugs caused by multi-robots. The config files and wrappers for humanoidbench_rl and fast_td3 have been adjusted to account for this change. For now, only consider robots[0] in both environments to ensure training.

@Fisher-Wang Fisher-Wang merged commit edbcdf8 into main Jun 15, 2025
2 checks passed
@Fisher-Wang Fisher-Wang deleted the fix/rl-infra-multirobots-configs branch June 15, 2025 23:04
wyzhgxy added a commit that referenced this pull request Jun 16, 2025
…dex (#280)

* [pre-commit.ci] pre-commit autoupdate (#242)

* isaacgym multi-robot

* test_script

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] align with isaaclab multirobot and support shadow handover

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] h1 cfg joints num bug

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] isaacgym get_joint_names order (#250)

* [fix] isaaclab and isaacgym support tensorized action (#251)

* [bugfix] isaaclab scene don't autodownload (#257)

* [refactor] autodownload check hf exists when local not exists (#258)

* [refactor] autodownload use hf_api.file_exists instead of hf_fs.exists to speed up; fix comments (#259)

* [fix] roboverse_learn/eval.py use correct action format (#260)

* Bug/fix action interface (#256)

* [add] github issue template (#262)

* [add] isaaclab support segmentation output in camera state (#264)

* [add] feature to isaacgym that toggle sync viewer by press V (#217)

* [bugfix] camera state bug introduced in #264

* add skillblender:walking and rsl_rl wrapper (#218)

Co-authored-by: Feishi Wang <feishiwang2001@gmail.com>

* Update README.md

* update readme

* update readme

* update readme

* update readme

* update readme

* [fix] isaaclab states not update (#265)

* [update] no default camera

* Reorganize doc (#266)

* [fix] change traj path

* [feature] add FastTD3 with config management and MJX support (#243)

* [doc] add skillblender_rl.md back (#270)

* [doc] add skillblender back (#271)

Co-authored-by: Di Fan <difan@Dis-MacBook-Pro.local>

* [add] isaacgym support  contact sensor

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [add] add dof force to states, supported by isaacgym

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] import sensor state

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [add,fix] add skillblender reaching and h1_wrist_cfg; fix isaacgym (#275)

Signed-off-by: weisonweileen <weisonweileen@gmail.com>
Co-authored-by: Feishi Wang <feishiwang2001@gmail.com>
Co-authored-by: geng-haoran <ghr@berkeley.edu>

* [update] github bug report template

* [fix] IsaacGym quaternion bugs (#277)

* fix isaacgym tensor regresh issue (#278)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* update state_consistency test code, delete isaacgym simulate. update xyzw_to_wxyz code with indexing to avoid latency

* [fix] bugs for RL infra and configs caused by multirobots (#279)

---------

Signed-off-by: weisonweileen <weisonweileen@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Fisher Wang <feishiwang2001@gmail.com>
Co-authored-by: weison_pan <124496507+WeisonWEileen@users.noreply.github.com>
Co-authored-by: Haoran Geng <71596067+geng-haoran@users.noreply.github.com>
Co-authored-by: geng-haoran <ghr@berkeley.edu>
Co-authored-by: Gu Song En <45731193+gusongen@users.noreply.github.com>
Co-authored-by: difan1995 <140031348+difan1995@users.noreply.github.com>
Co-authored-by: Murphy <167211955+MurphyZhao04@users.noreply.github.com>
Co-authored-by: Di Fan <difan@Dis-MacBook-Pro.local>
boli919 pushed a commit to boli919/RoboVerse that referenced this pull request Jul 20, 2025
WeisonWEileen added a commit that referenced this pull request Aug 15, 2025
…dex (#280)

* [pre-commit.ci] pre-commit autoupdate (#242)

* isaacgym multi-robot

* test_script

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] align with isaaclab multirobot and support shadow handover

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] h1 cfg joints num bug

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] isaacgym get_joint_names order (#250)

* [fix] isaaclab and isaacgym support tensorized action (#251)

* [bugfix] isaaclab scene don't autodownload (#257)

* [refactor] autodownload check hf exists when local not exists (#258)

* [refactor] autodownload use hf_api.file_exists instead of hf_fs.exists to speed up; fix comments (#259)

* [fix] roboverse_learn/eval.py use correct action format (#260)

* Bug/fix action interface (#256)

* [add] github issue template (#262)

* [add] isaaclab support segmentation output in camera state (#264)

* [add] feature to isaacgym that toggle sync viewer by press V (#217)

* [bugfix] camera state bug introduced in #264

* add skillblender:walking and rsl_rl wrapper (#218)

Co-authored-by: Feishi Wang <feishiwang2001@gmail.com>

* Update README.md

* update readme

* update readme

* update readme

* update readme

* update readme

* [fix] isaaclab states not update (#265)

* [update] no default camera

* Reorganize doc (#266)

* [fix] change traj path

* [feature] add FastTD3 with config management and MJX support (#243)

* [doc] add skillblender_rl.md back (#270)

* [doc] add skillblender back (#271)

Co-authored-by: Di Fan <difan@Dis-MacBook-Pro.local>

* [add] isaacgym support  contact sensor

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [add] add dof force to states, supported by isaacgym

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] import sensor state

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [add,fix] add skillblender reaching and h1_wrist_cfg; fix isaacgym (#275)

Signed-off-by: weisonweileen <weisonweileen@gmail.com>
Co-authored-by: Feishi Wang <feishiwang2001@gmail.com>
Co-authored-by: geng-haoran <ghr@berkeley.edu>

* [update] github bug report template

* [fix] IsaacGym quaternion bugs (#277)

* fix isaacgym tensor regresh issue (#278)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* update state_consistency test code, delete isaacgym simulate. update xyzw_to_wxyz code with indexing to avoid latency

* [fix] bugs for RL infra and configs caused by multirobots (#279)

---------

Signed-off-by: weisonweileen <weisonweileen@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Fisher Wang <feishiwang2001@gmail.com>
Co-authored-by: weison_pan <124496507+WeisonWEileen@users.noreply.github.com>
Co-authored-by: Haoran Geng <71596067+geng-haoran@users.noreply.github.com>
Co-authored-by: geng-haoran <ghr@berkeley.edu>
Co-authored-by: Gu Song En <45731193+gusongen@users.noreply.github.com>
Co-authored-by: difan1995 <140031348+difan1995@users.noreply.github.com>
Co-authored-by: Murphy <167211955+MurphyZhao04@users.noreply.github.com>
Co-authored-by: Di Fan <difan@Dis-MacBook-Pro.local>
cheolhong0916 pushed a commit to cheolhong0916/RoboVerse that referenced this pull request Aug 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants