-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Fix warnings when running AutoMate env #3660
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Test Results Summary2 547 tests 2 085 ✅ 2h 27m 12s ⏱️ For more details on these failures and errors, see this check. Results for commit 5d1ee06. |
gamma = torch.tensor([gamma], dtype=torch.float, device="cuda") | ||
bandwidth = torch.tensor([bandwidth], dtype=torch.float, device="cuda") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this using "cuda" and not the dev itself? Not sure if this will work nicely on multi-gpu setup?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We did not run AutoMate env with multi-gpu setting. Could you please suggest how to change device='cuda' for multi-gpu setting? Any example of this?
bash_command = "NUMBA_CUDA_LOW_OCCUPANCY_WARNINGS=0 isaaclab.bat -p" | ||
elif sys.platform.startswith("linux"): | ||
bash_command = "./isaaclab.sh -p" | ||
bash_command = "NUMBA_CUDA_LOW_OCCUPANCY_WARNINGS=0 ./isaaclab.sh -p" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What does the NUMBA_CUDA_LOW_OCCUPANCY_WARNINGS
do here specifically? Could you add a comment in the code if it needed for something specific?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This line is a easy fix for the reported warning "/colossus/isaaclab/venv_sim_pip_lab_src/lib/python3.11/site-packages/numba/cuda/dispatcher.py:536: NumbaPerformanceWarning: Grid size 1 will likely result in GPU under-utilization due to low occupancy.
warn(NumbaPerformanceWarning(msg))
[2025-07-23 22:33:10,045][numba.cuda.cudadrv.driver][INFO] - init
/colossus/isaaclab/venv_sim_pip_lab_src/lib/python3.11/site-packages/numba/cuda/dispatcher.py:536: NumbaPerformanceWarning: Grid size 1 will likely result in GPU under-utilization due to low occupancy.
warn(NumbaPerformanceWarning(msg))".
Description
Type of change
Checklist
pre-commit
checks with./isaaclab.sh --format
config/extension.toml
fileCONTRIBUTORS.md
or my name already exists there