Skip to content

A toolkit that simplifies Isaac Sim and Isaac ROS development

License

Notifications You must be signed in to change notification settings

isaac-powerpack/pow

Repository files navigation

✨ Isaac Powerpack’s goal is to provide a toolkit that simplifies Isaac ROS development on NVIDIA Jetson boards.

Key features include:

  • 🪻 Foxglove Studio extensions — for visualizing and debugging Isaac ROS data
  • 🛠️ CLI tools — to streamline Isaac ROS and Isaac Sim project setup and management

🚧 This project is in early development. Features and APIs are still evolving and subject to breaking changes.

🙋 We’ll open this project for contributions soon.

Read the Docs to Learn More

Features & Milestones

v0.1.0 (🏃 In Progress)
  • Detection2D Module

    • Detection2D panel with image display
    • Detection2DArrayImageAnnotations conversion
    • 2D bounding box visualization
    • Configurable object labels and IDs via Foxglove variables
    • Object ID, confidence, and label display
  • CLI

    • Install Isaac Sim local assets (sim add local-assets, v5.1.0)
    • Isaac Sim commands: sim init, sim run for simplified setup workflows
    • Isaac ROS commands: ros init, ros run, ros build for streamlined Docker workflows
  • Teleop Module

    • Developed a keyboard control panel to publish geometry_msgs/Twist messages for 6-DOF movement.
v0.2.0
  • Detection3D Module

    • Detection3D panel for 3D pose and bounding box visualization
    • Detection3DArray support with configurable labels, IDs, and confidence
    • Interactive object inspection (pose, distance, metadata) with camera mesh and pose axes rendering
    • Support visualization for Isaac ROS pose estimation packages (CenterPose, DOPE, FoundationPose)

    Remaining v0.2.0 features will be added soon in upcoming sprints

Future Ideas
  • Jetson Stat Module: Create a Foxglove panel to monitor Jetson device statistics
  • create-isaac: A starter project template generator for developing Isaac ROS and Isaac Sim applications.
  • Implement Joystick support in Teleop Module (pow: Teleop) support Logitech F710 Gamepad and PS5 DualSense Wireless Controller

Usage

Pow CLI

Pow CLI usage can be found in the example repository pow-orin-starter.

Isaac Powerpack Foxglove

Installation

  1. Install the Foxglove Studio desktop app from the Foxglove Studio download page.

  2. Follow the instructions in the Easy installation section of this blog post, extending-px4-support, and choose the isaac-powerpack package to install the Isaac Powerpack Foxglove extensions instead of PX4 Converter.

Foxglove Feature Mapping

The following table maps standard Robotic tasks to our corresponding Isaac Powerpack Foxglove features:

Tasks Isaac Powerpack Foxglove Panel
Object Detection pow: Detection 2D
6-DOF Twist Teleop pow: Teleop

Support Matrix

Platform Version / Validation
Device ✅ Jetson AGX Orin 32 GB — Tested
⏳ Jetson Orin Nano 8 GB — Pending Test
Isaac ROS Version release-3.2
Isaac Sim 5.1.0
OS Ubuntu 22.04

💡 Notes

  • This project is actively developed and tested with Isaac ROS version release-3.2 on the NVIDIA Jetson AGX Orin 32GB.
  • The Jetson Orin Nano 8GB (also known as the Jetson Nano Super Developer Kit) is scheduled for upcoming testing.
  • Pow CLI, Isaac Sim extension is tested on Ubuntu 22.04.

Contribution

See Contribution Guide

License

Apache-2.0.

About

A toolkit that simplifies Isaac Sim and Isaac ROS development

Resources

License

Contributing

Stars

Watchers

Forks

Packages