If you just want to run the completed project in order to collect your training and validation data this section can help do it.
To learn how to build something like this from scratch, see Part 1 and Part 2 of our tutorial.
Table of Contents
To follow this tutorial you need to clone this repository even if you want to create your Unity project from scratch.
- Open a terminal and navigate to the folder where you want to host the repository.
git clone --recurse-submodules https://github.com/Unity-Technologies/Object-Pose-Estimation.git
-
Open the completed project. To do so, open Unity Hub, click the
Add
button, and selectPoseEstimationDemoProject
from the rootObject-Pose-Estimation
folder.
-
Once the project is opened, in the Project tab, go to
Assets > Scenes
and double click onTutorialPoseEstimation
to open the Scene created for this tutorial. -
We now need to set the size of the images used. In the Game view, click on the dropdown menu in front of
Display 1
. Then, click + to create a new preset. Make sureType
is set toFixed Resolution
. SetWidth
to650
andHeight
to400
. The gif below depicts these actions.
The completed project is set up for inference mode by default, so we must switch it to data collection mode.
-
Uncheck the
ROSObjects
GameObject in the Hierarchy tab to disable it. -
On the
Simulation Scenario
GameObject, make sure thatPose Estimation Scenario
is enabled, and that itsAutomatic Iteration
property is checked. -
On the
Main Camera
GameObject, check thePerception Camera (Script)
component to enable it.
To get started with the data collection, follow the instructions in Part 3: Collect the Training and Validation Data of the tutorial. This section will explain how to set the a random seed for the environment, choose how many training data examples you'd like to collect, and get things running.
If you'd like to move on to training a pose estimation model on the data you've collected, navigate to Part 3: Train the Deep Learning Model.
Have fun!