Comotion - keypoints coordinates

[sarkadava]

Dear comotion developers,

great tool, the body animation looks really promising! I was wondering whether there is a way how to extract keypoint coordinates from your pipeline? I am sure there is, but I am moderately advanced coder so it is not so straightforward for me!

Thanks for any guidance/help

[anewell]

Hi,

To decode the keypoint coordinates you can do the following with the predicted SMPL parameters:

from comotion_demo.utils import helper, smpl_kinematics

smpl_decoder = smpl_kinematics.SMPLKinematics()

# Get SMPL joint coordinates in 3D
pred_3d = smpl_decoder(betas, pose, trans)

# Project those coordinates to 2D pixel space
pred_2d = helper.project_to_2d(K, pred_3d)

(K is the intrinsics matrix defining how points are projected to the image this is calculated in the dataloading utils)

Hope that's a helpful starting place!