Roadmap of MMPose

[hellock]

We keep this issue open to collect feature requests from users and hear your voice. Our monthly release plan is also available here.

You can either:

1. Suggest a new feature by leaving a comment.
2. Vote for a feature request with 👍 or be against with 👎. (Remember that developers are busy and cannot respond to all feature requests, so vote for your most favorable one!)
3. Tell us that you would like to help implement one of the features in the list or review the PRs. (This is the greatest things to hear about!)

[aa12356jm]

i hope that MMPose can support 21 hand landmark detetion, thanks

[jin-s13]

i hope that MMPose can support 21 hand landmark detetion, thanks

Good suggestions! We will add this feature in our TODO list. Thank you.

[jin-s13]

TODO List (continuously updated... [last edit: 2023.1.14]) :
Here is a collection of feature requests.
Items that have already been implemented in MMPose will be removed from the list.

1. More popular backbones

• ConvNeXt

2. Add more popular datasets:

• LSP
• MPII test set
• MPII multi-person dataset for bottom-up methods
• FashionAI
• DeepFashion2
• 3dpw
• MuCo-3DHP

3. More 2d human pose estimation method.

• CPN
• OpenPose [Feature] Paf detector #651
• PifPaf
• ZoomNet
• OPEC-Net
• CenterNet
• MoveNet
• MIPNet
• ViTPose [Feature] Support ViTPose #1876

4. More 2d face alignment algorithms.

5. More 3d human pose algorithms.

• DecoMR
• PoseFormer [Feature] Add PoseFormer backbone #1215
• C2F [Feature] C2F dataset part #868 [Feature] C2F train part #975
• SmoothNet training codes and models trained on 3DPW and AIST.
• PoseAug

6. Support 2d video pose estimation and tracking

• Penn Action
• LSTM Pose Machine
• DetTrack
• KeyTrack
• DCPose Are you planing to add DCPose with Darkpose? #759
• Skip-Convolultion Skip-Convolution Processing #836

7. Support Vehicle pose estimation

• CarFusion dataset
• Occlusion-net
• Apollocar3D

8. Add 3D Pose Consistency Benchmark Documentation: Add 3D Pose Consistency Benchmark #828

9. Mano based hand keypoints detection

10. Depth-based 3d hand pose estimation

• A2J

11. Multi-view 3d pose estimation

• Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images
• 3DMPPE PoseNet Add 3DMPPE POSENET #964
• Learnable Triangulation of Human Pose Multi-view 3d pose estimation #864
• Epipolar Transformers Multi-view 3d pose estimation #864
• Cross view fusion for 3d human pose estimation Multi-view 3d pose estimation #864

12. Support memonger

13. Support Pytorch AMP training Regarding multi-gpu training #339

14. Hyperparameter tuner Optuna

15. Support Unity plugin

16. print loss during evaluation. No log INFO show on terminal when training? #333

17. Quantization Aware Training Quantization Aware Training #359

18. Easier Usage (API)

19. Export to Torchscript How to export the model to torchscript？ #576

[gachiemchiep]

Would you mind add #31 (comment) to the TODO list.

[jin-s13]

Would you mind add #31 (comment) to the TODO list.

Sure.

[innerlee]

Speed up inference #40

[jin-s13]

Support video pose estimation #67

[pablovela5620]

Would be great to add support for whole body pose estimation dataset (body+face+hands) via COCO-WholeBody

[lisa676]

Also add support for MPII in mmdetection.