We did several works in this project, including:
- Based on videoavatar,which is the officially released source code of the paper “Video Based Reconstruction of 3D People Models”, the project did human body reconstruction.
- We implemented the "mesh subdivision" and "medium-level shape reconstruction" techniques proposed in the paper "Detailed human avatars from monocular video"(Detailed Avatars), achieving detailed reconstruction of human body.
- We built a version of videoavatar with supporting Python3.x, chumpyand [opendr are rewritten to support it.
- We developed a convenient model rendering and visualization tools, to get the final visualization results of video avatar with texture added.
We note that: although this README is written in English, many other texts in this project is written in Chinese, please feel free to contact us if you find anything hard to understand. Besides, some other features in "Detailed Avatar" are still to be implemented, we only realized the main two.
|-- Render: rendering tools
|-- snapshot:a demo based on one teammate\'s handsome selfie
|-- docs
|-- final_report:a conclusion report in Chinese
|-- Notes:other notes, nothing to do with the project
|-- code
|-- MLBSR: implementation of Medium-level Body-shape Reconstruction
|-- SSBM: implementation of Subdivided SMPL model
|-- Portable_py3.x:Python 3.x support of opendr and chumpy
|-- videoavatar:original videoavatar project files
With several simply obtained selfies, we can build the 3D body reconstruction as follows. We note that the camera parameters are important to produce reliable reconstruction.
We produce the face reconstruction w/ and w/o techniques proposed in the "Detailed Avatar" paper. The right faces in the following two images are produced with those techniques.
We produce the body reconstruction in a cloud point manner w/ and w/o techniques proposed in the "Detailed Avatar" paper. The comparison effect is remarkable.
Members of our team:Jinkun Cao、Yuqi Hu、Yuchen Luo、Nuo Chen、Erhu Feng. Thanks for their contributions, and especially for the selfies provided by handsome Erhu Feng
Note that this project is just a non-official attempt of implementing detailed-avatars, to refer this work, please cite the original publication.