Understanding and application of 3D Face Reconstruction

PhD Thesis Proposal Defence


Title: "Understanding and application of 3D Face Reconstruction"

by

Mr. Jiaxiang SHANG


Abstract:

The understanding and application of 3D face reconstruction have been 
extensive research for decades due to its fundamental research status and 
wide range of applications. The understanding module includes face 
modeling, digital avatar construction, and 3D face geometry/texture 
reconstruction. The applications of 3D face reconstruction leverage 3D 
face information to assist 2D tasks i.e., face reenactment and facial 
expression recognition. In this thesis, we aim to perform 3D face 
reconstruction under avatars or personalized face models. Moreover, we 
utilize such robust 3D information to guide 2D face tasks.

Specifically, we first propose an avatar digitization method that pursues 
high-quality identity preservation and vivid expression animations, which 
can further participate in constructing a 3D Morphable Model (3DMM). 
Secondly, considering the 3DMM as a face prior, we propose a 
self-supervised training architecture (MGCNet) for monocular 3D face 
reconstruction by the multi-view geometry consistency. The results of this 
robust face reconstruction model can benefit face reenactment. Therefore, 
thirdly, we design a controllable face reenactment network (REENet) 
leveraging the results of MGCNet as guidance. Besides, the REENet can 
generate 3DMM-image pairs, which provide large expression and pose cases 
to improve the self-supervised training strategy for face 
reconstruction. Finally, we leverage the 3D information to construct a 
facial expression recognition network (3D-FERNet), where the 3D 
information help to improve the recognition results.


Date:			Wednesday, 27 April 2022

Time:                  	4:00pm - 6:00pm

Zoom Meeting:
https://zoom.us/j/99902023973?pwd=ei9uVGNIODhhQzZ5ekc0ZnREendRUT09

Committee Members:	Prof. Long Quan (Supervisor)
  			Prof. Chiew-Lan Tai (Chairperson)
 			Dr. Xiaojuan Ma
 			Prof. Pedro Sander


**** ALL are Welcome ****