Question: Fitting a 2D face image onto a 3D model #124
Description
Is it possible to fit a 2D face image or a custom 3D face model without morphing the 3D model using face keypoints?
The process would be given a 2D face image and a custom 3D face mesh
1 - detect face landmarks on 2D image
2 - identify corresponding face landmarks on 3D face mesh (land marks can be pre-annotated)
3 - deform/transform the 2D face image to aling the land marks location
4 - use the transformed image as texture for 3D face
5 - project the 3D face to 2D
While doing this retain realism and expressions of the 2D face?