Jo, Jaeik Choi, Heeseung Kim, Ig-Jae Kim, Jaihie 2024-01-20T08:02:52Z 2024-01-20T08:02:52Z 2021-09-05 2015-01 0031-3203 https://pubs.kist.re.kr/handle/201004/125942 The 3D Morphable Model (3DMM) and the Structure from Motion (SfM) methods are widely used for 3D facial reconstruction from 2D single-view or multiple-view images. However, model-based methods suffer from disadvantages such as high computational costs and vulnerability to local minima and head pose variations. The SfM-based methods require multiple facial images in various poses. To overcome these disadvantages, we propose a single-view-based 3D facial reconstruction method that is person-specific and robust to pose variations. Our proposed method combines the simplified 3DMM and the SfM methods. First, 2D initial frontal Facial Feature Points (FFPs) are estimated from a preliminary 3D facial image that is reconstructed by the simplified 3DMM. Second, a bilateral symmetric facial image and its corresponding FFPs are obtained from the original side-view image and corresponding FFPs by using the mirroring technique. Finally, a more accurate the 3D facial shape is reconstructed by the SfM using the frontal, original, and bilateral symmetric FFPs. We evaluated the proposed method using facial images in 35 different poses. The reconstructed facial images and the ground-truth 3D facial shapes obtained from the scanner were compared. The proposed method proved more robust to pose variations than 3DMM. The average 3D Root Mean Square Error (RMSE) between the reconstructed and ground-truth 3D faces was less than 2.6 mm when 2D FFPs were manually annotated, and less than 3.5 mm when automatically annotated. (C) 2014 Elsevier Ltd. All rights reserved. English ELSEVIER SCI LTD FACE RECONSTRUCTION RECOGNITION MODEL SHAPE IMAGE FACTORIZATION LOCALIZATION MOTION Single-view-based 3D facial reconstruction method robust against pose variations Article 10.1016/j.patcog.2014.07.013 1 PATTERN RECOGNITION, v.48, no.1, pp.73 - 85 PATTERN RECOGNITION 48 1 73 85 scie scopus 000344204000007 2-s2.0-84908048668 Computer Science, Artificial Intelligence Engineering, Electrical & Electronic Computer Science Engineering Article FACE RECONSTRUCTION RECOGNITION MODEL SHAPE IMAGE FACTORIZATION LOCALIZATION MOTION 3D facial reconstruction Structure from motion Morphable model Single view Self-occlusion 3D model fitting