3D Morphable Models for Face Surface Analysis and Recognition

This chapter presents an automatic and efficient method to fit a statistical deformation model of the human face to 3D scan data. For a 3D face recognition system based on model coefficients, it is of utmost importance that the statistics of many realistic faces are captured in the morphable model. By applying and comparing different face-matching methods, the chapter discusses a complete 3D face recognition system with high recognition rates for the three data sets. It also presents a bootstrapping algorithm on the basis of an initial statistical model, which automatically fits to new scan data with noise and holes, and which is capable of measuring the redundancy of new example faces. The chapter concludes with a discussion on 3D face matching.

Controlled Vocabulary Terms

bootstrapping; image matching; three-dimensional displays

References

Amberg B, Knothe R, Vetter T. Expression invariant 3D face recognition with a morphable model automatic face and gesture recognition. In: Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition (FGR'08); 2008 Sept 17–19, Amsterdam, The Netherlands. New York: IEEE. 2008. p. 1–7.
Google Scholar
Amberg B, Romdhani S, Vetter T. Optimal step nonrigid ICP algorithms for surface registration. IEEE Conference on Computer Vision and Pattern Recognition, CVPR'07; 2007 Jun 17–22, Minneapolis, MN. New York: IEEE. 2007. p. 1–8.
10.1109/CVPR.2007.383165
Google Scholar
Basso C, Verri A. Fitting 3D morphable models using implicit representations. Journal of Virtual Reality and Broadcasting 2007; 4(18): 1–10.
Google Scholar
Basso C, Paysan P, Vetter T. Registration of Expressions Data using a 3D Morphable Model. In: Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR'06); 2006 Apr 2–6, Southampton, UK. New York: IEEE. 2006. p. 205–210.
Google Scholar
Berretti S, Del Bimbo A, Pala P, Silva Mata F. Face recognition by matching 2D and 3D geodesic distances. In: Sebe N, Liu Y, Zhuang Y, editors. Proceedings of the International Workshop on Multimedia Content Analysis and Mining (MCAM'07): Lecture Notes in Computer Science. Volume 4577; 2007 Jun 29–30, Weihai, China. Berlin Heidelberg: Springer. 2007. p. 444–453.
Google Scholar
Besl PJ, McKay ND. A method for registration of 3D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992; 14(2): 239–256.
10.1109/34.121791
Web of Science® Google Scholar
Blanz V, Vetter T. A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics, SIGGRAPH 99; 1999 Aug 8–13, Los Angeles, CA. New York: ACM Press. 1999. pp. 187–194.
Google Scholar
Blanz V, Vetter T. Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003; 25(9): 1063–1074.
10.1109/TPAMI.2003.1227983
Web of Science® Google Scholar
Blanz V, Scherbaum K, Seidel HP. Fitting a morphable model to 3D scans of faces. In: Proceedings of IEEE 11th International Conference on Computer Vision; 2007 Oct 14–21, Rio de Janeiro. New York: IEEE. 2007. p. 1–8.
Google Scholar
Bronstein AM, Bronstein MM, Kimmel R. Three-dimensional face recognition. International Journal of Computer Vision 2005; 64(1): 5–30.
10.1007/s11263-005-1085-y
Web of Science® Google Scholar
CAESAR-survey. The Civilian American and European Surface Anthropometry Resource. Available at: http://store.sae.org/caesar, accessed Mar 1, 2013. Warrendale, PA: SAE International; 2008.
Google Scholar
Chang KI, Bowyer KW, Flynn PJ. An evaluation of multimodal 2D+3D face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005; 27(4): 619–624.
10.1109/TPAMI.2005.70
PubMed Web of Science® Google Scholar
Cignoni P, Rocchini C, Scopigno R. Metro: Measuring error on simplified surfaces. Computer Graphics Forum 1998; 17: 167–174.
10.1111/1467-8659.00236
Web of Science® Google Scholar
Davis J, Marschner SR, Garr M, Levoy M. Filling holes in complex surfaces using volumetric diffusion. In: Proceedings of the First International Symposium on 3D Data Processing, Visualization and Transmission; 2002 Jun 19–21, Padua, Italy. New York: IEEE. 2002. p. 428–861. 2002
Google Scholar
Faltemier T, Bowyer K, Flynn P. A region ensemble for 3-D face recognition. IEEE Transactions on Information Forensics and Security 2008; 1(3): 62–73.
10.1109/TIFS.2007.916287
Web of Science® Google Scholar
Huang X, Paragios N, Metaxas DN. Shape registration in implicit spaces using information theory and free form deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006; 28(8), 1303–1318.
10.1109/TPAMI.2006.171
PubMed Web of Science® Google Scholar
Kakadiaris I, Passalis G, Toderici G, Murtuza N, Theoharis T. 3D face recognition. In: Chantler M, Fisher M, Trucco M, editors. Proceedings of the British Machine Vision Conference; 2006 Sept 4–7, Edinburgh, UK. Edinburgh: BMVA Press. 2006. p. 869–878.
Google Scholar
Kirkpatrick S, Gelatt CD, Vecchi MP. Optimization by Simulated Annealing. Science, New Series 1983; 220(4598): 671–680.
CAS Google Scholar
Lu X, Jain A. Deformation modeling for robust 3D face matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008; 30(8): 1346–1356.
10.1109/TPAMI.2007.70784
PubMed Web of Science® Google Scholar
Moreno AB, Sanchez A 2004a Gavabdb: A 3D face database. In: Proceedings of the 2nd COST 275 Workshop on Biometrics on the Internet; 2004 Mar 25–26, Vigo, Spain. Luxembourg: COST European Cooperation in Science and Technology. 2004. p. 75–80.
Google Scholar
ter Haar FB, Veltkamp RC. A 3D face matching framework. IEEE International Conference on Shape Modeling and Applications; 2008 Jun 4–6, Stony Brook, NY. New York: IEEE. 2008. p. 103–110.
10.1109/SMI.2008.4547956
Google Scholar
ter Haar FB, Veltkamp RC 2009. A 3D face matching framework for facial curves. Graphical Models 71(2): 77–91.
10.1016/j.gmod.2008.12.003
Web of Science® Google Scholar
ter Haar FB, Daoudi M, Veltkamp RC. SHREC contest session on retrieval of 3D face scans. IEEE International Conference on Shape Modeling and Applications; 2008 Jun 4–6, Stony Brook, NY. New York: IEEE. p. 225–226.
Web of Science® Google Scholar
Turk G, Levoy M. Zippered polygon meshes from range images. In: Proceedings of the 21st International ACM Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '94; 1994 Jul 24–29; New York: ACM Press. 1994. p. 311–318.
Google Scholar
Vetter T, Jones MJ, Poggio T. A bootstrapping algorithm for learning linear models of object classes. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 1997 Jun 17–19, San Juan, Puerto Rico; New York: IEEE Computer Society. 1997. p. 40–46.
Google Scholar
Whitmarsh T, Veltkamp RC, Spagnuolo M, Marini S, ter Haar FB. Landmark detection on 3d face scans by facial model registration. In: Proceedings of the First International Workshop on Shape and Semantics; 2006 Jun 17, Matsushima, Japan. New York: IEEE. 2006. p. 71–76.
Google Scholar
Yin L, Wei X, Sun Y, Wang J, Rosato MJ. A 3D facial expression database for facial behavior research. In: Proceedings of 7th International Conference on Automatic Face and Gesture Recognition; 2006 Apr 2–6, Southampton, UK. New York: IEEE. p. 211–216.
Google Scholar
Zhao H, Xu G. Triangular surface mesh fairing via Gaussian curvature flow. Journal of Computational and Applied Mathematics 2006; 195(1): 300–311.
10.1016/j.cam.2005.03.094
Web of Science® Google Scholar

3D Face Modeling, Analysis and Recognition