Chapter 2
3D Face Surface Analysis and Recognition Based on Facial Surface Features
Faisal Radhi M. Al-Osaimi,
Mohammed Bennammoun,
Faisal Radhi M. Al-Osaimi
Department of Computer Engineering, College of Computer and Information Systems, Umm Al-Qura University, Saudi Arabia
Search for more papers by this authorMohammed Bennammoun
School of Computer Science and Software Engineering, The University of Western Australia
Search for more papers by this authorFaisal Radhi M. Al-Osaimi,
Mohammed Bennammoun,
Faisal Radhi M. Al-Osaimi
Department of Computer Engineering, College of Computer and Information Systems, Umm Al-Qura University, Saudi Arabia
Search for more papers by this authorMohammed Bennammoun
School of Computer Science and Software Engineering, The University of Western Australia
Search for more papers by this authorSummary
This chapter discusses the state of the art in 3D surface features for the recognition of the human face. Particular emphasis is laid on the most prominent and recent contributions. Features extracted from 3D facial surfaces serve as a means for dimensionality reduction of surface data, facilitating the task of face recognition. The chapter first covers (1) the primary 3D surface representations from which feature representations of surfaces are extracted, (2) rigid transformations and decimation of 3D surfaces, and (3) geometries and topologies of the human face that might influence 3D face recognition. A section first discusses the concepts and mathematical definitions of 3D curvatures and then covers some practical methods for their extraction. The other sections in the chapter focus on 3D segmentation approaches that are specific to facial surfaces, the most prominent rigid approaches to feature extraction, and deformation modeling of 3D face surface.
Controlled Vocabulary Terms
image segmentation; three-dimensional displays
References
- Agathos A, Pratikakis I, Perantonis S, Sapidis N, Azariadis P. 3D mesh segmentation methodologies for CAD applications. Computer-Aided Design and Applications 2007; 4(6): 827–842.
10.1080/16864360.2007.10738515 Google Scholar
- Akagunduz E, Ulusoy I. 3D object representation using transform and scale invariant 3d features. Proceedings of the 11th International Conference on Computer Vision; 2007 Oct 14–21; Rio de Janeiro, Brazil. 2007. p. 18.
- Al-Osaimi FR, Bennamoun M, Mian AS. Interest-point based face recognition from range images. In: Rajpoot NM and Bhalerao AH, editors. Proceedings of the British Machine Conference; 2007 Sept 10–13; University of Warwick, UK. London: BMVA Press; 2007. p. 34.1–34.10.
- Al-osaimi FR, Bennamoun M, Mian AS. Integration of local and global geometrical cues for 3d face recognition. Pattern Recognition 2008; 41(2): 1030–1040.
- Al-Osaimi FR, Bennamoun M, Mian AS. An expression deformation approach to non-rigid 3d face recognition. International Journal of Computer Vision 2009; 81(3): 302–316.
- Amor BB, Ardabilian M, Chen L. New experiments on ICP-based 3D face recognition and authentication. In: Proceedings of 18th IEEE International Conference on Pattern Recognition, Volume 3; 2006 Aug 20–24, Hong Kong, China. New York: IEEE. 2006. p. 1195–1199.
- Bar C. Elementary Differential Geometry. London: Cambridge University Press. 2010.
10.1017/CBO9780511844843 Google Scholar
- Besl P, Jain R. Segmentation through variable-order surface fitting. IEEE Transactions on Pattern Analysis and Machine Intelligence 1988; 10: 167–192.
- Besl PJ, Mckay HD. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992; 14(2): 239–256.
- Botsch M, Pauly M, Kobbelt L, Alliez P, Levy B, Bischoff S, Rossl C. Geometric modeling based on polygonal meshes. In: Proceedings of ACM SIGGRAPH Course Notes; 2007 Aug 5–9, San Diego, CA. New York: Association for Computing Machinery. 2007.
- Bronstein AM, Bronstein MM, Kimmel R. Three-dimensional face recognition. International Journal of Computer Vision 2005; 64(1): 5–30.
- Chang K, Bowyer K, Flynn P. Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006; 28(10): 1695–1700.
- Chen Y and Medioni G. Object modeling by registration of multiple range images. In: Medoni G, editor. Proceedings of IEEE International Conference on Robotics and Automation. Volume 3; 1991 Apr 9–11, Sacramento, CA. New York: IEEE. 1991. p. 2724–2729.
- Dibeklioglu H, Salah A, Akarun L. 3D facial landmarking under expression, pose, and occlusion variations. In: Proceedings of the 2nd IEEE International Conference on Biometrics: Theory, Applications and Systems; 2008 Sep 29–Oct 1, Arlington, VI. New York: IEEE. 2008. pp. 1–6.
- Garland M, Heckbert PS. Surface simplification using quadric error metrics. In: Owen GS, Whitted T, Mones-Hattal B, editors. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '97;1997 Aug 3–8, Los Angeles, CA. New York: ACM Press/Addison-Wesley Publishing Co. 1997. p. 209–216.
- Gnanaprakasam C, Sumathi S, Malini RR. Average-half-face in 2D and 3D using wavelets for face recognition. In: Niola V, Quartieri J, Neri F, et al., editors. Proceedings of the 9th WSEAS International Conference on Signal Processing, SIP'10; 2010 May 2931. Stevens Point, WI: World Scientific and Engineering Academy and Society (WSEAS). 2010. p. 107–112.
- Gokberk B, Irfanoglu M, Akarun L. 3D shape-based face representation and feature extraction for face recognition. Image and Vision Computing 2006; 24(8): 857–869.
- Greenspan M, Yurick M. Approximate k-d tree search for efficient ICP. In: Proceedings of the 4th International Conference on 3-D Digital Imaging and Modeling; 2003 Oct 6–10, Banff, Canada. New York: IEEE. 2003. p. 442–448.
- Gunlu G, Bilge H. 3D face decomposition and region selection against expression variations. In: Proceedings of the 20th IEEE International Conference on Pattern Recognition; 2010 Aug 23–26, Istanbul, Turkey. New York: IEEE. 2010. p. 1298–1301.
- Harguess J, Gupta S, Aggarwal J. 3D face recognition with the average-half-face. In: Proceedings of the 19th IEEE International Conference on Pattern Recognition; 2008, Dec 811, Tampa, FL. New York: IEEE. 2008. p. 1–4.
- Heckbert PS, Garland M. Survey of polygonal surface simplification algorithms. Technical Report, School of Computer Science, Carnegie Mellon University; 1997 and In: Proceedings of the ACM SIGGRAPH Conference, Multiresolution Surface Modeling, Course Note # 25; 1997 Aug 5, Los Angeles, CA. New York: ACM. 1997. p. 209–216.
- Husken M, Brauckmann M, Gehlen S, Von der Malsburg C. Strategies and benefits of fusion of 2D and 3D face recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition – Workshops, CVPR Workshops; 2005 Jun 20–25, San Diego, CA. New York: IEEE. 2005 p. 174.
- Kakadiaris IA, Passalis G, Theoharis T, Toderici G, Konstantinidis I, Murtuza MN 2005 8d-thermo cam: Combination of geometry with physiological information for face recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Volume 2; 2005 Jun 20–25, San Diego, CA. New York: IEEE. p. 1183.
- Kakadiaris IA, Passalis G, Toderici G, Murtuza MN, Lu Y, Karampatziakis N, Theoharis T. Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 2007; 29(4): 640–649.
- Kettner L. Using generic programming for designing a data structure for polyhedral surfaces. Computational Geometry: Theory and Applications 1999; 13: 65–90.
- Lee J, Milios E. Matching range images of human faces. In: Proceedings of the 3rd IEEE International Conference on Computer Vision; 1990 Dec 4–7, Osaka, Japan. 1990. New York: IEEE. p. 722–726.
- Lo TWR, Siebert JP. Sift keypoint descriptors for range image analysis. Annals of the British Machine Vision Association 2008; 2008(3): 1–18.
- Lowe DG. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2004; 60: 91–110.
- Lu X, Jain AK, Colbry D. Matching 2.5D face scans to 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006; 28(1): 31–43.
- Luebke D. A developer's survey of polygonal simplification algorithms. IEEE Computer Graphics and Applications 2001; 21(3): 24–35.
- McCool C, Cook J, Chandran V, Sridharan S. Feature modelling of PCA difference vectors for 2D and 3D face recognition. In: Proceedings of the IEEE International Conference on Video and Signal Based Surveillance, AVSS'06; 2006 Dec 11, Sydney, Australia. New York: IEEE. p. 57.
- Mian A, Bennamoun M, Owens R. Region-based matching for robust 3D face recognition. In: Clocksin W, Fitzgibbon A, Torr P, editors. Proceedings of the 16th British Machine Vision Conference, Volume 1; 2005 Sept 5–8, Oxford, UK. London: BMVC. 2005. p. 199–208.
- Mian A, Bennamoun M, Owens R. An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 2007; 29: 1927–1943.
- Mian AS, Bennamoun M, Owens R. Keypoint detection and local feature matching for textured 3D face recognition. International Journal of Computer Vision 2008; 79: 1–12.
- Moreno AB, Sanchez A, Vlez JF, Daz FJ. Face recognition using 3D surface-extracted descriptors In: Proceedings of the Irish Machine Vision and Image Processing Conference, IMVIP'03; 2003 Sept 3–5, University of Ulster, Coleraine, Ireland. Dublin, Ireland: SIGMEDIA. 2003.
- O'Neill B. Elementary Differential Geometry. Revised 2nd edition. New York/London: Elsevier/Academic Press; 2006.
- Pan G, Wu Z. 3d Face Recognition from Range Data. International Journal of Image and Graphics 2005; 5(3): 573–593.
10.1142/S0219467805001884 Google Scholar
- Renze KJ, Oliver JH. Generalized unstructured decimation. IEEE Computer Graphics and Applications 1996; 16: 24–32.
- Rossignac J, Borrell P. Multi-resolution 3D approximations for rendering complex scenes. In: Falcidieno B, Kunii TL, editors. Proceedings of Geometric Modeling in Computer Graphics; 1993 Jun 28–Jul 2, Genova, Italy. Heidelberg: Springer Verlag. 1993. p. 455–465.
- Schroeder WJ, Zarge JA, Lorensen WE. Decimation of triangle meshes. In: Proceedings of the 19th Annual Conference on Computer Graphics, SIGGRAPH '92; 1992 Jul 26–31 Chicago, IL. New York: ACM. 1992. p. 65–70.
- Segundo M, Queirolo C, Bellon O, Silva L. Automatic 3D facial segmentation and landmark detection. In: Cucchiara R, editor. Proceedings of the 14th International Conference on Image Analysis and Processing, ICIAP '07; 2007 Sept 10–14, Modena, Italy. New York: IEEE Computer Society. 2007. p. 431–436.
- seng Chua C, Han F, khing Ho Y. 3D human face recognition using point signature In: Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition; 2000 Mar 28–30, Grenoble, France. California: IEEE Computer Society. 2000. p. 233–238.
- Shamir A. A survey on mesh segmentation techniques. Computer Graphics Forum 2008; 27(6): 1539–1556.
- Smeets D, Fabry T, Hermans J, Vandermeulen D, Suetens P. Isometric deformation modeling using singular value decomposition for 3D expression-invariant face recognition. In: Proceedings of the 3rd IEEE International Conference on Biometrics: Theory, Applications and Systems, BTAS'09; 2009 Sept 28–30,Washington, DC. Piscataway, NJ: IEEE Press. 2009. p. 68–73.
- Tanaka H, Ikeda M and Chiaki H. Curvature-based face surface recognition using spherical correlation. principal directions for curved object recognition. In: Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition; 1998 Apr 14–16, Nara, Japan. New York: IEE. 1998. p. 372–377.
- Wang Y, Chua CS, Ho YK, Ren Y. Integrated 2D and 3D images for face recognition. In: Proceedings of 11th International Conference on Image analysis and Processing; 2001 Sep 2628; Palermo, Italy. California: The IEEE Computer Society, 2001. p. 0048.
- Wang Y, Pan G, Wu Z, Wang Y. Exploring facial expression effects in 3d face recognition using partial ICP. In: Proceedings of the 7th Asian Conference on Computer Vision, ACCV'06. Part1; 2006 Jan 13–16, Hyderabad, India. New York: Springer. 2006. p. 581–590.
- Wiskott L, Fellous JM, Kuiger N, von der Malsburg C. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997; 19(7): 775–779.
- Zhang L, Razdan A, Farin GE, Femiani J, Bae M, Lockwood C. 3D face authentication and recognition based on bilateral symmetry analysis. The Visual Computer 2006; 22: 43–55.
