Facial Asymmetry-Based Age Group Estimation: Role in Recognizing Age-Separated Face Images
Muhammad Sajid Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorImtiaz Ahmad Taj Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorCorresponding Author
Usama Ijaz Bajwa Ph.D.
Department of Computer Science, COMSATS Institute of Information Technology, Off Raiwind Road, Lahore, Pakistan
Additional information and reprint requests:
Usama Ijaz Bajwa, Ph.D.
Department of Computer Science
COMSATS Institute of Information Technology
Off Raiwind Road
Lahore
Pakistan
E-mail: [email protected]; [email protected]
Search for more papers by this authorNaeem Iqbal Ratyal Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorMuhammad Sajid Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorImtiaz Ahmad Taj Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorCorresponding Author
Usama Ijaz Bajwa Ph.D.
Department of Computer Science, COMSATS Institute of Information Technology, Off Raiwind Road, Lahore, Pakistan
Additional information and reprint requests:
Usama Ijaz Bajwa, Ph.D.
Department of Computer Science
COMSATS Institute of Information Technology
Off Raiwind Road
Lahore
Pakistan
E-mail: [email protected]; [email protected]
Search for more papers by this authorNaeem Iqbal Ratyal Ph.D.
Vision and Pattern Recognition Systems Research Group, Capital University of Science and Technology, Expressway, Zone V, Islamabad, Pakistan
Search for more papers by this authorAbstract
Face recognition aims to establish the identity of a person based on facial characteristics. On the other hand, age group estimation is the automatic calculation of an individual's age range based on facial features. Recognizing age-separated face images is still a challenging research problem due to complex aging processes involving different types of facial tissues, skin, fat, muscles, and bones. Certain holistic and local facial features are used to recognize age-separated face images. However, most of the existing methods recognize face images without incorporating the knowledge learned from age group estimation. In this paper, we propose an age-assisted face recognition approach to handle aging variations. Inspired by the observation that facial asymmetry is an age-dependent intrinsic facial feature, we first use asymmetric facial dimensions to estimate the age group of a given face image. Deeply learned asymmetric facial features are then extracted for face recognition using a deep convolutional neural network (dCNN). Finally, we integrate the knowledge learned from the age group estimation into the face recognition algorithm using the same dCNN. This integration results in a significant improvement in the overall performance compared to using the face recognition algorithm alone. The experimental results on two large facial aging datasets, the MORPH and FERET sets, show that the proposed age group estimation based on the face recognition approach yields superior performance compared to some existing state-of-the-art methods.
References
- 1Fu Y, Huang TS. Human age estimation with regression on discriminative aging manifold. IEEE Trans Multimedia 2006; 10(4): 578–84.
- 2Yang Z, Ai H. Demographic classification with local binary patterns. Proceedings of the International Conference on Biometrics: Advances in Biometrics; 2007 Aug 27–29; Seoul, South Korea. Berlin, Heidelberg: Springer;2007, 4642: 464–73.
- 3Ylioinas J, Hadid A, Pietikainen M. Age classification in unconstrained conditions using LBP variants. Proceedings of the 21st International Conference on Pattern Recognition; 2012 Nov 11–15; Tsukuba, Japan. Piscataway, NJ: IEEE, 2012.
- 4Lu J, Tan Y. Ordinary preserving manifold analysis for human age and head pose estimation. IEEE Trans Hum Mach Syst 2013; 43(2): 249–58.
- 5Hu H, Jain AK. Age, gender and race estimation from unconstrained face images. East Lansing, MI: Michigan State University, 2014; Report No.: MSU-CSE-14–5.
- 6Han H, Otto C, Liu X, Jain AK. Demographic estimation from face images: human vs. machine performance. IEEE Trans Pattern Anal Mach Intell 2015; 37(6): 1148–61.
- 7Guo G, Mu G. Joint estimation of age, gender and ethnicity: CCA vs. PLS. Proceedings of the 10th International Conference and Workshops on Automatic Face and Gesture Recognition; 2013 Apr 22–26; Shanghai, China. Piscataway, NJ: IEEE, 2013: 1–6.
- 8Chen C, Dantcheva A, Ross A. Impact of facial cosmetics on automatic gender and age estimation algorithms. Proceedings of the 9th International Conference on Computer Vision Theory and Applications; 2014 Jan 5–8; Lisbon, Portugal. Piscataway, NJ: IEEE, 2014.
- 9Ngan ML, Grother PJ. Face Recognition Vendor Test (FRT) – performance of automated age estimation algorithms, 2014; https://www.nist.gov/publications/face-recognition-vendor-test-frvt-performance-automated-age-estimation-algorithms (accessed March 8, 2018).
- 10Rhodes MG. Age estimation of faces: a review. Appl Cogn Psychol 2009; 23(1): 1–12.
- 11Burt D, Perrett D. Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information. Proc Biol Sci 1995; 259(1355): 137–43.
- 12George PA, Hole GJ. The influence of feature-based information in the age processing of unfamiliar faces. Perception 1998; 27(3): 295–312.
- 13Jones G, Smith PK. The eyes have it: young children's discrimination of age in masked and unmasked facial photographs. J Exp Child Psychol 1984; 38(2): 328–37.
- 14Fu Y, Guo G, Huang TS. Age synthesis and estimation via faces: a survey. IEEE Trans Pattern Anal Mach Intell 2010; 32(11): 1955–76.
- 15Kwon YH, Lobo NV. Age classification from facial images. Comput Vis Image Underst 1999; 71(1): 1–21.
10.1006/cviu.1997.0549 Google Scholar
- 16Ling H, Soatto S, Ramanathan N, Jacobs D. Face verification across age progression using discriminative methods. IEEE Trans Inf Forensics Sec 2010; 5(1): 82–91.
- 17Park U, Tong Y, Jain AK. Age-invariant face recognition. IEEE Trans Pattern Anal Mach Intell 2010; 32(5): 947–54.
- 18Li Z, Park U, Jain AK. A discriminative model for age-invariant face recognition. IEEE Trans Inf Forensics Sec 2011; 6(3): 1028–37.
- 19Yadav D, Vatsa M, Singh R, Tistarelli M. Bacteria foraging fusion for face recognition across age progression. Proceedings of the International Conference on Computer Vision and Pattern Recognition Workshops; 2013 June 23–28; Portland, OR. Piscataway, NJ: IEEE, 2013.
- 20Sungatullina D, Lu J, Wang G, Moulin P. Multiview discriminative learning for age-invariant face recognition. Proceedings of the 10th International Conference and Workshops on Automatic Face and Gesture Recognition; 2013 Apr 22–26; Shanghai, China. Piscataway, NJ: IEEE, 2013: 1–6.
- 21Best-Rowden L, Jain AK. Longitudinal study of automatic face recognition. IEEE Trans Pattern Anal Mach Intell 2017; 40(1): 148–62.
- 22Klare B, Jain AK. On a taxonomy of facial features. Proceedings of the Fourth International Conference on Biometrics: Theory Applications and Systems; 2010 Sept 27–29; Washington, DC. Piscataway, NJ: IEEE, 2010.
- 23Liu Y, Schmidt K, Cohn J, Mitra S. Facial asymmetry quantification for expression-invariant human identification. Comput Vis Image Underst 2003; 91(1–2): 138–59.
- 24Gutta S, Wechsler H. Face recognition using asymmetric faces. Proceedings of the First International Conference on Biometric Authentication; 2004 July 15–17; Hong Kong, China. Berlin, Heidelberg: Springer, 2004; 3072: 162–8.
- 25Abaza A, Ross A. Towards understanding the symmetry of human ears: a biometric perspective. Proceedings of the Fourth International Conference on Biometrics: Theory Applications and Systems; 2010 Sept 27–29; Washington, DC. Piscataway, NJ: IEEE, 2010.
- 26Ricanek KJr, Tesafaye T. MORPH: a longitudinal image database of normal adult age-progression. Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition; 2006 Apr 10–12; Southampton, U.K. Piscataway, NJ: IEEE, 2006; 341–5.
- 27 Color FERET Database; https://www.nist.gov/itl/iad/image-group/color-feret-database (accessed March 8, 2018).
- 28Huang GB, Ramesh M, Berg T, Learned-Miller E. Labeled faces in the wild: a database for studying face recognition in unconstarined environments. University of Massachusetts, 2007; Report; 07-49.
- 29Ercan I, Ozdemir ST, Etoz A, Sigirli D, Tubbs RS, Loukas M, et al. Facial asymmetry in young healthy subjects evaluated by statistical shape analysis. J Anat 2008; 213: 663–9.
- 30Cheong YW, Lo LJ. Facial asymmetry: etiology, evaluation and management. Chang Gung Med J 2011; 34(4): 341–51.
- 31 Face++; https://www.faceplusplus.com (accessed March 8, 2018).
- 32Vig PS, Hewitt AB. Asymmetry of the human facial skeleton. Angle Orthod 1975; 45: 125–9.
- 33Snedecor GW, Cochran WG. Statistical methods, 8th edn. Ames, IA: Iowa State University Press, 1989.
- 34Hotelling H. Relations between two sets of variates. Biometrika 1936; 28: 321–77.
- 35Hotelling H. The most predictable criterion. J Educ Psychol 1935; 26: 139–42.
- 36Pudil P, Novovicova J, Kittler J. Floating search methods in feature selection. Pattern Recognit Lett 1994; 15(11): 1119–25.
- 37Hall MA. Correlation-based feature subset selection for machine learning. [dissertation]. Hamilton, New Zealand: University of Waikato, 1999.
- 38Vapnik VN. Statistical learning theory. New York, NY: John Wiley & Sons Inc, 1998.
- 39Chang C-C, Lin C-J. LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2011; 2: 1–27.
- 40Choi SE, Lee YJ, Lee SJ, Park KR, Kim J. Age estimation using a hierarchical classifier based on global and local facial features. Pattern Recognit 2011; 44(6): 1262–81.
- 41Thukral P, Mitra K, Chellappa R. A hierarchical approach for human age estimation. Proceedings of the International Conference on Acoustics, Speech and Signal Processing; 2012 Mar 25–30; Kyoto, Japan. Piscataway, NJ: IEEE, 2012; 1529–32.
- 42Altman DG, Bland JM. Diagnostic tests. 1: sensitivity and specificity. BMJ 1994; 308(6943): 1552.
- 43Schaefer S, McPhail T, Warren J. Image deformation using moving least squares. ACM Trans Graph 2006; 25: 533–40.
- 44Pesaresi M, Benidiktsson JA. A new approach for the morphological segmentation of high resolution satellite imagery. IEEE Trans Geosci Remote Sens 2001; 39(2): 309–20.
- 45Hu MK. Visual pattern verification by moment invariants. IEEE Trans Inf Theory 1962; 8: 179–87.
- 46Sivic J, Zisserman A. Video Google: efficient visual search of videos. In: J Ponce, M Hebert, C Schmid, A Zisserman, editors. Toward category-level object recognition: lecture notes in computer science. Berlin, Heidelberg: Springer, 2006; 4170: 127–44.
10.1007/11957959_7 Google Scholar
- 47Perronnin F, Liu Y, Sanchez J, Poirier H. Large-scale image retrieval with compressed Fisher vectors. Proceedings of the International Conference on Computer Vision and Pattern Recognition; 2010 June 13–18; San Francisco, CA. Piscataway, NJ: IEEE, 2010; 3384–91.
- 48Jegou H, Perronnin F, Douze M, Sanchez J, Perez P, Schmid C. Aggregating local image descriptors into compact codes. IEEE Trans Pattern Anal Mach Intell 2012; 34(9): 1704–16.
- 49Babenko A, Lempitsky VS. Aggregating deep convolutional features for image retrieval. Ithaca, NY: Cornell University Library, 2015.
- 50Razavian AS, Sullivan J, Maki A, Carlsson S. Visual instance retrieval with deep convolutional networks. Ithaca, NY: Cornell University Library, 2014.
- 51Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems; 2012 Dec 03–06; Lake Tahoe, NV. New York, NY: ACM, 2012; 1097–105.
- 52 VeriLook SDK: face identification for stand-alone or web applications; http://www.neurotechnology.com/verilook.html (accessed March 8, 2018).
- 53Ross A, Jain AK. Information fusion in biometrics. Pattern Recognit Lett 2003; 24(13): 2115–25.
- 54Kittler J. Combining classifiers: a theoretical framework. Pattern Anal Appl 1998; 1(1): 18–27.