Gait Recognition: Databases, Representations, and Applications
Abstract
There has been a considerable progress in automatic recognition of people by the way they walk since its inception almost 20 years ago: There is now a plethora of techniques and data that continue to show that a person's gait is indeed unique. Gait recognition is a behavioral biometric that is available even at a distance from a camera when other biometrics may be occluded, obscured, or suffering from insufficient image resolution (e.g., a blurred face image or a face image occluded by mask). Since gait recognition does not require subject cooperation due to its noninvasive capturing process, it is expected to be applied for criminal investigation from CCTV footages in public and private places. This article introduces current progress, a research background, and basic approaches for gait recognition in the first three sections, and two important aspects of gait recognition, the gait databases and gait feature representations, are described in the following sections.
Publicly available gait databases are essential for benchmarking individual approaches, and such databases should contain a sufficient number of subjects as well as covariate factors to realize statistically reliable performance evaluation and also robust gait recognition. Gait recognition researchers have therefore built such useful gait databases that incorporate subject diversities and/or rich covariate factors.
Gait feature representation is also an important aspect for effective and efficient gait recognition. We describe the two main approaches to representation: model-free (appearance-based) approaches and model-based approaches. In particular, silhouette-based model-free approaches predominate in recent studies and many have been proposed and are described in detail.
Performance evaluation results of such recent gait feature representations on two of the publicly available gait databases are reported: USF Human ID with rich covariate factors such as views, surface, bag, shoes, and time elapse and OU-ISIR LP with more than 4000 subjects. Since gait recognition is suitable for criminal investigation, applications of the gait recognition to forensics are addressed with real criminal cases in the application section. Finally, several open problems of the gait recognition are discussed to show future research avenues of the gait recognition.
Bibliography
- 1 M. Murray, A. Drought, and R. Kory. J. Bone Joint Surg. 1964, 46 (2), p 335.
- 2
D. A. Winter.
Biomechanics and Motor Control of Human Movement.
John Wiley & Sons, Inc.:
Ottawa, ON,
2009.
10.1002/9780470549148 Google Scholar
- 3 J. E. Cutting and L. T. Kozlowski. Bull. Psychon. Soc. 1977, 9 (5), pp 353–356
- 4 L. T. Kozlowski and J. E. Cutting. Percept. Psychophys. 1977, 21 (6), pp 575–580.
- 5 N. F. Troje. J. Vis. 2002, 2, pp 371–387.
- 6 I. Bouchrika, M. Goffredo, J. N. Carter, and M. S. Nixon. J. Forensic Sci. 2011, 56 (4), pp 882–889.
- 7 H. Iwama, D. Muramatsu, Y. Makihara, and Y. Yagi. IPSJ Trans. Comput. Vis. Appl. 2013, 5, pp 163–175.
- 8 N. Lynnerup and P. K. Larsen. IET Biom. 2014, 3 (2), pp 47–54.
- 9 J. Yoo, D. Hwang, and M. S. Nixon. Proc. of the 15th International Conference on Advanced Concepts for Intelligent Vision Systems; 2006, pp 138–145.
- 10 G. Huang and Y. Wang. Proc. of the 8th Asian Conference on Computer Vision; 2007, vol. 1, pp 462–471.
- 11 X. Li, S. J. Maybank, S. Yan, D. Tao, and D. Xu. IEEE Trans. Syst. Man Cybern. C 2008, 38 (2), pp 145–155.
- 12 S. Yu, T. Tan, K. Huang, K. Jia, and X. Wu. IEEE Trans. Image Process. 2009, 18 (8), pp 1905–1910.
- 13 J. W. Davis. Proc. of the 3rd International Conference on Audio- and Video-Based Biometric Person Authentication; 2001, pp 295–300.
- 14 R. K. Begg. IEEE Trans. Biomed. Eng. 2005, 52 (5), pp 828–838.
- 15 J. Lu and Y.-P. Tan. IEEE Trans. Inf. Forensics Secur. 2010, 5 (4), pp 761–770.
- 16 Y. Makihara, M. Okumura, H. Iwama, and Y. Yagi. Proc. of the 1st International Joint Conference on Biometrics; 2001, pp 1–6.
- 17 M. Livne, L. Sigal, N. F. Troje, and D. J. Fleet. Computer Vis. Image Underst. 2012, 116 (5), pp 648–660.
- 18 Z. Liu and S. Sarkar. IEEE Trans. Syst. Man Cybern. B 2005, 35 (2), pp 170–183.
- 19 Y. Boykov and G. Funka-Lea. Int. J. Comput. Vis. 2006, 70 (2), pp 109–131.
- 20 Y. Makihara and Y. Yagi. Proc. of the 19th International Conference on Pattern Recognition; 2008, pp 1–4.
- 21 A. Levin, D. Lischinski, and Y. Weiss. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30 (2), pp 228–242.
- 22 M. Hofmann and G. Rigoll. Proc. of the 19th IEEE International Conference on Image Processing; 2012, pp 1389–1392.
- 23 S. Sarkar, P. J. Phillips, Z. Liu, I. R. Vega, P. Grother, and K. W. Bowyer. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27 (2), pp 162–177.
- 24 L. Wang, T. Tan, H. Ning, and W. Hu. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25 (12), pp 1505–1518.
- 25 Y. Makihara, R. Sagawa, Y. Mukaigawa, T. Echigo, and Y. Yagi. Proc. of the 9th European Conference on Computer Vision; 2006, vol. 3, pp 151–163.
- 26 Y. Makihara, M. R. Aqmar, T. T. Ngo, H. Nagahara, R. Sagawa, Y. Mukaigawa, and Y. Yagi. IEEE Trans. Signal Process. 2014, 62 (8), pp 2066–2079.
- 27 J. Han and B. Bhanu. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28 (2), pp 316–322.
- 28 O. Chapelle and S. Keerthi. Inf. Retr. 2010, 13, pp 201–215.
- 29 R. Martin-Felez and T. Xiang. Proc. of the 12th European Conference on Computer Vision; 2010, vol. 1, pp 328–341.
- 30 R. Gross and J. Shi. Technical Report CMU-RI-TR-01-18, Robotics Institute, Carnegie Mellon University, 2001.
- 31 R. Tanawongsuwan and A. Bobick. Technical Report GIT-GVU-03-01, Georgia Institute of Technology, 2003.
- 32 T. Chalidabhongse, V. Kruger, and R. Chellappa. Technical Report, University of Maryland, 2001.
- 33 M. S. Nixon, J. N. Carter, J. Shutler, and M. Grant. Technical Report, University of Southampton, 2001.
- 34 J. D. Shutler, M. G. Grant, M. S. Nixon, and J. N. Carter. Proc. of the 4th International Conference on Recent Advances in Soft Computing; 2002, pp 66–71.
- 35
S. Samangooei,
J. Bustard,
M. S. Nixon, and
J. N. Carter.
In
Multibiometrics for Human Identification; B; Bhanu V. Govindaraju, Eds.;
Cambridge University Press,
2011;
pp 277–301.
10.1017/CBO9780511921056.014 Google Scholar
- 36 D. S. Matovski, M. S. Nixon, S. Mahmoodi, and J. N. Carter. Proc. of the 4th IEEE International Conference on Biometrics: Theory, Applications and Systems; 2012.
- 37 L. Wang, H. Ning, W. Hu, and T. Tan. Proc. of the 19th IEEE International Conference on Image Processing; 2002, vol. 3, pp 433–436.
- 38 S. Yu, D. Tan, and T. Tan. Proc. of the 18th International Conference on Pattern Recognition; 2006, vol. 4, pp 441–444.
- 39 D. Tan, K. Huang, S. Yu, and T. Tan, Proc. of the 18th International Conference on Pattern Recognition; 2006, vol. 3, pp 1000–1003.
- 40 A. Tsuji, Y. Makihara, and Y. Yagi. Proc. of the 23rd IEEE Conference on Computer Vision and Pattern Recognition; 2010, pp 717–722.
- 41 M. A. Hossain, Y. Makihara, W. Junqiu, and Y. Yagi. Pattern Recognit. 2010, 43 (6), pp 2281–2291.
- 42 Y. Makihara, H. Mannami, and Y. Yagi. Proc. of the 10th Asian Conference on Computer Vision; 2010, pp 975–986.
- 43 A. Mori, Y. Makihara, and Y. Yagi. Proc. of the 20th International Conference on Pattern Recognition; 2010, pp 2194–2197.
- 44 H. Iwama, M. Okumura, Y. Makihara, and Y. Yagi. IEEE Trans. Inf. Forensics Secur. 2012, 7 (5), pp 1511–1521.
- 45 M. Hofmann, S. Sural, and G. Rigoll. Proc. of the 19th International Conference on Computer Graphics, Visualization and Computer Vision; 2011.
- 46 M. Hofmann, J. Geiger, S. Bachmann, B. Schuller, and G. Rigoll. J.Vis. Commun. Image Represent. 2014, 25 (1), pp 195–206.
- 47 B. DeCann, A. Ross, and J. Dawson. Proc. of the SPIE Conference on Biometric Technology for Human Identification X; 2013 pp 1–16.
- 48 R. Seely, S. Samangooei, M. Lee, J. Carter, and M. Nixon, Proc. of the 2nd IEEE International Conference Biometrics: Theory, Applications and Systems; 2008.
- 49 Y. Makihara, H. Mannami, A. Tsuji, M. A. Hossain, K. Sugiura, A. Mori, and Y. Yagi. IPSJ Trans. Comput. Vis. Appl. 2012, 4, pp 53–62.
- 50 S. A. Niyogi and E. H. Adelson. Proc. of the 7th IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 1994, pp 469–474.
- 51 H. Murase and R. Sakai. Pattern Recognit. Lett. 1996, 17, pp 155–162.
- 52 J. Little and J. Boyd. Videre: J. Comput. Vis. Res. 1998, 1 (2), pp 1–32.
- 53 P. S. Huang, C. J. Harris, and M. S. Nixon. Artif. Intell. Eng. 1999, 13 (4), pp 359–366.
- 54 J. D. Shutler and M. S. Nixon. Proc. of the 12th British Machine Vision Conference; 2001, pp 705–714.
- 55 C. BenAbdelkader, R. Cutler, and L. Davis. Proc. of the 3rd International Conference on Audio- and Video-Based Biometric Person Authentication; 2001, pp 284–294.
- 56 R. Collins, R. Gross, and J. Shi. Proc. of the 5th IEEE International Conference on Face and Gesture Recognition; 2002, pp 366–371.
- 57 Y. Liu, R. Collins, and Y. Tsin. Proc. of the 7th European Conference on Computer Vision; 2002, pp 657–671.
- 58 I. R. Vega and S. Sarkar. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25 (10), pp 1323–1328.
- 59 J. P. Foster, M. S. Nixon, and A. Prugel-Bennet. Pattern Recognit. Lett. 2003, 24, pp 2489–2497.
- 60 J. Hayfron-Acquah, M. S. Nixon, and J. N. Carter. Pattern Recognit. Lett. 2003, 24 (13), pp 2175–2183.
- 61 G. Zhao, R. Chen, G. Liu, and L. Hua. Proc. of the 6th IEEE International Conference on Face and Gesture Recognition; 2004, pp 23–28.
- 62 A. Kale, A. Sundaresan, A. Rajagopalan, N. Cuntoor, A. Roy-Chowdhury, V. Kruger, and R. Chellappa. IEEE Trans. Image Process. 2004, 13 (9), pp 1163–1173.
- 63 Z. Liu and S. Sarkar. Proc. of the 17th International Conference on Pattern Recognition; 2004, pp 211–214.
- 64 C.-S. Lee and A. Elgammal. Proc. of the 6th IEEE International Conference on Face and Gesture Recognition; 2004, pp 147–152.
- 65 T. Kobayashi and N. Otsu. Proc. of the 17th International Conference on Pattern Recognition; 2004, vol. 3, pp 741–744.
- 66 S. D. Mowbray and M. S. Nixon. Proc. of the 1st IEEE International Conference on Advanced Video and Signal Based Surveillance; 2003, pp 566–573.
- 67 T. H. W. Lam and R. S. T. Lee. Proc. of the 1st IAPR International Conference on Biometrics; 2006, pp 612–618.
- 68 D. Tao, X. Li, X. Wu, and S. Maybank. Proc. of the 18th IEEE Conference on Computer Vision and Pattern Recognition; 2006, vol. 2, pp 1670–1677.
- 69 D. Ioannidis, D. Tzovaras, I. G. Damousis, S. Argyropoulos, and K. Moustakas. IEEE Trans. Inf Forensics Secur. 2007, 2 (3), pp 623–630.
- 70 T. H. W. Lam, R. S. T. Lee, and D. Zhang, Pattern Recognit. 2007, 40 (9), pp 2563–2573.
- 71 S. Lee, Y. Liu, and R. Collins. Proc. of the 19th IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2007, pp 1–8.
- 72 K. Bashir, T. Xiang, and S. Gong. Proc. of the 20th British Machine Vision Conference; 2009, pp 1–11.
- 73 K. Bashir, T. Xiang, and S. Gong. Proc. of the 3rd International Conference on Imaging for Crime Detection and Prevention; 2009.
- 74 K. Bashir, T. Xiang, and S. Gong. Pattern Recognit. Lett. 2010, 31 (13), pp 2052–2060.
- 75 B. DeCann and A. Ross. Proc. of the SPIE, Biometric Technology for Human Identification VII. 76670Q-76670Q-13; 2010.
- 76 T. H. W. Lam, K. H. Cheung, and J. N. K. Liu. Pattern Recognit. 2011, 44 (4), pp 973–987.
- 77 S. Sivapalan, D. Chen, S. Denman, S. Sridharan, and C. Fookes. Proc. of the 1st International Joint Conference on Biometrics; 2011, pp 1–6.
- 78 C. Wang, J. Zhang, J. Pu, L. Wang, and X. Yuan. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 23 (11), pp 2164–2176.
- 79 M. Hofmann, S. Bachmann, and G. Rigoll. Proc. of the 5th IEEE International Conference on Biometrics Theory, Applications, and Systems, Paper ID 172; 2012, pp 1–5.
- 80 H. Nakajima, I. Mitsugami, and Y. Yagi. IPSJ Trans. Comput. Vis. Appl. 2013, 5, pp 94–98.
- 81 H. El-Alfy, I. Mitsugami, and Y. Yagi. Proc. of the ACCV 2014 Workshop on Human Gait and Action Analysis in the Wild: Challenges and Applications; 2014.
- 82 D. Cunado, M. S. Nixon, and J. N. Carter. Comput. Vis. Image Underst. 2003, 90 (1), pp 1–41.
- 83 L. Lee and W. E. L. Grimson. Proc. of the 5th IEEE International Conference on Face and Gesture Recognition; 2002, pp 155–162.
- 84 B. Bhanu and J. Han. Proc. of the 4th International Conference Audio- and Video-Based Biometric Person Authentication; 2003, pp 600–608.
- 85 C. Benabdelkader, R. Cutler, and L. Davis. Proc. of the 5th IEEE International Conference on Automatic Face and Gesture Recognition; 2002, pp 267–272.
- 86 A. F. Bobick and A. Y. Johnson. Proc. of the 14th IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2001, vol. 1, pp 423–430.
- 87 L. Wang, H. Ning, T. Tan, and W. Hu. IEEE Trans. Circuits Syst. Video Technol. 2004, 14 (2), pp 149–158.
- 88 D. K. Wagg and M. S. Nixon. Proc. of the 6th IEEE International Conference on Face and Gesture Recognition; 2004, pp 11–16.
- 89 Yam, C., M. S. Nixon, and J. N. Carter. Pattern Recognit. 2004, 37 (5), pp 1057–1072.
- 90 R. Zhang, C. Vogler, and D. Metaxas. Proc. of the 17th IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2004, vol. 2, pp 342–349.
- 91 G. Zhao, G. Liu, H. Li, and M. Pietikainen. Proc. of the 7th International Conference on Automatic Face and Gesture Recognition; 2006, pp 529–534.
- 92 H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos. EURASIP J. Adv. Signal Process 2008, 2008 (62), pp 1–13.
- 93 G. Ariyanto and M. S. Nixon. Proc. of the 5th IAPR International Conference on Biometrics; 2012, pp 354–359.
- 94 M. S. Nixon, T. N. Tan, and R. Chellappa. Human Identification Based on Gait. Springer: New York, 2005.
- 95 M. S. Nixon and J. N. Carter. Proc. IEEE 2006, 94 (11), pp 2013–2024.
- 96 H. Murase and S. K. Nayar. Int. J. Comput. Vis. 1995, 14 (1), pp 5–24.
- 97
W. Liang,
T. Tieniu,
N. Huazhong, and
H. Weiming.
IEEE Trans. Pattern Anal. Mach. Intell.
2003,
25 (12),
pp 1505–1518.
10.1109/TPAMI.2003.1251144 Google Scholar
- 98 A. Sundaresan, A. Roychowdhury, and R. Chellappa. Proc. of the 10th IEEE International Conference on Image Processing; 2003, pp 93–96.
- 99 L. Wang, T. N. Tan, W. M. Hu, and H. Z. Ning. IEEE Trans. Image Process. 2003, 12 (9), pp 1120–1131.
- 100 N. Dalal and B. Triggs. Proc. of the 18th IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2005, vol. 1, pp 886–893.
- 101 I. Bouchrika and M. Nixon. Proc. of the 8th IEEE International Conference on Automatic Face and Gesture Recognition; 2008, pp 1–6.
- 102 R. Urtasun and P. Fua. Proc. of the 6th IEEE International Conference on Automatic Face and Gesture Recognition; 2004, pp 17–22.
- 103 Z. Guoying, L. Guoyi, L. Hua, and M. Pietikainen. Proc. of the 7th IEEE International Conference on Automatic Face and Gesture Recognition; 2006, pp 529–534.
- 104 P. K. Larsen, E. B. Simonsen, and N. Lynnerup. J. Forensic Sci. 2008, 53 (5), pp 1149–1153.
- 105 M. Goffredo, I. Bouchrika, J. N. Carter, and M. S. Nixon. IEEE Trans. Syst. Man Cybern. B 2010, 40 (4), pp 997–1008.
- 106 W. Kusakunniran, Q. Wu, J. Zhang, H. Li, and L. Wang. IEEE Trans. Image Process. 2014, 23 (2), pp 696–709.
- 107 M. R. Aqmar, K. Shinoda, and S. Furui. Proc. of the 20th IEEE International Conference on Pattern Recognition; 2010, pp 2190–2193.
- 108 Y. Guan and C.-T. Li. Proc. of the 6th IAPR International Conference on Biometrics; 2013, pp 1–8.
- 109 X. Zhou and B. Bhanu. Pattern Recognit. 2008, 41 (3), pp 778–795.
- 110 D. Muramatsu, H. Iwama, Y. Makihara, and Y. Yagi. Proc. of the 6th IAPR International Conference on Biometrics; 2013, pp 1–8.
- 111 B. DeCann and A. Ross. Proc. of the 6th International Conference on Biometrics: Theory, Applications and Systems; 2013, pp 1–8.
- 112 D. S. Matovski, M. Nixon, S. Mahmoodi, and T. Mansfield. Proc. of the 21st International Conference on Pattern Recognition; 2012, pp 3272–3275.
- 113 S. Stevenage, M. Nixon, and K. Vince. Appl. Cogn. Psychol. 1999, 13, pp 513–526.
Citing Literature
Wiley Encyclopedia of Electrical and Electronics Engineering
Browse other articles of this reference work: