Automatic fabric defect detection using a deep convolutional neural network
Corresponding Author
Jun-Feng Jing
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorHao Ma
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorHuan-Huan Zhang
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorCorresponding Author
Jun-Feng Jing
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorHao Ma
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorHuan-Huan Zhang
School of Electronics and Information, Xi'an Polytechnic University, Xi'an, 710048 China
Search for more papers by this authorAbstract
Fabric defect detection plays an important role in the textile production process, but there are still some challenges in detecting defects rapidly and accurately. In this paper, we propose a powerful detection method for automatic fabric defect detection using a deep convolutional neural network (CNN). It consists of three main steps. First, the fabric image is decomposed into local patches and each local patch is labelled. Then the labelled patches are transmitted to the pretrained deep CNN for transfer learning. Finally, defects are detected during the inspection phase by sliding over the whole image using the trained model, and the category and position of each defect is obtained. The proposed method is validated on two public and one self-made fabric database. The experimental results demonstrate that our method significantly outperforms selected state-of-the art methods in terms of both quality and robustness.
References
- 1H Y T Ngan, G K H Pang and N H Yung, Image Vis. Comput., 29 (2011) 442.
- 2A Kumar, IEEE Trans. Ind. Electron., 55 (2008) 348.
- 3M Bennamoun and A Bodnarova, Proc. IEEE Conf. SMC., San Diego, CA, USA (1998) 4340.
- 4C S Cho, B M Chung and M J Park, IEEE Trans. Ind. Electron., 52 (2005) 1073.
- 5X Z Yang, G K H Pang and N H C Yung, Opt. Eng., 41 (2002) 3116.
- 6C Kwak, J A Ventura and K Tofang-Sazi, Intell Data Anal., 5 (2001) 355.
10.3233/IDA-2001-5406 Google Scholar
- 7R T Chin and C A Harlow, IEEE Trans. Pattern Anal. Mach. Intell., 4 (1982) 557.
- 8E J Wood, Text. Res. J., 60 (1990) 212.
- 9F Tajeripour and E Kabir, Proc. of the Int. Conf. on Comput. Intel. and Multimed. Appl., Sivakasi, Tamil Nadu, India (2007) 261.
- 10C H Chan and G Pang, IEEE Trans. Ind. Appl., 36 (2000) 1267.
- 11D M Tsai and T Y Huang, Image Vis. Comput., 21 (2003) 307.
- 12D M Tsai and C H Chiang, Image Vis. Comput., 21 (2003) 413.
- 13J Jing, A Dong and P Li, Opt. Eng., 56 (2017) 1.
- 14L H Hoffer, F Francini, B Tiribilli and G Longobardi, Opt. Eng., 35 (1996) 3183.
- 15D Zhu, R Pan, W Gao and J Zhang, Autex Res. J., 15 (2015) 226.
- 16D Yapi, M Allili and N Baaziz, IEEE Trans. Autom. Sci. Eng., 99 (2017) 1.
- 17G Oh, S Lee and S Yong Shin, Pattern Recognit. Lett., 20 (1999) 191.
- 18Y LeCun, B E Boser, J S Denker, D Henderson, R E Howard, W E Hubbard and L D Jackel, NIPS., Denver, CO, USA (1989) 396.
- 19H Y T Ngan, G K H Pang and N H C Yung, Pattern Recogn., 41 (2008) 1878.
- 20A Latif-Amet, A Ertüzün and A Erçil, Image Vis. Comput., 18 (2000) 543.
- 21H Sari-Sarraf and J S Goddard, IEEE Trans. Ind. Applicat., 35 (1999) 1252.
- 22X Yang, G Pang and N Yung, Pattern Recogn., 37 (2004) 889.
- 23H Y T Ngan, G K H Pang, S P Yung and M K Ng, Pattern Recogn., 38 (2005) 559.
- 24C Guo, Q Ma and L Zhang, CVPR., Anchorage, AK, USA (2008) 1063.
- 25J G Campbell, A A Hasim and F D Murtagh, ISSC (Ireland: Univ. Ulster, 1997) 97.
- 26F S Cohen, Z Fau and S Attali, IEEE Trans. Pattern Anal. Mach. Intell., 13 (1991) 803.
- 27M S Allili, N Baaziz and M Mejri, IEEE Trans. Multimedia, 16 (2014) 772.
- 28J Long, E Shelhamer and T Darrell, CVPR (Boston, MA, USA: Hynes Convention Center, 2015) 1.
- 29Y LeCun, Y Bengio and G Hinton, Nature, 521 (2015) 436.
- 30S Faghih-Roohi, S Hajizadeh, A Núñez, R Babuska and B D Schutter, Proc. Int. Joint Conf. Neural Netw., Vancouver, BC, Canada (2016) 2584.
- 31X Bian, S N Lim and N Zhou, Proc. WACV, Lake Placid, NY, USA (2016) 1.
- 32D Cireşan, U Meier, J Masci and J Schmidhuber, Neural Netw., 32 (2012) 333.
- 33Y Lou, G Fu, Z Jiang, A Men and Y Zhou, IEEE GlobalSIP, Montreal, QC, Canada (2017) 1280.
- 34P Sermanet, K Kavukcuoglu, S Chintala and Y Lecun, CVPR (Portland, OR, USA: Oregon Convention Center, 2013) 3626.
- 35R Vaillant, C Monricq and Y Le Cun, IEE Proc. Vis. Image Signal Process., 141 (1994) 245.
10.1049/ip-vis:19941301 Google Scholar
- 36C Garcia and M Delakis, IEEE Trans. Pattern Anal. Mach. Intell., 26 (2004) 1408.
- 37Y Taigman, M Yang, M Ranzato and L Wolf, CVPR (Columbus, OH, USA: Greater Columbus Convention Center, 2014) 1701.
- 38J Jing, X Fan and P Li, J. Text. Res., 38 (2017) 68.
- 39R Ren, T Hung and K C Tan, IEEE Trans. Cybern., 48 (2017) 929.
- 40P F Felzenszwalb and D P Huttenlocher, Int. J. Comput. Vis., 59 (2004) 167.
- 41J Jing, P Yang and P Li, J. Text. Res., 36 (2015) 98.
- 42A Santoro, S Bartunov, M Botvinick, D Wierstra and T Lillicrap, International Conference on Machine Learning, New York City, NY, USA (2016) 1842.
- 43J Snell, K Swersky and R Zemel, NIPS (Long Beach, CA, USA: Long Beach Convention Center, 2017) 30.
- 44O Vinyals, C Blundell, T Lillicrap, K Kavukcuoglu and D Wierstra, NIPS (Barcelona Spain: Centre Convencions Internacional Barcelona, 2016) 29.
- 45H C Shin, H R Roth, M Gao, L Lu, Z Xu, I Nogues, J Yao, D Mollura and R M Summers, IEEE Trans. Med. Imaging, 35 (2016) 1285.
- 46J Lu, V Behbood, P Hao, H Zuo, S Xue and G Zhang, Knowl.-Based Syst., 80 (2015) 14.
- 47Y Lecun, L Bottou, Y Bengio and P Haffner, Proc. IEEE, 86 (1998) 2278.
- 48J Deng, W Dong, R Socher, L Li, K Li and F Li, CVPR, Miami, FL, USA (2009) 248.
- 49A Krizhevsky, I Sutskever and G Hinton, NIPS, Lake Tahoe, NV, USA (2012) 1095.
- 50K Simonyan and A Zisserman, ICLR, San Diego, CA, USA (2015).
- 51C Szegedy, W Liu, Y Jia, P Sermanet, S Reed, D Anguelov, D Erhan, V Vanhoucke and A Rabinovich, CVPR (Boston, MA, USA: Hynes Convention Center, 2015) 1.
- 52K He, X Zhang, S Ren and J Sun, CVPR (Boston, MA, USA: Hynes Convention Center, 2015) 770.