Volume 29, Issue 8 e2974
RESEARCH ARTICLE

Pixelwise asphalt concrete pavement crack detection via deep learning-based semantic segmentation method

Ju Huyan

Ju Huyan

School of Transportation, Southeast University, Nanjing, China

Search for more papers by this author
Tao Ma

Corresponding Author

Tao Ma

School of Transportation, Southeast University, Nanjing, China

Correspondence

Tao Ma, School of Transportation, Southeast University, Southeast University Road, Jiangning District, Nanjing 211189, China.

Email: [email protected]

Search for more papers by this author
Wei Li

Wei Li

School of Information Engineering, Chang'an University, Xi'an, China

Search for more papers by this author
Handuo Yang

Handuo Yang

School of Transportation, Southeast University, Nanjing, China

Search for more papers by this author
Zhengchao Xu

Zhengchao Xu

School of Information Engineering, Chang'an University, Xi'an, China

Search for more papers by this author
First published: 05 April 2022
Citations: 31

Funding information: Fundamental Research Funds for the Central University of China, Grant/Award Numbers: 300102249306, 300102249301; National Key R&D Program of China, Grant/Award Numbers: 2021YFB2600600, 2021YFB2600604; National Natural Science Foundation of China, Grant/Award Number: 52108403

Summary

Explicit gaps exist between the advanced deep learning technologies and the less satisfied pixel-level crack detection algorithms. Therefore, this research sought to bridge this gap via outlining the deep neural network model for pixelwise pavement crack detection. Two state-of-the-art deep neural network models are constructed for the semantic segmentation of crack images. The first architecture, VGGCrackU-net, is composed of 10 3 × 3 convolutional layers, 4 max-pooling layers, 4 up-sampling layers, and 4 concatenate operations. Another architecture, ResCrackU-net, is composed of 7-level residual units with a total of 22 convolutional layers. Asphalt concrete pavement crack images are collected by smartphones, action cameras, and automatic pavement monitoring systems from diverse functional classes of AC pavements. The crack images are manually labeled and double-checked by trained operators for quality insurance. After that, 500 crack images are randomly divided into training, validating, and test datasets according to the ratio of 3:1:1. Both architectures are trained on GPU facilitated Keras platform with Python version of 3.5, which demonstrated fast convergence. Results prove that the proposed models exhibit significant advantages for pixelwise crack detection when compared with the performance of widely used FCN net and PSPnet. Meanwhile, ResCrackU-net slightly outperforms VGGCrackU-net, which, however, can provide acceptable results as well. Though significant false negative and false positive errors are observed in both network models, the contributions are noticeable, which can provide innovative guidance for future work in figuring out solutions to the problems.

DATA AVAILABILITY STATEMENT

The dataset used in this research is open available to researchers and can be found in the author's GitHub address (https://github.com/juhuyan/CrackDataset_DL_HY).

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.