A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof

Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water sp...

Full description

Saved in:

Bibliographic Details
Main Author:	Muhamed Yusof, Nor Aizam
Format:	Thesis
Language:	English
Published:	2021
Subjects:	Neural networks (Computer science) Pavements and paved roads
Online Access:	https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-uitm-ir.61064
record_format	uketd_dc
spelling	my-uitm-ir.610642022-06-07T07:41:46Z A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof 2021-08 Muhamed Yusof, Nor Aizam Neural networks (Computer science) Pavements and paved roads Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water spots. These conditions will eventually result in poor visual and low contrast between cracks and the surrounding pavement. Therefore, in tackling these issues, this study proposes a fully automated pavement crack detection and classification using a new Deep Convolutional Neural Network architecture (DCNN) called hierarchical DCNN (Hi-DCNN). The image of pavement cracks is manually prepared in RGB format with a dimension of 1024×768 pixels. This image is captured using NIKON digital camera and segmented into patches (32×32 pixels) as a training dataset from the original pavement cracks. To ease these processes, this study introduces a new app, CrackLabel, that can automatically label patches in the crack images into two groups, crack and non-crack. The CrackLabel utilises a special design image thresholding algorithm known as Global and Lower Quartile Average Intensity (GLQAI). In the first part, a DCNN structure, DCNN-1, is proposed to perform crack detection based on the labelled patches as its input. This is necessary to build training and testing datasets for the network. As a result, the network managed to achieve better performance in crack detection with 98.50%, 98.85%, 98.68%, and 98.67% for recall, precision, accuracy, and F-score respectively. As for the second part involving the crack classification process, DCNN-2 is proposed to classify the detected crack images, obtained from the previous step. This stage is performed to classify images into three groups which are transverse, longitudinal, and alligator cracks. The Hi-DCNN structure achieved promising accuracy of 96.80%, 97.41%, and 95.58% for transverse, longitudinal and alligator respectively. The last part is the integration of the optimized performance networks from the Hi-DCNN, which proposes a new app system that can automatically detect and classify pavement cracks. This app can facilitate and assist civil surveyors in determining pavement distress through a simple and user-friendly interface. For future work, this study suggests a real-time automated app that allows the integration between crack images and a manual operated digital camera to facilitate the automated process. In addition, the conversion of the RGB images into HSV colour space and further evaluation on the crack depth analysis help to obtain fine-detailed information for handling network robustness. 2021-08 Thesis https://ir.uitm.edu.my/id/eprint/61064/ https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf text en public phd doctoral Universiti Teknologi MARA College of Engineering Osman, Muhammad Khusairi (Dr.)
institution	Universiti Teknologi MARA
collection	UiTM Institutional Repository
language	English
advisor	Osman, Muhammad Khusairi (Dr.)
topic	Neural networks (Computer science) Pavements and paved roads
spellingShingle	Neural networks (Computer science) Pavements and paved roads Muhamed Yusof, Nor Aizam A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
description	Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water spots. These conditions will eventually result in poor visual and low contrast between cracks and the surrounding pavement. Therefore, in tackling these issues, this study proposes a fully automated pavement crack detection and classification using a new Deep Convolutional Neural Network architecture (DCNN) called hierarchical DCNN (Hi-DCNN). The image of pavement cracks is manually prepared in RGB format with a dimension of 1024×768 pixels. This image is captured using NIKON digital camera and segmented into patches (32×32 pixels) as a training dataset from the original pavement cracks. To ease these processes, this study introduces a new app, CrackLabel, that can automatically label patches in the crack images into two groups, crack and non-crack. The CrackLabel utilises a special design image thresholding algorithm known as Global and Lower Quartile Average Intensity (GLQAI). In the first part, a DCNN structure, DCNN-1, is proposed to perform crack detection based on the labelled patches as its input. This is necessary to build training and testing datasets for the network. As a result, the network managed to achieve better performance in crack detection with 98.50%, 98.85%, 98.68%, and 98.67% for recall, precision, accuracy, and F-score respectively. As for the second part involving the crack classification process, DCNN-2 is proposed to classify the detected crack images, obtained from the previous step. This stage is performed to classify images into three groups which are transverse, longitudinal, and alligator cracks. The Hi-DCNN structure achieved promising accuracy of 96.80%, 97.41%, and 95.58% for transverse, longitudinal and alligator respectively. The last part is the integration of the optimized performance networks from the Hi-DCNN, which proposes a new app system that can automatically detect and classify pavement cracks. This app can facilitate and assist civil surveyors in determining pavement distress through a simple and user-friendly interface. For future work, this study suggests a real-time automated app that allows the integration between crack images and a manual operated digital camera to facilitate the automated process. In addition, the conversion of the RGB images into HSV colour space and further evaluation on the crack depth analysis help to obtain fine-detailed information for handling network robustness.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Muhamed Yusof, Nor Aizam
author_facet	Muhamed Yusof, Nor Aizam
author_sort	Muhamed Yusof, Nor Aizam
title	A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_short	A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_full	A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_fullStr	A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_full_unstemmed	A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_sort	hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / nor aizam muhamed yusof
granting_institution	Universiti Teknologi MARA
granting_department	College of Engineering
publishDate	2021
url	https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf
_version_	1783735206599983104

A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof

Similar Items