Autonomous detection of damage to multiple steel surfaces from 360° panoramas using deep neural networks

Luo, Cai and Yu, Leijian and Yan, Jiaxing and Li, Zongwei and Ren, Peng and Bai, Xiao and Yang, Erfu and Liu, Yonghong (2021) Autonomous detection of damage to multiple steel surfaces from 360° panoramas using deep neural networks. Computer-Aided Civil and Infrastructure Engineering. ISSN 1467-8667

[thumbnail of Luo-etal-CACIE-2021-Autonomous-detection-of-damage-to-multiple-steel-surfaces-from-360-panoramas] Text (Luo-etal-CACIE-2021-Autonomous-detection-of-damage-to-multiple-steel-surfaces-from-360-panoramas)
Accepted Author Manuscript
Restricted to Repository staff only until 24 March 2022.

Download (21MB) | Request a copy from the Strathclyde author


    Structural health assessments are essential for infrastructure. By using an autonomous panorama vision‐based inspection system, the limitations of the human cost and safety factors of previously time‐consuming tasks have been overcome. The main damage detection challenges to panorama images are (1) the lack of annotated panorama defect image data, (2) detection in high‐resolution images, and (3) the inherent distortion disturbance for panorama images. In this paper, a new PAnoramic surface damage DEtection Network (PADENet) is presented to solve the challenges by (a) using an unmanned aerial vehicle to capture panoramic images and a distorted panoramic augmentation method to expand the panoramic dataset, (b) employing the proposed multiple projection methods to process high‐resolution images, and (c) modifying the faster region‐based convolutional neural network and training via transfer learning on VGG‐16, which improves the precision for detecting multiple types of damage in distortion. The results show that the proposed method is optimal for surface damage detection.

    ORCID iDs

    Luo, Cai, Yu, Leijian, Yan, Jiaxing, Li, Zongwei, Ren, Peng, Bai, Xiao, Yang, Erfu ORCID logoORCID: and Liu, Yonghong;