Mitigating RGB-D camera errors for robust ultrasonic inspections using a force-torque sensor

Tabatabaeipour, Morteza and Jackson, William and Gilmour, Adam and Zhang, Dayi and Poole, Alastair and Tzaferis, Konstantinos and Dobie, Gordon and Gachagan, Anthony (2024) Mitigating RGB-D camera errors for robust ultrasonic inspections using a force-torque sensor. Nondestructive Testing and Evaluation. ISSN 1058-9759 (https://doi.org/10.1080/10589759.2024.2386618)

[thumbnail of Tabatabaeipour-etal-NTE-2024-Mitigating-RGB-D-camera-errors-for-robust-ultrasonic-inspections]
Preview
 Text. Filename: Tabatabaeipour-etal-NTE-2024-Mitigating-RGB-D-camera-errors-for-robust-ultrasonic-inspections.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (7MB)| Preview

Abstract

Robot-based phased array ultrasonic testing is widely used for precise defect detection, particularly in complex geometries and various materials. Compact robots with miniature arms can inspect constrained areas, but payload limitations restrict sensor choice. RGB-D cameras, due to their small size and light weight, capture RGB colour and depth data, creating colourised 3D point clouds for scene representation. These point clouds help estimate surface normals to align the ultrasound transducer on complex surfaces. However, sole reliance on RGB-D cameras can lead to inaccuracies, affecting ultrasonic beam direction and test results. This paper investigates the impact of transducer pose and RGB-D camera limitations on ultrasonic inspections and proposes a novel method using force-torque sensors to mitigate errors from inaccurately estimated normals from the camera. The force-torque sensor, integrated into the robot end effector, provides tactile feedback to the controller, enabling joint angle adjustments to correct errors in the estimated normal. Experimental results show the successful application of ultrasound transducers using this method, even with significant misalignment. Adjustments took approximately 4 seconds to correct deviations from 12.55°, with an additional 4 seconds to ensure the probe was parallel to the surface, enhancing ultrasonic inspection accuracy in complex, constrained environments.

ORCID iDs

Tabatabaeipour, Morteza, Jackson, William ORCID logoORCID: https://orcid.org/0000-0002-1360-4722, Gilmour, Adam ORCID logoORCID: https://orcid.org/0009-0006-3636-2398, Zhang, Dayi ORCID logoORCID: https://orcid.org/0000-0003-4611-4161, Poole, Alastair, Tzaferis, Konstantinos, Dobie, Gordon ORCID logoORCID: https://orcid.org/0000-0003-3972-5917 and Gachagan, Anthony ORCID logoORCID: https://orcid.org/0000-0002-9728-4120;
CORE (COnnecting REpositories)