Domain randomisation and CNN-based keypoint-regressing pose initialisation for relative navigation with uncooperative finite-symmetric spacecraft targets using monocular camera images

Kajak, Karl Martin and Maddock, Christie and Frei, Heike and Schwenk, Kurt (2023) Domain randomisation and CNN-based keypoint-regressing pose initialisation for relative navigation with uncooperative finite-symmetric spacecraft targets using monocular camera images. Advances in Space Research, 72 (7). pp. 2824-2844. ISSN 0273-1177 (https://doi.org/10.1016/j.asr.2023.02.024)

[thumbnail of Kajak-etal-ASR-2023-Domain-randomisation-and-CNN-based-keypoint-regressing-pose-initialisation]
Preview
 Text. Filename: Kajak_etal_ASR_2023_Domain_randomisation_and_CNN_based_keypoint_regressing_pose_initialisation.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (14MB)| Preview

Abstract

Vision-based relative navigation technology is a key enabler of several areas of the space industry such as on-orbit servicing, space debris removal, and formation flying. A particularly demanding scenario is navigating relative to a non-cooperative target that does not offer any navigational aid and is unable to stabilise its attitude. This research integrates a convolutional neural network (CNN) and an EPnP-solver in a pose initialisation system. The system's performance is benchmarked on images gathered from the European Proximity Operations Simulator EPOS 2.0 laboratory. A synthetic dataset is generated using Blender as a rendering engine. A segmentation-based pose estimation CNN is trained using the synthetic dataset and the resulting pose estimation performance is evaluated on a set of real images gathered from the cameras of the EPOS 2.0 robotic close-range relative navigation laboratory. It is demonstrated that a synthetic-image-trained CNN-based pose estimation pipeline is able to successfully perform in a close-range visual relative navigation setting on real camera images of a 6-facet symmetrical spacecraft.

ORCID iDs

Kajak, Karl Martin, Maddock, Christie ORCID logoORCID: https://orcid.org/0000-0003-1079-4863, Frei, Heike and Schwenk, Kurt;
CORE (COnnecting REpositories)