Development of a minaturised forwards looking imager using deep learning for responsive operations

Greenland, Steve and Ireland, Murray and Kobayashi, Chisato and Mendham, Peter and Post, Mark and White, David; (2018) Development of a minaturised forwards looking imager using deep learning for responsive operations. In: 4S Symposium 2018. ESA, Noordwijk.

[thumbnail of Greenland-etal-4S-2018-minaturised-forwards-looking-imager-using-deep-learning-for-responsive-operations]
Preview
 Text. Filename: Greenland_etal_4S_2018_minaturised_forwards_looking_imager_using_deep_learning_for_responsive_operations.pdf
Accepted Author Manuscript
Download (627kB)| Preview

Abstract

This work presents the design and prototyping work of a miniaturised camera system with integrated ‘deep learning’ neural network capabilities, developed within a framework for implementing autonomous data processing onboard small and nanosatellites. The framework targets low-resource algorithms developed in other sectors including autonomous vehicles and commercial machine learning. For proof of concept, the system has been initially trained for real time cloud detection and classification, looking 1 min ahead of the satellite to enable responsive decision making for Earth observation and telecommunication applications. The design has been miniaturised and modularised to allow accommodation on small and nanosatellite systems. Flight representative and heritage components have been selected for prototyping. Compatibility of the autonomy framework with ECSS and CCSDS standards and existing off-the-shelf flight software was evaluated. A simulator to facilitate end to end testing of the system has been developed using existing data sets as input, incorporating distortions to test robustness. Results show that a competitive low power < 2 W system can be delivered, with the chain < 5 seconds from capture to input into the onboard planning and with timing consistent with continuous real time decision-making.

  • Item type:Book Section
    ID code:63922
    Dates:
    Date
    Event
    28 May 2018
    Published
    28 February 2018
    Accepted
    Notes:Title changed from "Design & prototyping of a minaturised forwards looking imager using deep learning for responsive onboard operations" to "Development of a miniaturised forwards looking imager using deep learning for responsive onboard operations" after acceptance.
    Subjects:Technology > Motor vehicles. Aeronautics. Astronautics
    Department:Faculty of Engineering > Design, Manufacture and Engineering Management
    Depositing user: Pure Administrator
    Date deposited:02 May 2018 10:09
    Last modified:26 Apr 2024 00:07
    URI:https://strathprints.strath.ac.uk/id/eprint/63922
CORE (COnnecting REpositories)