Operational neural networks for parameter-efficient hyperspectral single-image super-resolution
Ulrichsen, Alexander and Murray, Paul and Marshall, Stephen and Gabbouj, Moncef and Kiranyaz, Serkan and Yamaç, Mehmet and Aburaed, Nour (2023) Operational neural networks for parameter-efficient hyperspectral single-image super-resolution. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17. pp. 1470-1484. ISSN 2151-1535 (https://doi.org/10.1109/JSTARS.2023.3333274)
Preview |
Text.
Filename: Ulrichsen-etal-IEEE-JSTAEORS-Operational-neural-networks-for-parameter-efficient-hyperspectral-single-image-super-resolution.pdf
Final Published Version License: Download (5MB)| Preview |
Abstract
Hyperspectral imaging is a crucial tool in remote sensing, which captures far more spectral information than standard color images. However, the increase in spectral information comes at the cost of spatial resolution. Super-resolution is a popular technique where the goal is to generate a high-resolution version of a given low-resolution input. The majority of modern super-resolution approaches use convolutional neural networks (CNNs). However, convolution itself is a linear operation and the networks rely on the nonlinear activation functions after each layer to provide the necessary nonlinearity to learn the complex underlying function. This means that CNNs tend to be very deep to achieve the desired results. Recently, self-organized operational neural networks (ONNs) have been proposed that aim to overcome this limitation by replacing the convolutional filters with learnable nonlinear functions through the use of MacLaurin series expansions. This work focuses on extending the convolutional filters of a popular super-resolution model to more powerful operational filters to enhance the model performance on hyperspectral images (HSIs). We also investigate the effects that residual connections and different normalization types have on this type of enhanced network. Despite having fewer parameters than their convolutional network equivalents, our results show that ONNs achieve superior super-resolution performance on small HSI datasets.
ORCID iDs
Ulrichsen, Alexander, Murray, Paul ORCID: https://orcid.org/0000-0002-6980-9276, Marshall, Stephen ORCID: https://orcid.org/0000-0001-7079-5628, Gabbouj, Moncef, Kiranyaz, Serkan, Yamaç, Mehmet and Aburaed, Nour ORCID: https://orcid.org/0000-0002-5906-0249;-
-
Item type: Article ID code: 87234 Dates: DateEvent14 December 2023Published7 November 2023Accepted29 August 2023SubmittedSubjects: Science > Mathematics > Electronic computers. Computer science Department: Faculty of Engineering > Electronic and Electrical Engineering
Strategic Research Themes > Measurement Science and Enabling Technologies
Technology and Innovation Centre > Sensors and Asset ManagementDepositing user: Pure Administrator Date deposited: 08 Nov 2023 13:01 Last modified: 26 Sep 2024 00:54 URI: https://strathprints.strath.ac.uk/id/eprint/87234