Semantic communication based complexity scalable image transmission system for resource constrained devices

Samarathunga, Prabhath and Ganearachchi, Yasith Lakmal and Fernando, Thanuj and Thanippulige, Lahiru Deshan and Fernando, Anil; (2024) Semantic communication based complexity scalable image transmission system for resource constrained devices. In: 2024 IEEE Gaming, Entertainment, and Media Conference (GEM). 2024 IEEE Gaming, Entertainment, and Media Conference (GEM) . IEEE, ITA. ISBN 9798350374537 (https://doi.org/10.1109/GEM61861.2024.10585490)

[thumbnail of Samarathunga-etal-IEEE-GEM-2024-Semantic-communication-based-complexity-scalable-image-transmission-system]
Preview
Text. Filename: Samarathunga-etal-IEEE-GEM-2024-Semantic-communication-based-complexity-scalable-image-transmission-system.pdf
Accepted Author Manuscript
License: Creative Commons Attribution 4.0 logo

Download (1MB)| Preview

Abstract

Multimedia traffic is expanding at an astonishing rate and is finding its way into many new applications, including wireless sensor networks and devices from the Internet of Things. However, the bandwidth and energy requirements associated with them are becoming increasingly prohibitive, challenging the sustainability of many communication networks. Semantic communications offer a novel approach to overcome bandwidth limitations, but the complexity of encoders and decoders limits their application in resources-constrained devices. We propose a semantic communication-based complexity-scalable image transmission system that uses asymmetric autoencoders to shift the complexity of the system to the encoder or decoder without compromising on human and machine perceived quality. Using a test data set, we demonstrate that the complexity can be shifted between the two without affecting the overall performance of the semantic communication system. This concept will be significant in the implementation of wireless sensor networks based on semantic communication and Internet of Things applications, while also providing a novel tool to further improve conventional encoder simplification approaches, such as distributed coding. Furthermore, the realization of energy efficient sensors by utilizing semantic communications and complexity scalability will have a direct impact on achieving sustainable development goals related to energy usage and management in media communications.

ORCID iDs

Samarathunga, Prabhath, Ganearachchi, Yasith Lakmal ORCID logoORCID: https://orcid.org/0000-0002-8337-3739, Fernando, Thanuj, Thanippulige, Lahiru Deshan and Fernando, Anil;