Enhanced semantic communications and VVC based hybrid video coding system

Samarathunga, Prabhath and Ganearachchi, Yasith and Fernando, Thanuj and Jayasingam, Adhuran and Sivalingam, Thushan and Rajatheva, Nandana and Fernando, Anil (2026) Enhanced semantic communications and VVC based hybrid video coding system. IEEE Access, 14. pp. 50755-50778. ISSN 2169-3536 (https://doi.org/10.1109/access.2026.3676702)

[thumbnail of Samarathunga-etal-IEEEA-2026-Enhanced-semantic-communications-and-VVC-based-hybrid-video-coding-system]
Preview
Text. Filename: Samarathunga-etal-IEEEA-2026-Enhanced-semantic-communications-and-VVC-based-hybrid-video-coding-system.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo

Download (2MB)| Preview

Abstract

Video, the dominant media format on the Internet, is pushing conventional video coding techniques to their limits with a wide range of bandwidth-intensive and delay-sensitive applications. This phenomenon is creating renewed interest in learned video coding, and building on the principles of semantic communications, it has the potential to enhance and augment the effectiveness of the video coding process. We propose a semantics-based video codec implemented using autoencoders and the integration of bidirectional hierarchical frame prediction into semantic encoding and decoding. This approach aims to better exploit temporal redundancies in video without requiring extensive training or presharing of trained neural networks. It exceeds the rate-distortion performance of the state-of-the-art in both conventional and learned video codecs for the test scenarios and demonstrates better tolerance to bitstream errors compared to the latest conventional video codecs. The proposed system demonstrates the potential to evolve into a new video coding paradigm that consistently outperforms state-of-the-art conventional and learned video codecs, particularly for emerging applications where semantic communication systems are becoming integral.

ORCID iDs

Samarathunga, Prabhath, Ganearachchi, Yasith ORCID logoORCID: https://orcid.org/0000-0002-8337-3739, Fernando, Thanuj, Jayasingam, Adhuran, Sivalingam, Thushan, Rajatheva, Nandana and Fernando, Anil ORCID logoORCID: https://orcid.org/0000-0002-2158-2367;