Security and forensics exploration of learning-based image coding

Bhowmik, Deepayan and Elawady, Mohamed and Nogueira, Keiller; (2022) Security and forensics exploration of learning-based image coding. In: 2021 International Conference on Visual Communications and Image Processing (VCIP). IEEE International Conference on Visual Communications and Image Processing (VCIP) . IEEE, Piscataway, NJ, pp. 1-5. ISBN 9781728185514 (https://doi.org/10.1109/VCIP53242.2021.9675445)

[thumbnail of Bhowmik-etal-VCIP-2021-Security-and-forensics-exploration-of-learning-based-image-coding]
Preview
Text. Filename: Bhowmik_etal_VCIP_2021_Security_and_forensics_exploration_of_learning_based_image_coding.pdf
Accepted Author Manuscript
License: Strathprints license 1.0

Download (4MB)| Preview

Abstract

Advances in media compression indicate significant potential to drive future media coding standards, e.g., Joint Photographic Experts Group's learning-based image coding technologies (JPEG AI) and Joint Video Experts Team's (JVET) deep neural networks (DNN) based video coding. These codecs in fact represent a new type of media format. As a dire consequence, traditional media security and forensic techniques will no longer be of use. This paper proposes an initial study on the effectiveness of traditional watermarking on two state-of-the-art learning based image coding. Results indicate that traditional watermarking methods are no longer effective. We also examine the forensic trails of various DNN architectures in the learning based codecs by proposing a residual noise based source identification algorithm that achieved 79% accuracy.