Neural weight step video compression

Czerkawski, Mikolaj and Cardona, Javier and Atkinson, Robert and Michie, Craig and Andonovic, Ivan and Clemente, Carmine and Tachtatzis, Christos (2021) Neural weight step video compression. In: NeurIPS 2021 Pre-Registration Workshop, 2021-12-13 - 2021-12-13, Online.

[thumbnail of Czerkawski-etal-PreReg-2021-Neural-weight-step-video-compression]
Preview
Text. Filename: Czerkawski_etal_PreReg_2021_Neural_weight_step_video_compression.pdf
Final Published Version
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo

Download (172kB)| Preview
[thumbnail of Czerkawski-etal-PreReg-2021-Neural-weight-step-video-compression-video-summary] Video. Filename: Czerkawski_etal_PreReg_2021_Neural_weight_step_video_compression_video_summary.mp4
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo

Download (7MB)

Abstract

A variety of compression methods based on encoding images as weights of a neural network have been recently proposed. Yet, the potential of similar approaches for video compression remains unexplored. In this work, we suggest a set of experiments for testing the feasibility of compressing video using two architectural paradigms, coordinate-based MLP (CbMLP) and convolutional network. Furthermore, we propose a novel technique of neural weight stepping, where subsequent frames of a video are encoded as low-entropy parameter updates. To assess the feasibility of the considered approaches, we will test the video compression performance on several high-resolution video datasets and compare against existing conventional and neural compression techniques.