Codebook cardinality spectrum of distributed arithmetic codes for stationary memoryless binary sources

Fang, Yong and Stankovic, Vladimir (2020) Codebook cardinality spectrum of distributed arithmetic codes for stationary memoryless binary sources. IEEE Transactions on Information Theory, 66 (10). pp. 6580-6596. ISSN 0018-9448 (https://doi.org/10.1109/TIT.2020.3014965)

[thumbnail of Fang-Stankovic-IEEE-TIT-2020-Codebook-cardinality-spectrum-of-distributed-arithmetic-codes]
Preview
 Text. Filename: Fang_Stankovic_IEEE_TIT_2020_Codebook_cardinality_spectrum_of_distributed_arithmetic_codes.pdf
Accepted Author Manuscript
Download (517kB)| Preview

Abstract

It was demonstrated that, as a nonlinear implementation of Slepian-Wolf Coding, Distributed Arithmetic Coding (DAC) outperforms traditional Low-Density Parity-Check (LPDC) codes for short code length and biased sources. This fact triggers research efforts into theoretical analysis of DAC. In our previous work, we proposed two analytical tools, Codebook Cardinality Spectrum (CCS) and Hamming Distance Spectrum, to analyze DAC for independent and identically-distributed (i.i.d.) binary sources with uniform distribution. This article extends our work on CCS from uniform i.i.d. binary sources to biased i.i.d. binary sources. We begin with the final CCS and then deduce each level of CCS backwards by recursion. The main finding of this article is that the final CCS of biased i.i.d. binary sources is not uniformly distributed over [0, 1). This article derives the final CCS of biased i.i.d. binary sources and proposes a numerical algorithm for calculating CCS effectively in practice. All theoretical analyses are well verified by experimental results.

ORCID iDs

Fang, Yong and Stankovic, Vladimir ORCID logoORCID: https://orcid.org/0000-0002-1075-2420;
  • Item type:Article
    ID code:72669
    Dates:
    Date
    Event
    October 2020
    Published
    7 August 2020
    Published Online
    29 May 2020
    Accepted
    Notes:© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
    Keywords:distributed source coding, Slepian-Wolf coding, distributed arithmetic coding, codebook cardinality spectrum, biased sources, Electronic computers. Computer science, Library Science. Information Science, Library and Information Sciences, Information Systems, Computer Science Applications
    Subjects:Science > Mathematics > Electronic computers. Computer science
    Bibliography. Library Science. Information Resources > Library Science. Information Science
    Department:Faculty of Engineering > Electronic and Electrical Engineering
    Depositing user: Pure Administrator
    Date deposited:10 Jun 2020 13:11
    Last modified:09 Feb 2022 01:30
    Related URLs:
    URI:https://strathprints.strath.ac.uk/id/eprint/72669
CORE (COnnecting REpositories)