Estimation of mutual information using copula density function

Zeng, X. and Durrani, T. S. (2011) Estimation of mutual information using copula density function. Electronics Letters, 47 (8). pp. 493-494. ISSN 0013-5194 (https://doi.org/10.1049/el.2011.0778)

Full text not available in this repository.

Abstract

The dependence between random variables may be measured by mutual information. However, the estimation of mutual information is difficult since the estimation of the joint probability density function (PDF) of non-Gaussian distributed data is a hard problem. Copulas offer a natural approach for estimating mutual information, since the joint probability density function of random variables can be expressed as the product of the associated copula density function and marginal PDFs. The experiment demonstrates that the proposed copulas-based mutual information is much more accurate than conventional methods such as the joint histogram and Parzen window based mutual information that are widely used in image processing.