The data processing inequality and stochastic resonance

Mark D. McDonnell; Nigel G. Stocks; Charles E. M. Pearce; Derek Abbott

doi:10.1117/12.496992

Translator Disclaimer

7 May 2003 Data processing inequality and stochastic resonance

Mark D. McDonnell, Nigel G. Stocks, Charles E. M. Pearce, Derek Abbott

Author Affiliations +

Proceedings Volume 5114, Noise in Complex Systems and Stochastic Dynamics; (2003) https://doi.org/10.1117/12.496992
Event: SPIE's First International Symposium on Fluctuations and Noise, 2003, Santa Fe, New Mexico, United States

Abstract

The data processing inequality of information theory states that given random variables X, Y and Z which form a Markov chain in the order X-->Y-->Z, then the mutual information between X and Y is greater than or equal to the mutual information between X and Z. That is I(X) >= I(X;Z) . In practice, this means that no more information can be obtained out of a set of data then was there to begin with, or in other words, there is a bound on how much can be accomplished with signal processing. However, in the field of stochastic resonance, it has been reported that a signal to noise ratio gain can occur in some nonlinear systems due to the addition of noise. Such an observation appears to contradict the data processing inequality. In this paper, we investigate this question by using an example model system.

Citation Download Citation

Mark D. McDonnell, Nigel G. Stocks, Charles E. M. Pearce, and Derek Abbott "Data processing inequality and stochastic resonance", Proc. SPIE 5114, Noise in Complex Systems and Stochastic Dynamics, (7 May 2003); https://doi.org/10.1117/12.496992

ACCESS THE FULL ARTICLE