Access to SPIE eBooks is limited to subscribing institutions. Access is not available as part of an individual subscription. However, books can be purchased on SPIE.Org
Chapter 4:
Maximum-Entropy Density Estimation
Published: 2011
DOI: 10.1117/3.903451.ch4

4.1 Introduction

An uncertain system yields random outputs even for deterministic inputs. Consequently, design and analysis of such systems require faithful models of this uncertainty. In a statistical framework, these models are typically specified by probability distributions, which are often unknown a priori and must therefore be estimated from available data or information. Unfortunately, the observed uncertainty may not be uniquely specified by a single distribution. In this case, unique densities are obtained by constraining candidate densities to satisfy additional optimality criteria. Motivated by the principles of information theory, we now detail how entropy may be used as one such constraint.

Online access to SPIE eBooks is limited to subscribing institutions.

Statistical analysis

Systems modeling

Data modeling


Data analysis

Information theory

Statistical modeling

Back to Top