The application of Shannon's information metric is considered within the context of specifying physically realizable economic and technologic performance constraints, such as the maximization of returned information (bits/dollars), or the minimization of expected informational redundancy. The robustness of the selected doctrine is examined as a function of the classification resolution, and the marginal effects, e.g., entropies, of additional data sets (or observation variables) are also investigated relative to the enhancement of the discrimination surfaces.
AARON N. SILVER,
"Pattern Recognition And Classification: An Information Theory Approach", Proc. SPIE 0018, Pattern Recognition Studies I, (9 December 1969); doi: 10.1117/12.946828; https://doi.org/10.1117/12.946828