28 January 2008 Whole-book recognition using mutual-entropy-driven model adaptation
Author Affiliations +
We describe an approach to unsupervised high-accuracy recognition of the textual contents of an entire book using fully automatic mutual-entropy-based model adaptation. Given images of all the pages of a book together with approximate models of image formation (e.g. a character-image classifier) and linguistics (e.g. a word-occurrence probability model), we detect evidence for disagreements between the two models by analyzing the mutual entropy between two kinds of probability distributions: (1) the a posteriori probabilities of character classes (the recognition results from image classification alone), and (2) the a posteriori probabilities of word classes (the recognition results from image classification combined with linguistic constraints). The most serious of these disagreements are identified as candidates for automatic corrections to one or the other of the models. We describe a formal information-theoretic framework for detecting model disagreement and for proposing corrections. We illustrate this approach on a small test case selected from real book-image data. This reveals that a sequence of automatic model corrections can drive improvements in both models, and can achieve a lower recognition error rate. The importance of considering the contents of the whole book is motivated by a series of studies, over the last decade, showing that isogeny can be exploited to achieve unsupervised improvements in recognition accuracy.
© (2008) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Pingping Xiu, Pingping Xiu, Henry S. Baird, Henry S. Baird, } "Whole-book recognition using mutual-entropy-driven model adaptation", Proc. SPIE 6815, Document Recognition and Retrieval XV, 681506 (28 January 2008); doi: 10.1117/12.767121; https://doi.org/10.1117/12.767121


Efficient method of image edge detection based on FSVM
Proceedings of SPIE (July 19 2013)
Multiple-agent adaptation in whole-book recognition
Proceedings of SPIE (January 24 2011)
Font adaptation of an HMM-based OCR system
Proceedings of SPIE (January 18 2010)

Back to Top