Using online handwriting and audio streams for mathematical expressions recognition: a bimodal approach

Sofiane Medjkoune; Harold Mouchère; Simon Petitrenaud; Christian Viard-Gaudin

doi:10.1117/12.2007847

4 February 2013 Using online handwriting and audio streams for mathematical expressions recognition: a bimodal approach

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin

Proceedings Volume 8658, Document Recognition and Retrieval XX; 865810 (2013) https://doi.org/10.1117/12.2007847
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

The work reported in this paper concerns the problem of mathematical expressions recognition. This task is known to be a very hard one. We propose to alleviate the difficulties by taking into account two complementary modalities. The modalities referred to are handwriting and audio ones. To combine the signals coming from both modalities, various fusion methods are explored. Performances evaluated on the HAMEX dataset show a significant improvement compared to a single modality (handwriting) based system.

Citation Download Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, and Christian Viard-Gaudin "Using online handwriting and audio streams for mathematical expressions recognition: a bimodal approach", Proc. SPIE 8658, Document Recognition and Retrieval XX, 865810 (4 February 2013); https://doi.org/10.1117/12.2007847

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available