Mobile application for receipt fraud detection based on optical character recognition

Sorin Liviu Jurj; Allen-Jasmin Farcas; Flavius Opritoiu; Mircea Vladutiu

doi:10.1117/12.2556377

31 January 2020 Mobile application for receipt fraud detection based on optical character recognition

Sorin Liviu Jurj, Allen-Jasmin Farcas, Flavius Opritoiu, Mircea Vladutiu

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 114330A (2020) https://doi.org/10.1117/12.2556377
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

This paper presents a method for detecting receipt fraud by implementing an Object Character Recognition (OCR) algorithm composed of Image Processing Techniques and Convolutional Neural Networks (CNNs). We implemented two CNN models into a smartphone application that gives customers the option to take pictures of products they intend to buy (also to crop their price tags) while present in a hypermarket/supermarket as well as of the paid receipt and succeeds to automatically identify and compare all prices (multiple digits including decimals) of the products seen at the shelf and all prices found in the paid receipt, received from the cashier. This application helps the customer detect a receipt fraud due to a computer or human error, in a cheap and convenient way. Experimental results show 99.96% overall test accuracy for the CNN responsible for identifying product prices and 99.35% overall test accuracy for the CNN responsible for identifying receipt prices.

Citation Download Citation

Sorin Liviu Jurj, Allen-Jasmin Farcas, Flavius Opritoiu, and Mircea Vladutiu "Mobile application for receipt fraud detection based on optical character recognition", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114330A (31 January 2020); https://doi.org/10.1117/12.2556377

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Optical character recognition

Image processing

Data modeling

Cameras

Image segmentation

Computing systems

Detection and tracking algorithms

Show All Keywords

Keywords/Phrases

Search In:

Publication Years