Event recognition in personal photo collections via multiple instance learning-based classification of multiple images

Kashif Ahmad; Nicola Conci; Giulia Boato; Francesco G. B. De Natale

doi:10.1117/1.JEI.26.6.060502

5 December 2017 Event recognition in personal photo collections via multiple instance learning-based classification of multiple images

Kashif Ahmad, Nicola Conci, Giulia Boato, Francesco G. B. De Natale

Author Affiliations +

Journal of Electronic Imaging, Vol. 26, Issue 6, 060502 (December 2017). https://doi.org/10.1117/1.JEI.26.6.060502

Abstract

Over the last few years, a rapid growth has been witnessed in the number of digital photos produced per year. This rapid process poses challenges in the organization and management of multimedia collections, and one viable solution consists of arranging the media on the basis of the underlying events. However, album-level annotation and the presence of irrelevant pictures in photo collections make event-based organization of personal photo albums a more challenging task. To tackle these challenges, in contrast to conventional approaches relying on supervised learning, we propose a pipeline for event recognition in personal photo collections relying on a multiple instance-learning (MIL) strategy. MIL is a modified form of supervised learning and fits well for such applications with weakly labeled data. The experimental evaluation of the proposed approach is carried out on two large-scale datasets including a self-collected and a benchmark dataset. On both, our approach significantly outperforms the existing state-of-the-art.

Citation Download Citation

Kashif Ahmad, Nicola Conci, Giulia Boato, and Francesco G. B. De Natale "Event recognition in personal photo collections via multiple instance learning-based classification of multiple images," Journal of Electronic Imaging 26(6), 060502 (5 December 2017). https://doi.org/10.1117/1.JEI.26.6.060502

Received: 30 May 2017; Accepted: 15 November 2017; Published: 5 December 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available