Combination of visual and semantic criteria for automated selection of region proposals in a bounding box

Mohamed-Hicham Leghettas; Robin Deléarde; Camille Kurtz; Laurent Wendling

doi:10.1117/12.2622448

4 March 2022 Combination of visual and semantic criteria for automated selection of region proposals in a bounding box

Mohamed-Hicham Leghettas, Robin Deléarde, Camille Kurtz, Laurent Wendling

Proceedings Volume 12084, Fourteenth International Conference on Machine Vision (ICMV 2021); 120840E (2022) https://doi.org/10.1117/12.2622448
Event: Fourteenth International Conference on Machine Vision (ICMV 2021), 2021, Rome, Italy

Abstract

Deep learning based techniques have been widely used for semantic segmentation. The underlying voluminous DNN models are trained on large datasets that have been annotated at the pixel level by humans. Such low-level annotation tasks are expensive to obtain for newly collected datasets. Alternatively, we propose ComViSe, a segmentation pipeline that requires only high-level annotations that remain relatively accessible (e.g., bounding boxes and labels of a detection, labels of a legend) to segment a given image. ComViSe embeds a segmentation framework, pre-trained on a semantically different dataset, to generate image region proposals. The pipeline relies then on several semantic, visual and geometric criteria to characterize each proposed region, and combines them to select the optimal segmentation mask, comparing diverse aggregation strategies from handcrafted formula to automatic ones, supervised or not. An experimental study conducted on the PASCAL VOC dataset shows that these effectively combined criteria are enough to select the mask proposals with the best IoU score in most cases, and that the aggregation can be done automatically.

Citation Download Citation

Mohamed-Hicham Leghettas, Robin Deléarde, Camille Kurtz, and Laurent Wendling "Combination of visual and semantic criteria for automated selection of region proposals in a bounding box", Proc. SPIE 12084, Fourteenth International Conference on Machine Vision (ICMV 2021), 120840E (4 March 2022); https://doi.org/10.1117/12.2622448

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available