Spatial encoding of visual words for image classification

Dong Liu; Shengsheng Wang; Fatih Porikli

doi:10.1117/1.JEI.25.3.033008

Abstract

Appearance-based bag-of-visual words (BoVW) models are employed to represent the frequency of a vocabulary of local features in an image. Due to their versatility, they are widely popular, although they ignore the underlying spatial context and relationships among the features. Here, we present a unified representation that enhances BoVWs with explicit local and global structure models. Three aspects of our method should be noted in comparison to the previous approaches. First, we use a local structure feature that encodes the spatial attributes between a pair of points in a discriminative fashion using class-label information. We introduce a bag-of-structural words (BoSW) model for the given image set and describe each image with this model on its coarsely sampled relevant keypoints. We then combine the codebook histograms of BoVW and BoSW to train a classifier. Rigorous experimental evaluations on four benchmark data sets demonstrate that the unified representation outperforms the conventional models and compares favorably to more sophisticated scene classification techniques.

Citation Download Citation

Dong Liu, Dong Liu, Shengsheng Wang, Shengsheng Wang, Fatih Porikli, Fatih Porikli, } "Spatial encoding of visual words for image classification," Journal of Electronic Imaging 25(3), 033008 (31 May 2016). https://doi.org/10.1117/1.JEI.25.3.033008 . Submission:

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $20.00

Non-members: $25.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years