Improved classification approach for use with large-scale scene images in the Hadoop cluster environment

Jianfang Cao; Yanfei Li; Yan Wang; Hongyan Cui; Yun Tian

doi:10.1117/1.JEI.27.6.063027

19 December 2018 Improved classification approach for use with large-scale scene images in the Hadoop cluster environment

Jianfang Cao, Yanfei Li, Yan Wang, Hongyan Cui, Yun Tian

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 6, 063027 (December 2018). https://doi.org/10.1117/1.JEI.27.6.063027

Abstract

Faced with massive amounts of image data, the performance of classification algorithms based on traditional platforms with single-node architecture drops dramatically. We propose a classification method based on hybrid optimization and combination technology in a cluster environment that is suitable for use with large-scale scene images. Support vector machine (SVM) algorithms are optimized by the artificial bee colony and particle swarm optimization algorithms to produce weak classifiers; then, a strong classifier is constructed by combining the outputs from the 15 weak classifiers using the AdaBoost algorithm. The MapReduce parallel programming model in the Hadoop platform is used to parallelize the algorithm, and a parallel AdaBoost hybrid optimization (PAH)-SVM algorithm is proposed. Finally, a model is constructed for automatic classification of the large-scale scene images. Multiple sets of comparative experiments show that the average classification accuracy of the proposed algorithm when applied to the scene understanding (Caltech-256 and Pascal VOC 2012) database exceeds 85.0%, and its training time is <10 min when 170,000 images are used. Considering the cost of hardware, the execution time and accuracy of this algorithm are superior to those of mainstream classification algorithms, such as P-SVM and CNN. In addition, the speed of the system based on the proposed algorithm increases linearly, and the constructed Hadoop cluster shows good extensibility. The proposed algorithm is suitable for automatic classification and prediction using large-scale scene images.

Citation Download Citation

Jianfang Cao, Yanfei Li, Yan Wang, Hongyan Cui, and Yun Tian "Improved classification approach for use with large-scale scene images in the Hadoop cluster environment," Journal of Electronic Imaging 27(6), 063027 (19 December 2018). https://doi.org/10.1117/1.JEI.27.6.063027

Received: 14 May 2018; Accepted: 27 November 2018; Published: 19 December 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image classification

Scene classification

Data modeling

Optimization (mathematics)

Databases

Particle swarm optimization

Computer programming

Show All Keywords

Keywords/Phrases

Search In:

Publication Years