Exploring data sampling techniques for imbalanced classification problems

Yu Sui; Xiaohui Zhang; Jiajia Huan; Haifeng Hong

doi:10.1117/12.2540457

31 July 2019 Exploring data sampling techniques for imbalanced classification problems

Yu Sui, Xiaohui Zhang, Jiajia Huan, Haifeng Hong

Proceedings Volume 11198, Fourth International Workshop on Pattern Recognition; 1119813 (2019) https://doi.org/10.1117/12.2540457
Event: Fourth International Workshop on Pattern Recognition, 2019, Nanjing, China

Abstract

The class imbalance problem is one of the key challenges in machine learning and data mining. Imbalanced data can result in the sub-optimal performance of classification models. To address the problem, a variety of data sampling methods have been proposed in previous studies. However, there is no universal solution and it is worth to explore which kind of data sampling technique is more effective in balancing class distribution in terms of the type of data and classifier. In this work, we present an experimental study based on a number of real-world data sets obtained from different disciplines. The goal is to investigate different sampling techniques in terms of the effectiveness of increasing the classification performance in imbalanced data sets. In particular, we study ten sampling methods of different types, including random sampling, clusterbased sampling, ensemble sampling and so on. Besides, the C4.5 decision tree algorithm is used to train the base classifiers and the performance is measured by using precision, G-Measure and Cohen's Kappa statistic.

Citation Download Citation

Yu Sui, Xiaohui Zhang, Jiajia Huan, and Haifeng Hong "Exploring data sampling techniques for imbalanced classification problems", Proc. SPIE 11198, Fourth International Workshop on Pattern Recognition, 1119813 (31 July 2019); https://doi.org/10.1117/12.2540457

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available