About the journal

• Home page
• Contact information
• Aims and scope
• Indexing information
• Editorial policies
• ComSIS consortium
• Journal boards
• Managing board

For authors

• Information for contributors
• Paper submission
• Article submission through OJS
• Copyright transfer form
• Download section

For readers

• Forthcoming articles
• Current issue
• Archive

For reviewers

• View and review submissions

News

• Journal's Facebook page
• Calls for special issues
• New issue notification

Selective Ensemble Learning Algorithm for Imbalanced Dataset

Hongle Du^{1, 2, 3}, Yan Zhang^{1, 3}, Lin Zhang^{1, 3} and Yeh-Cheng Chen⁴

1. School of Mathematics and Computer Application, Shangluo University
   726000, Shangluo, China
   {dhl5597,flyingzhang,zhlin002}@163.com
2. University of the Cordilleras
   aguio City, Philippines
3. Shangluo Public Big Data Research Center
   726000, Shangluo, China
4. Department of computer science, University of California
   Davis, CA, USA
   ycch@ucdavis.edu

Abstract

Under the imbalanced dataset, the performance of the base-classifier, the computing method of weight of base-classifier and the selection method of the base-classifier have a great impact on the performance of the ensemble classifier. In order to solve above problem to improve the generalization performance of ensemble classifier, a selective ensemble learning algorithm based on under-sampling for imbalanced dataset is proposed. First, the proposed algorithm calculates the number K of under-sampling samples according to the relationship between class sample density. Then, we use the improved K-means clustering algorithm to under-sample the majority class samples and obtain K cluster centers. Then, all cluster centers (or the sample of the nearest cluster center) are regarded as new majority samples to construct a new balanced training subset combine with the minority class’s samples. Repeat those processes to generate multiple training subsets and get multiple base-classifiers. However, with the increasing of iterations, the number of baseclassifiers increase, and the similarity among the base-classifiers will also increase. Therefore, it is necessary to select some base-classifier with good classification performance and large difference for ensemble. In the stage of selecting base-classifiers, according to the difference and performance of baseclassifiers, we use the idea of maximum correlation and minimum redundancy to select base-classifiers. In the ensemble stage, G-mean or F-mean is selected to evaluate the classification performance of base-classifier for imbalanced dataset. That is to say, it is selected to compute the weight of each baseclassifier. And then the weighted voting method is used for ensemble. Finally, the simulation results on the artificial dataset, UCI dataset and KDDCUP dataset show that the algorithm has good generalization performance on imbalanced dataset, especially on the dataset with high imbalance degree.

Key words

Under Sampling; Imbalanced Dataset; Clustering Algorithm; Selective Ensemble Learning

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS220817023D

Publication information

Volume 20, Issue 2 (April 2023)
Special Issue on Machine Learning-based Decision Support Systems in IoT systems
Year of Publication: 2023
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

Available in PDF
Portable Document Format

How to cite

Du, H., Zhang, Y., Zhang, L., Chen, Y.: Selective Ensemble Learning Algorithm for Imbalanced Dataset. Computer Science and Information Systems, Vol. 20, No. 2, 831–856. (2023), https://doi.org/10.2298/CSIS220817023D