Anomaly detection-based undersampling for imbalanced classification problems

• Type: Article in International Scientific Journal
• Date: 2024

Authors

Park, YJ (Author) Other; brito, p (Author) FEP; Ma, YC (Author) Other

Journal

Title: Engineering Optimization

Vol. 56 No. 12

Pages: 2565-2578

ISSN: 0305-215X

Publisher: Taylor & Francis

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-010-2P1

DOI: 10.1080/0305215x.2024.2315501

Abstract (EN): In various machine learning applications, classification plays an important role in categorizing and predicting data. To improve the classification performance, it is crucial to identify and remove the anomalies. Also, class imbalance in many machine learning applications is a very common problem since most classifiers tend to be biased toward the majority class by ignoring the minority class instances. Thus, in this research, we propose a new under-sampling technique based on anomaly detection and removal to enhance the performance of imbalanced classification problems. To demonstrate the effectiveness of the proposed method, comprehensive experiments are conducted on forty imbalanced data sets and two non-parametric hypothesis tests are employed to show the statistical difference in classification performances between the proposed method and other traditional resampling methods. From the experiment, it is shown that the proposed method improves the classification performance by effectively detecting and eliminating the anomalies among true-majority or pseudo-majority class instances.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 14