An Analysis of Performance Metrics for Imbalanced Classification

• Type: Article in International Conference Proceedings Book
• Date: 2021

Authors

Gaudreault, JG (Author) Other; Branco, P (Author) Other; João Gama (Author) FEP

Conference proceedings International

Title: DS

Pages: 67-77

24th International Conference on Discovery Science, DS 2021

11 October 2021 through 13 October 2021

Indexing

ISI Web of Knowledge - 26 Citations

Scopus - 32 Citations

Other information

Authenticus ID: P-00V-H9B

DOI: 10.1007/978-3-030-88942-5_6

Abstract (EN): Numerous machine learning applications involve dealing with imbalanced domains, where the learning focus is on the least frequent classes. This imbalance introduces new challenges for both the performance assessment of these models and their predictive modeling. While several performance metrics have been established as baselines in balanced domains, some cannot be applied to the imbalanced case since the use of the majority class in the metric could lead to a misleading evaluation of performance. Other metrics, such as the area under the precision-recall curve, have been demonstrated to be more appropriate for imbalance domains due to their focus on class-specific performance. There are, however, many proposed implementations for this particular metric, which could potentially lead to different conclusions depending on the one used. In this research, we carry out an experimental study to better understand these issues and aim at providing a set of recommendations by studying the impact of using different metrics and different implementations of the same metric under multiple imbalance settings. © 2021, Springer Nature Switzerland AG.

Language: English

Type (Professor's evaluation): Scientific