An Analysis of Performance Metrics for Imbalanced Classification

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2021

Autores

Gaudreault, JG (Autor) Outra; Branco, P (Autor) Outra; João Gama (Autor) FEP

Ata de Conferência Internacional

Título: DS

Páginas: 67-77

24th International Conference on Discovery Science, DS 2021

11 October 2021 through 13 October 2021

Indexação

ISI Web of Knowledge - 26 Citações

Scopus - 32 Citações

Outras Informações

ID Authenticus: P-00V-H9B

DOI: 10.1007/978-3-030-88942-5_6

Abstract (EN): Numerous machine learning applications involve dealing with imbalanced domains, where the learning focus is on the least frequent classes. This imbalance introduces new challenges for both the performance assessment of these models and their predictive modeling. While several performance metrics have been established as baselines in balanced domains, some cannot be applied to the imbalanced case since the use of the majority class in the metric could lead to a misleading evaluation of performance. Other metrics, such as the area under the precision-recall curve, have been demonstrated to be more appropriate for imbalance domains due to their focus on class-specific performance. There are, however, many proposed implementations for this particular metric, which could potentially lead to different conclusions depending on the one used. In this research, we carry out an experimental study to better understand these issues and aim at providing a set of recommendations by studying the impact of using different metrics and different implementations of the same metric under multiple imbalance settings. © 2021, Springer Nature Switzerland AG.

Idioma: Inglês

Tipo (Avaliação Docente): Científica