MEASURING THE PERFORMANCE OF ORDINAL CLASSIFICATION

• Tipo: Artigo em Revista Científica Internacional
• Data: 2011

Autores

Jaime S Cardoso (Autor) FEUP; Ricardo Sousa (Autor) Outra

Revista

Título: International Journal of Pattern Recognition and Artificial Intelligence

Vol. 25 Nº 8

Páginas: 1173-1195

ISSN: 0218-0014

Editora: World Scientific

Indexação

ISI Web of Knowledge - 33 Citações

ISI Web of Science

Scopus - 45 Citações

Classificação Científica

FOS: Ciências exactas e naturais > Ciências da computação e da informação

Outras Informações

ID Authenticus: P-002-J0V

DOI: 10.1142/s0218001411009093

Abstract (EN): Ordinal classification is a form of multiclass classification for which there is an inherent order between the classes, but not a meaningful numeric differerence between them. The performance of such classifiers is usually assessed by measures appropriate for nominal classes or for regression. Unfortunately, these do not account for the true dimension of the error. The goal of this work is to show that existing measures for evaluating ordinal classification models surffer from a number of important shortcomings. For this reason, we propose an alternative measure defined directly in the confusion matrix. An error coefficient appropriate for ordinal data should capture how much the result diverges from the ideal prediction and how "inconsistent" the classifier is in regard to the relative order of the classes. The proposed coefficient results from the observation that the performance yielded by the Misclassification Error Rate coefficient is the benefit of the path along the diagonal of the confusion matrix. We carry out an experimental study which confirms the usefulness of the novel metric.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 23