MEASURING THE PERFORMANCE OF ORDINAL CLASSIFICATION

• Type: Article in International Scientific Journal
• Date: 2011

Authors

Jaime S Cardoso (Author) FEUP; Ricardo Sousa (Author) Other

Journal

Title: International Journal of Pattern Recognition and Artificial Intelligence

Vol. 25 No. 8

Pages: 1173-1195

ISSN: 0218-0014

Publisher: World Scientific

Indexing

ISI Web of Knowledge - 33 Citations

ISI Web of Science

Scopus - 45 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-002-J0V

DOI: 10.1142/s0218001411009093

Abstract (EN): Ordinal classification is a form of multiclass classification for which there is an inherent order between the classes, but not a meaningful numeric differerence between them. The performance of such classifiers is usually assessed by measures appropriate for nominal classes or for regression. Unfortunately, these do not account for the true dimension of the error. The goal of this work is to show that existing measures for evaluating ordinal classification models surffer from a number of important shortcomings. For this reason, we propose an alternative measure defined directly in the confusion matrix. An error coefficient appropriate for ordinal data should capture how much the result diverges from the ideal prediction and how "inconsistent" the classifier is in regard to the relative order of the classes. The proposed coefficient results from the observation that the performance yielded by the Misclassification Error Rate coefficient is the benefit of the path along the diagonal of the confusion matrix. We carry out an experimental study which confirms the usefulness of the novel metric.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 23