Online evaluation of email streaming classifiers using GNUsmail

• Type: Article in International Conference Proceedings Book
• Date: 2011

Authors

Carmona Cejudo, JM (Author) Other; Baena Garcia, M (Author) Other; Del Campo Avila, J (Author) Other; Bifet, A (Author) Other; João Gama (Author) FEP; Morales Bueno, R (Author) Other

Conference proceedings International

Title: ADVANCES IN INTELLIGENT DATA ANALYSIS X: IDA 2011

Pages: 90-100

10th International Symposium on Intelligent Data Analysis

Porto, PORTUGAL, OCT 29-31, 2011

Indexing

ISI Web of Knowledge - 1 Citation

Scopus - 1 Citation

Other information

Authenticus ID: P-008-0ZY

DOI: 10.1007/978-3-642-24800-9_11

Abstract (EN): Real-time email classification is a challenging task because of its online nature, subject to concept-drift. Identifying spam, where only two labels exist, has received great attention in the literature. We are nevertheless interested in classification involving multiple folders, which is an additional source of complexity. Moreover, neither cross-validation nor other sampling procedures are suitable for data streams evaluation. Therefore, other metrics, like the prequential error, have been proposed. However, the prequential error poses some problems, which can be alleviated by using mechanisms such as fading factors. In this paper we present GNUsmail, an open-source extensible framework for email classification, and focus on its ability to perform online evaluation. GNUsmail's architecture supports incremental and online learning, and it can be used to compare different online mining methods, using state-of-art evaluation metrics. We show how GNUsmail can be used to compare different algorithms, including a tool for launching replicable experiments. © 2011 Springer-Verlag.

Language: English

Type (Professor's evaluation): Scientific