Ensembles of jittered association rule classifiers

• Type: Article in International Scientific Journal
• Date: 2010

Authors

Paulo J Azevedo (Author) Other; Alipio Mario Jorge (Author) FCUP

Journal

Title: Data Mining and Knowledge Discovery

Vol. 21

Pages: 91-129

ISSN: 1384-5810

Publisher: Springer Nature

Indexing

ISI Web of Knowledge - 9 Citations

ISI Web of Science

Scopus - 9 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-003-554

DOI: 10.1007/s10618-010-0173-y

Abstract (EN): The ensembling of classifiers tends to improve predictive accuracy. To obtain an ensemble with N classifiers, one typically needs to run N learning processes. In this paper we introduce and explore Model Jittering Ensembling, where one single model is perturbed in order to obtain variants that can be used as an ensemble. We use as base classifiers sets of classification association rules. The two methods of jittering ensembling we propose are Iterative Reordering Ensembling (IRE) and Post Bagging (PB). Both methods start by learning one rule set over a single run, and then produce multiple rule sets without relearning. Empirical results on 36 data sets are positive and show that both strategies tend to reduce error with respect to the single model association rule classifier. A bias-variance analysis reveals that while both IRE and PB are able to reduce the variance component of the error, IRE is particularly effective in reducing the bias component. We show that Model Jittering Ensembling can represent a very good speed-up w.r.t. multiple model learning ensembling. We also compare Model Jittering with various state of the art classifiers in terms of predictive accuracy and computational efficiency.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 39