Cascade generalization

• Tipo: Artigo em Revista Científica Internacional
• Data: 2000

Autores

João Gama (Autor) FEP; Pavel Brazdil (Autor) FEP

Revista

Título: Machine Learning

Vol. 41 Nº 3

Páginas: 315-343

ISSN: 0885-6125

Editora: Springer Nature

Indexação

ISI Proceedings

ISI Web of Knowledge - 177 Citações

Scopus - 230 Citações

Classificação Científica

FOS: Ciências da engenharia e tecnologias > Outras ciências da engenharia e tecnologias

Outras Informações

ID Authenticus: P-000-YBQ

DOI: 10.1023/a:1007652114878

Abstract (EN): Using multiple classifiers for increasing learning accuracy is an active research area. In this paper we present two related methods for merging classifiers. The first method, Cascade Generalization, couples classifiers loosely. It belongs to the family of stacking algorithms. The basic idea of Cascade Generalization is to use sequentially the set of classifiers, at each step performing an extension of the original data by the insertion of new attributes. The new attributes are derived from the probability class distribution given by a base classifier. This constructive step extends the representational language for the high level classifiers, relaxing their bias. The second method exploits tight coupling of classifiers, by applying Cascade Generalization locally. At each iteration of a divide and conquer algorithm, a reconstruction of the instance space occurs by the addition of new attributes. Each new attribute represents the probability that an example belongs to a class given by a base classifier. We have implemented three Local Generalization Algorithms. The first merges a linear discriminant with a decision tree, the second merges a naive Bayes with a decision tree, and the third merges a linear discriminant and a naive Bayes with a decision tree. All the algorithms show an increase of performance, when compared with the corresponding single models. Cascade also outperforms other methods for combining classifiers, like Stacked Generalization, and competes well against Boosting at statistically significant confidence levels.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 29