Combining meta-learning and search techniques to select parameters for support vector machines

• Tipo: Artigo em Revista Científica Internacional
• Data: 2012

Autores

Taciana A F Gomes (Autor) Outra; Ricardo B C Prudencio (Autor) Outra; Carlos Soares (Autor) FEP; Andre L D Rossi (Autor) Outra; Andre Carvalho (Autor) Outra

Revista

Título: Neurocomputing

Vol. 75 Nº 1

Páginas: 3-13

ISSN: 0925-2312

Editora: Elsevier

Indexação

ISI Web of Knowledge - 86 Citações

Scopus - 105 Citações

Classificação Científica

FOS: Ciências exactas e naturais > Ciências da computação e da informação

Outras Informações

ID Authenticus: P-002-HHW

DOI: 10.1016/j.neucom.2011.07.005

Abstract (EN): Support Vector Machines (SVMs) have achieved very good performance on different learning problems. However, the success of SVMs depends on the adequate choice of the values of a number of parameters (e.g., the kernel and regularization parameters). In the current work, we propose the combination of meta-learning and search algorithms to deal with the problem of SVM parameter selection. In this combination, given a new problem to be solved, meta-learning is employed to recommend SVM parameter values based on parameter configurations that have been successfully adopted in previous similar problems. The parameter values returned by meta-learning are then used as initial search points by a search technique, which will further explore the parameter space. In this proposal, we envisioned that the initial solutions provided by meta-learning are located in good regions of the search space (i.e. they are closer to optimum solutions). Hence, the search algorithm would need to evaluate a lower number of candidate solutions when looking for an adequate solution. In this work, we investigate the combination of meta-learning with two search algorithms: Particle Swarm Optimization and Tabu Search. The implemented hybrid algorithms were used to select the values of two SVM parameters in the regression domain. These combinations were compared with the use of the search algorithms without meta-learning. The experimental results on a set of 40 regression problems showed that, on average, the proposed hybrid methods obtained lower error rates when compared to their components applied in isolation.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 11