Semi-Automatic Creation of a Reference News Corpus for Fine-Grained Multi-Label Scenarios

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2011

Autores

teixeira, j (Autor) FEUP; sarmento, l (Autor) Outra; oliveira, e (Autor) FEUP

Ata de Conferência Internacional

Título: SISTEMAS E TECNOLOGIAS DE INFORMACAO, VOL I

Páginas: 749-754

6th Iberian Information Systems and Technologies Conference

Chaves, PORTUGAL, JUN 15-18, 2011

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Classificação Científica

FOS: Ciências exactas e naturais > Ciências da computação e da informação

Outras Informações

ID Authenticus: P-002-ZHS

Abstract (EN): In this paper we tackle the problem of creating a reference corpus for the classification of news items in fine-grained multi-label scenarios. These scenarios are particularly challenging for text classification techniques, and the availability of reference corpora is one important bottleneck for developing and testing new classification strategies. We propose a semiautomatic approach for creating a reference corpus that uses three auxiliary classification methods - one based on Support Vector Machines, one based on Nearest Neighbor Classifiers and another based on a dictionary-based classification heuristic - for suggesting to human annotators topic-related labels that can be used to describe different facets of a given news item being annotated. Using such approach, we semi-automatically produce a corpus of 1,600 news items with 865 different labels, having in average 3.63 labels per news item. We evaluate the contribution of each of the auxiliary classification methods to the annotation process and we conclude that: (i) none of the methods alone is capable of suggesting all relevant labels, (ii) a dictionary-based classification heuristic contributes significantly and (iii) the Nearest Neighbor classifier performs very efficiently in the most extreme multi-label part of the problem and is robust to the very unbalanced item-to-class distribution.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 6