Semi-Automatic Creation of a Reference News Corpus for Fine-Grained Multi-Label Scenarios

• Type: Article in International Conference Proceedings Book
• Date: 2011

Authors

teixeira, j (Author) FEUP; sarmento, l (Author) Other; oliveira, e (Author) FEUP

Conference proceedings International

Title: SISTEMAS E TECNOLOGIAS DE INFORMACAO, VOL I

Pages: 749-754

6th Iberian Information Systems and Technologies Conference

Chaves, PORTUGAL, JUN 15-18, 2011

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-002-ZHS

Abstract (EN): In this paper we tackle the problem of creating a reference corpus for the classification of news items in fine-grained multi-label scenarios. These scenarios are particularly challenging for text classification techniques, and the availability of reference corpora is one important bottleneck for developing and testing new classification strategies. We propose a semiautomatic approach for creating a reference corpus that uses three auxiliary classification methods - one based on Support Vector Machines, one based on Nearest Neighbor Classifiers and another based on a dictionary-based classification heuristic - for suggesting to human annotators topic-related labels that can be used to describe different facets of a given news item being annotated. Using such approach, we semi-automatically produce a corpus of 1,600 news items with 865 different labels, having in average 3.63 labels per news item. We evaluate the contribution of each of the auxiliary classification methods to the annotation process and we conclude that: (i) none of the methods alone is capable of suggesting all relevant labels, (ii) a dictionary-based classification heuristic contributes significantly and (iii) the Nearest Neighbor classifier performs very efficiently in the most extreme multi-label part of the problem and is robust to the very unbalanced item-to-class distribution.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6