The Complementary Nature of Different NLP Toolkits for Named Entity Recognition in Social Media

• Type: Article in International Conference Proceedings Book
• Date: 2017

Authors

Nuno Mateus (Author) FCUP; Figueira, A (Author) FCUP

Conference proceedings International

Title: PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2017)

Pages: 803-814

18th EPIA Conference on Artificial Intelligence (EPIA)

Univ Porto, Fac Engn, Porto, PORTUGAL, SEP 05-08, 2017

Indexing

ISI Web of Knowledge - 2 Citations

Scopus - 2 Citations

Other information

Authenticus ID: P-00M-YF0

DOI: 10.1007/978-3-319-65340-2_65

Abstract (EN): In this paper we study the combined use of four different NLP toolkits-Stanford CoreNLP, GATE, OpenNLP and Twitter NLP tools-in the context of social media posts. Previous studies have shown performance comparisons between these tools, both on news and social media corporas. In this paper, we go further by trying to understand how differently these toolkits predict Named Entities, in terms of their precision and recall for three different entity types, and how they can complement each other in this task in order to achieve a combined performance superior to each individual one. Experiments on two publicly available datasets from the workshops WNUT-2015 and #MSM2013 show that using an ensemble of toolkits can improve the recognition of specific entity types - up to 10.62% for the entity type Person, 1.97% for the type Location and 1.31% for the type Organization, depending on the dataset and the criteria used for the voting. Our results also showed improvements of 3.76% and 1.69%, in each dataset respectively, on the average performance of the three entity types.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 12