A Game with a Purpose for Building Crowdsourced Semantic Relations Datasets for Named Entities

• Type: Article in International Conference Proceedings Book
• Date: 2023

Authors

dos Santos, AF (Author) Other; José Paulo Leal (Author) FCUP

Conference proceedings International

Title: Lecture Notes in Networks and Systems

Pages: 422-439

Proceedings of the Computing Conference 2023

London, 22 June 2023 through 23 June 2023

Indexing

Scopus - 0 Citations

Other information

Authenticus ID: P-00Z-4TE

DOI: 10.1007/978-3-031-37963-5_30

Abstract (EN): Semantic measures evaluate and compare the strength of relations between entities. To assess their accuracy, semantic measures are compared against human-generated gold standards. Existing semantic gold standards are mainly focused on concepts. Nevertheless, semantic measures are frequently applied both to concepts and instances. Games with a purpose are used to offload to humans computational or data collection needs, improving results by using entertainment as motivation for higher engagement. We present Grettir, a system which allows the creation of crowdsourced semantic relations datasets for named entities through a game with a purpose where participants are asked to compare pairs of entities. We describe the system architecture, the algorithms and implementation decisions, the first implemented instance ¿ dedicated to the comparison of music artists ¿ and the results obtained. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 17