Acceptance Decision Prediction in Peer-Review Through Sentiment Analysis

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2021

Autores

Ana Carolina Ribeiro (Autor) Outra; Amanda Sizo (Autor) Outra; Henrique Lopes Cardoso (Autor) FEUP; Luís Paulo Reis (Autor) FEUP

Ata de Conferência Internacional

Título: PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2021)

Páginas: 766-777

20th EPIA Conference on Artificial Intelligence (EPIA)

ELECTR NETWORK, SEP 07-09, 2021

Indexação

ISI Web of Knowledge - 1 Citação

Scopus - 1 Citação

Outras Informações

ID Authenticus: P-00V-CPG

DOI: 10.1007/978-3-030-86230-5_60

Abstract (EN): Peer-reviewing is considered the main mechanism for quality control of scientific publications. The editors of journals and conferences assign submitted papers to reviewers, who review them. Therefore, inconsistencies between reviewer recommendations and reviewer comments are a problem that the editor needs to handle. However, few studies have explored whether it is possible to predict the reviewer recommendation from review comments based on NLP techniques. This study aims to predict reviewer recommendation of the scientific papers they review (accept or reject) and predict reviewers' final scores. We used a dataset composed of 2,313 review texts from two computer science conferences to test our approach, based on seven ML algorithms on regression and classification tasks and VADER application. SVM and MLP Classifier achieved the best performance in the classification task. In the regression task, the best performance was achieved by Nearest Neighbors. One of the most interesting results is the positive classification of most reviews by VADER: reviewers present constructively written reviews without highly negative comments land; therefore, VADER cannot detect reviews with a negative score.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 12