Scalable data analytics using crowdsourced repositories and streams

• Tipo: Artigo em Revista Científica Internacional
• Data: 2018

Autores

Veloso, B (Autor) Outra; Leal, F (Autor) Outra; Gonzalez Velez, H (Autor) Outra; Malheiro, B (Autor) Outra; Burguillo, JC (Autor) Outra

Revista

Título: Journal of Parallel and Distributed Computing

Vol. 122

Páginas: 1-10

ISSN: 0743-7315

Editora: Elsevier

Indexação

ISI Web of Knowledge - 8 Citações

Scopus - 10 Citações

Outras Informações

ID Authenticus: P-00N-ZKZ

DOI: 10.1016/j.jpdc.2018.06.013

Abstract (EN): The scalable analysis of crowdsourced data repositories and streams has quickly become a critical experimental asset in multiple fields. It enables the systematic aggregation of otherwise disperse data sources and their efficient processing using significant amounts of computational resources. However, the considerable amount of crowdsourced social data and the numerous criteria to observe can limit analytical off-line and on-line processing due to the intrinsic computational complexity. This paper demonstrates the efficient parallelisation of profiling and recommendation algorithms using tourism crowdsourced data repositories and streams. Using the Yelp data set for restaurants, we have explored two different profiling approaches: entity-based and feature-based using ratings, comments, and location. Concerning recommendation, we use a collaborative recommendation filter employing singular value decomposition with stochastic gradient descent (SVD-SGD). To accurately compute the final recommendations, we have applied post-recommendation filters based on venue suitability, value for money, and sentiment. Additionally, we have built a social graph for enrichment. Our master-worker implementation shows super-linear scalability for 10, 20, 30, 40, 50, and 60 concurrent instances.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 10