Prolog programming with a map-reduce parallel construct

• Type: Article in International Conference Proceedings Book
• Date: 2013

Authors

Corte Real, J (Author) Other; Dutra, I (Author) FCUP; Rocha, R (Author) FCUP

Conference proceedings International

Title: Proceedings of the 15th Symposium on Principles and Practice of Declarative Programming, PPDP 2013

Pages: 285-296

15th Symposium on Principles and Practice of Declarative Programming, PPDP 2013

Madrid, 16 September 2013 through 18 September 2013

Indexing

ISI Web of Knowledge

Scopus - 3 Citations

Scientific classification

FOS: Natural sciences

Other information

Authenticus ID: P-008-EWR

DOI: 10.1145/2505879.2505882

Abstract (EN): Map-Reduce is a programming model that has its roots in early functional programming. In addition to producing short and elegant code for problems involving lists or collections, this model has proven very useful for large-scale highly parallel data processing. In this work, we present the design and implementation of a high-level parallel construct that makes the Map-Reduce programming model available for Prolog programmers. To the best of our knowledge, there is no Map-Reduce framework native to Prolog, and so the aim of this work is to offer data processing features from which several applications can greatly benefit; the Inductive Logic Programming field, for instance, can take advantage of a Map-Reduce predicate when proving newly created rules against sets of examples. Our Map-Reduce model was comprehensively tested with different applications. Our experiments, using the Yap Prolog system, show that: (i) the model scales linearly up to 24 processors; (ii) a dynamic distributed scheduling strategy performs better than centralized or static scheduling strategies; and (iii) the performance varies significantly with the number of items being sent to each processor at a time. Overall, our Map-Reduce framework presents as a good alternative for both taking advantage of the currently available low cost multi-core architectures and developing scalable data processing applications, native to the Prolog programming language. © 2013 ACM.

Language: English

Type (Professor's evaluation): Scientific