UbiDis: a Flexible and General top-level Middleware to Manage Applications in Grids and Clusters

• Type: Article in International Conference Proceedings Book
• Date: 2009

Authors

Nuno A Fonseca (Author) Other; Ines Dutra (Author) FCUP

Conference proceedings International

Title: IBERGRID: 3RD IBERIAN GRID INFRASTRUCTURE CONFERENCE PROCEEDINGS

Pages: 247-255

3rd Iberian Grid Infrastructure Conference (IBERGRID)

Valencia, SPAIN, MAY 20-22, 2009

Indexing

ISI Web of Knowledge - 0 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-003-QA7

Abstract (EN): From an application point of view, the Grid computing with its powerful processing power and large amounts of data storage offers the possibility to process large quantities of data, to run computationally-intensive operations, or both. For instance, in computational biological pipelines, one often has to process large quantities of data in individually computationally-intensive operations. To process this data in the Grid, hundreds, or even thousands of jobs need to be submitted and their results processed. Obviously, performing these tasks manually is unfeasible. On the other hand, developing software to this end, specifically for a single application, is unproductive because if the application changes, or the Grid submission engine changes, then the code needs to be rewritten. In this paper we present a middleware that facilitates the submission of jobs to grids (or clusters) and helps handling their results. The middleware, that we call UbiDis (Ubiquitous Distribution), copies all files necessary for running the program to the UI or front-end host (in a Grid or cluster), compiles programs on the UI or front-end (if necessary), generates and submits the jobs, and copies the outputs to the local machine. Furthermore, UbiDis transparently generates jobs to different job managers, allowing the user to easily and quickly change the location to where the jobs are submitted. Finally, we illustrate the usefulness of UbiDis using two applications.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 9