2013Procedia Computer ScienceOpen access

MapReduce Operations with WS-VLAM Workflow Management System

Mikołaj Baranowski, Adam Belloum, Marian Bubak

Open full text 4 citations

Abstract

Workflow management systems are widely used to solve scientific problems as they enable orchestration of remote and lo- cal services such as database queries, job submission and running an application. To extend the role that workflow systems play in data-intensive science, we propose a solution that integrates WMS and MapReduce model. In this paper, we discuss possible solution of combining MapReduce and workflow applications, we describe the implementation of chosen solution based on metaprogramming approach in Ruby programming language and evaluate it with an example of word count application.

About this research paper

What this paper is about

Workflow management systems are widely used to solve scientific problems as they enable orchestration of remote and lo- cal services such as database queries, job submission and running an application. To extend the role that workflow systems play in data-intensive science, we propose a solution that integrates WMS and MapReduce model. In this paper, we discuss possible solution of combining MapReduce and workflow applications, we describe the implementation of chosen solution based on metaprogramming approach in Ruby programming language and evaluate it with an example of word count application.

Why it matters

OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Workflow management systems are widely used to solve scientific problems as they enable orchestration of remote and lo- cal services such as database queries, job submission and running an application. To extend the role that workflow systems play in data-intensive science, we propose a solution that integrates WMS and MapReduce model. In this paper, we discuss possible solution of combining MapReduce and workflow applications, we describe the implementation of chosen solution based on metaprogramming approach in Ruby programming language and evaluate it with an example of word count application.

Key concepts: Computer science, Orchestration, Workflow, Metaprogramming, Workflow management system, Workflow technology, Workflow engine, Software engineering

Related papers

Back to paper searchBrowse research topicsOriginal source
MapReduce Operations with WS-VLAM Workflow Management System — Research Paper | ScholarLens