2015•Frontiers in artificial intelligence and applicationsRequires access

A Task Scheduling Policy for Heterogeneous MapReduce Cluster

Chiu Chui-Ming, Huang Sheng-Wei, Huang Tzu-Chi, Shieh Ce-Kuen, Tsai Ming-Fong, Chen Lien-Wu

Open publisher page 0 citations

Abstract

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

About this research paper

What this paper is about

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

Key concepts: Computer science, Scheduling (production processes), Distributed computing, Cluster (spacecraft), Parallel computing, Task (project management), Operating system, Mathematical optimization

Related papers

Back to paper searchBrowse research topicsOriginal source
A Task Scheduling Policy for Heterogeneous MapReduce Cluster — Research Paper | ScholarLens