A Task Scheduling Policy for Heterogeneous MapReduce Cluster
Chiu Chui-Ming, Huang Sheng-Wei, Huang Tzu-Chi, Shieh Ce-Kuen, Tsai Ming-Fong, Chen Lien-Wu
Abstract
Chiu Chui-Ming, Huang Sheng-Wei, Huang Tzu-Chi, Shieh Ce-Kuen, Tsai Ming-Fong, Chen Lien-Wu
Abstract
MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.
Key concepts: Computer science, Scheduling (production processes), Distributed computing, Cluster (spacecraft), Parallel computing, Task (project management), Operating system, Mathematical optimization