• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2014, Vol. 36 ›› Issue (11): 2054-2060.

• 论文 • Previous Articles     Next Articles

An energy-saving algorithm for
MapReduce-based virtual cluster       

DENG Danting1,TENG Fei1,2,LI Tianrui1,YANG Hao1   

  1. (1.School of Information Science and Technology,Southwest Jiaotong University,Chengdu  610031;
    2.State key Laboratory for Novel Software Technology,Nanjing University,Nanjing 210023,China)
  • Received:2014-06-10 Revised:2014-08-21 Online:2014-11-25 Published:2014-11-25

Abstract:

In the global energy crisis, many researchers begin to pay close attention to the problem of data centers’ energy consumption. On the premise of meeting the users’ demand, reducing the active nodes of adata center can effectively reduce the whole energy consumption. Virtual machine migration is a traditional way to reduce active nodes, but causes huge system cost. An energysaving algorithm for MapReducebased virtual cluster, named Online Time Balance Algorithm (OTBA), is proposed. The proposed algorithm can reduce the number of active physical nodes, reduce the energy consumption effectively, and avoid migrating the virtual machines. The objective function and the variable factors are determined by building the energy consumption model, the queue model and the MapReduce performance model. Since OTBA is based on virtual cloud environment and online MapReduce, it can make a  tradeoff between the runtime of virtual machines and the resource utilization so as to minimize the number of the activated physical servers in the data center and the energy consumption. At last, the algorithm is validated through experiments in simulation environment and on Hadoop platform.

Key words: energy efficiency;VM placement;online;MapReduce;cloud computing