Computer Engineering & Science
Previous Articles Next Articles
HU Ya-hong1,SHENG Xia2,Mao Jia-fa1
Received:
2019-08-15
Revised:
2019-11-04
Online:
2020-02-25
Published:
2020-02-25
HU Ya-hong1,SHENG Xia2,Mao Jia-fa1.
[1] | Qin X,Jiang H.A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heteroge-neous clusters[J].Journal of Parallel & Distributed Computing,2005,65(8):885-900. |
[2] | Zhu X,He C,Li K,et al.Adaptive energy-efficient scheduling for real-time tasks on DVS-enabled heterogeneous clusters[J].Journal of Parallel & Distributed Computing,2012,72(6):751-763. |
[3] | Feng Xing-jie, He Yang. Improvement of job scheduling algorithm on Hadoop[J].Computer Engineering and Applications,2017,53(12):85-91.(in Chinese) |
[4] | Tang Z,Zhou J,Li K,et al.A MapReduce task scheduling algorithm for deadline constraints[J].Cluster Computing,2013,16(4):651-662. |
[5] | Yong M, Garegrat N,Mohan S. Towards a resource aware scheduler in Hadoop[C]∥Proc of the 7th IEEE International Conference on Web Services,2009:102-109. |
[6] | Xu Y,Li K,Hu J,et al.A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues[J].Information Sciences,2014,270(6):255-287. |
[7] | Caruana G,Li M,Qi M,et al.gSched:A resource aware Hadoop scheduler for heterogeneous cloud computing environments[J].Concurrency and Computation:Practice and Experience,2017,29(20):e3841. |
[8] | Chen Q,Zhang D,Guo M,et al.SAMR:A self-adaptive MapReduce scheduling algorithm in heterogeneous environment[C]∥ |
Proc of 2010 10th IEEE International Conference on Computer & Information Technology,2010:2736-2743. | |
[9] | Zhang Mi-mi. Performance analysis and improvement optimization of MapReduce model in Hadoop [D].Chengdu:University of Electronic Science and Technology of China,2010.(in Chinese) |
[10] | Srinivas N N, Atul N, Bapu B R T, et al.A data locality based scheduler to enhance MapReduce performance in heterogeneous environments[J].Future Generation Computer Systems,2019,90:423-434. |
[11] | Xu X, Cao L, Wang X.Adaptive task scheduling strategy based on dynamic workload adjustment for heterogeneous Hadoop clusters[J].IEEE Systems Journal,2016,10(2):471-482. |
[12] | Xu Jia-jun, Liu Gong-shen,Su Bo, et al.Adaptive scheduling strategy for heterogeneous Spark cluster [J].Computer Science and Application,2016,6(11):692-704.(in Chinese) |
[13] | Yang Zhi-wei, Zheng Quan, Wang Song, et al.Adaptive task scheduling strategy for heterogeneous Spark cluster [J].Computer Engineering,2016,42(1):31-35.(in Chinese) |
[14] | Wang Zhao-yuan, Li Tian-rui, Yi Xiu-wen. Approach for development of ant colony optimization based oil MapReduce [J].Computer Science,2014,41(7):261-265.(in Chinese) |
[15] | Huang X,Zhou H,Wu W.Hadoop job scheduling based on mixed ant-genetic algorithm[C]∥Proc of 2015 International Conference on Cyber-enabled Distributed Computing & Knowledge Discovery,2015:226-229. |
[16] | Xhafa F,Duran B,Abraham A,et al.Tuning struggle strategy in genetic algorithms for scheduling in computational grids[C]∥Proc of 2008 7th Computer Information Systems & Industrial Management Applications,2008:1. |
[17] | Lai Xiang-yang, Gong Xiu-jun, Han Lai-ming. Genetic algorithm based K-medoids clustering within MapReduce framework [J].Computer Science,2017,44(3):23-26.(in Chinese) |
[18] | Er H R, Erdogan N. Parallel genetic algorithm to solve traveling salesman problem on MapReduce framework using Hadoop cluster[J]. |
The International Journal of Soft Computing and Software Engineering, 2013,3(3):380-386. | |
[19] | Gu Lian-jun. Research of Hadoop job scheduling based on priority and reliability in cloud computing environment [D].Changsha:Hunan University,2013.(in Chinese) |
[20] | Ganglia [EB/OL].[2019-06-30].http://ganglia.info/. |
[21] | Sacerdoti F D,Katz M J,Massie M L,et al.Wide area cluster monitoring with Ganglia[C]∥Proc of IEEE International Conference on Cluster Computing,2003:289-298. |
[22] | Zhan Jian-feng, Gao Wan-ling, Wang Lei,et al. BigDataBench:An open-source big data benchmark suite [J].Chinese Journal of Computers,2016,39(1):196-211.(in Chinese) |
附中文参考文献: | |
[3] | 冯兴杰,贺阳.改进的Hadoop作业调度算法[J].计算机工程与应用,2017,53(12):85-91. |
[9] | 张密密.MapReduce模型在Hadoop实现中的性能分析及改进优化[D].成都:电子科技大学,2010. |
[12] | 徐佳俊,刘功申,苏波,等.基于Spark的异构集群调度策略研究[J].计算机科学与应用,2016,6(11):692-704. |
[13] | 杨志伟,郑烇,王嵩,等.异构Spark集群下自适应任务调度策略[J].计算机工程,2016,42(1):31-35. |
[14] | 王诏远,李天瑞,易修文.基于MapReduce的蚁群优化算法实现方法[J].计算机科学,2014,41(7):261-265. |
[17] | 赖向阳,宫秀军,韩来明.一种MapReduce架构下基于遗传算法的K-Medoids聚类[J].计算机科学,2017,44(3):23-26. |
[19] | 谷连军.云计算环境下基于优先级与可靠度的Hadoop作业调度研究[D].长沙:湖南大学,2013. |
[22] | 詹剑锋,高婉铃,王磊,等.BigDataBench:开源的大数据系统评测基准[J].计算机学报,2016,29(1):196-211. |
[1] |
CHEN Qiaoan1,LI Feng1,CAO Yue1,LONG Mingsheng1,2.
Parameter optimization for Spark jobs based on runtime data analysis [J]. J4, 20160101, 38(01): 11-19. |
[2] | WANG Xing-su, XIONG Wen, ZHANG Rui. A massive subway passenger trajectory similarity connection method:A case study of Shenzhen metro [J]. Computer Engineering & Science, 2023, 45(08): 1383-1392. |
[3] | HU Yan-fang, XIONG Wen, GAO Wei. An online game user churn prediction method based on Spark platform [J]. Computer Engineering & Science, 2022, 44(10): 1730-1737. |
[4] | WEN Rui-lin, FAN Chun, MA Yin-ping, WANG Zheng-dan, XIANG Guang-yu, FU Zhen-xin. SlurmX:A task scheduling system refactored from Slurm using object oriented methodology [J]. Computer Engineering & Science, 2022, 44(09): 1532-1541. |
[5] | LI Wen-jia, SHI Lan, JI Hang-xu, LUO Yi-peng. Research and implementation of a Flink-oriented load balancing task scheduling algorithm [J]. Computer Engineering & Science, 2022, 44(07): 1141-1151. |
[6] | LUO Lei, CHEN Zhao-yun, WANG Li-xuan. User QoS-aware deep learning task dynamic scheduling on GPU clusters [J]. Computer Engineering & Science, 2021, 43(08): 1331-1340. |
[7] | HUANG Shan, , FANG Liu-yi, , XU Hao-tong, DUAN Xiao-dong, . Task scheduling optimization of Flink in container environment [J]. Computer Engineering & Science, 2021, 43(07): 1173-1184. |
[8] | XING Hong-xing, WEI Ye-hua, LE Yi. A hardware cost reduction scheduling algorithm of heterogeneous distributed embedded system [J]. Computer Engineering & Science, 2021, 43(02): 258-265. |
[9] |
HU Ya-hong1,WANG Yi-zhou2,MAO Jia-fa1.
A node performance evaluation method for heterogeneous
clusters based on PageRank and benchmarks
[J]. Computer Engineering & Science, 2020, 42(03): 391-396.
|
[10] |
HE Deng-ping1,2,3,HE Zong-hao1,2,LI Pei-qiang1,2.
A parallelhigh utility itemset mining
algorithm based on Spark
|
[11] |
ZHU Yong-chao1,ZHOU Chuan1,CUI Yu-wei2,GUO Jian1,WU Yi-fei1.
An improved primary/backup scheduling algorithm
based on simulated annealing algorithm
[J]. Computer Engineering & Science, 2019, 41(09): 1534-1540.
|
[12] |
WANG Yu-xin,WANG Fei,WANG Guan,GUO He.
A MapReduce workflow heterogeneous scheduling
algorithm based on two-level DAG model
|
[13] |
YANG Jiechao,XU Jiangchun,YUE Qiuyan,ZENG Debin,LU Wanrong.
SMS scam user identification based
on SPARK and random forest
[J]. Computer Engineering & Science, 2019, 41(06): 1136-1144.
|
[14] |
YANG Guangming,ZHANG Tao,TRUONG Thanhtung,WANG Rui,MA Lianbo.
A Spark-based parallel brainstorm optimization algorithm and
its application in optimizing complex multimodal functions
[J]. Computer Engineering & Science, 2019, 41(03): 393-399.
|
[15] |
JI Hui,ZHOU Lei.
A task scheduling method for
network-on-chip temperature optimization
[J]. Computer Engineering & Science, 2018, 40(09): 1527-1533.
|
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||
湘公网安备 43010502000083号
湘ICP备10006030号
Copyright © Computer Engineering & Science, All Rights Reserved.
Address:109 Deya Rd,Changsha,hunan(410073) Tel: 0731-87002567 Email: jsjgcykx@vip.163.com
Powered by Beijing Magtech Co., Ltd.