混合计算环境中截止期约束下的科学工作流调度策略

J4 ›› 2012, Vol. 34 ›› Issue (9): 40-46.

混合计算环境中截止期约束下的科学工作流调度策略

阎朝坤1,2，胡志刚1，罗慧敏2

（1.中南大学信息科学与工程学院,湖南长沙410083;
2.河南大学计算机与信息工程学院,河南开封 475004）

收稿日期:2012-04-05 修回日期:2012-06-25 出版日期:2012-09-25 发布日期:2012-09-25
基金资助:
国家自然科学基金资助项目（60970038）

Scheduling Strategy for DeadlineSensitive Scientific Workflow on Hybrid GridCloud Infrastructure

YAN Chaokun1,2，HU Zhigang1，LUO Huimin2

（1.School of Information Science and Engineering,Central South University,Changsha 410083;
2.School of Computer and Information Engineering,Henan University,Kaifeng 475004,China）

Received:2012-04-05 Revised:2012-06-25 Online:2012-09-25 Published:2012-09-25

摘要/Abstract

摘要：

整合云和网格基础设施，增强科研机构现有网格系统的计算能力并向应用提供截止时间保障的服务是科学研究领域的热点。在这种“网格云”混合计算环境中，对何时租借云虚拟资源以及如何租借做出有效决策是一个难题。现有的一些调度策略主要在网格资源静态能力特征的基础上，以作业等待时间作为决策依据，缺乏对资源动态服务能力的有效评估，无法保证科学应用的截止时间需求。本文提出了一种混合环境下的科学工作流执行系统架构并对其核心组件进行了阐述。针对其中的工作流调度问题，利用随机服务模型建模已有网格系统中的资源的动态服务能力，以任务违约风险作为是否租借外部虚拟资源的判断指标，提出了一个科学工作流调度算法HCA_SASWD。实验结果表明，HCA_SASWD相对于其他算法，能有效保证用户的截止时间要求，为需要提供截止时间保障的系统架构提供了参考。

关键词: 云, 网格系统, 混合计算环境, 工作流, 截止时间, 违约风险

Abstract:

In a hybrid gridcloud environment,the user has elasticity provided by public cloud resources that can be aggregated to the existing grid resource pool as necessary.However,the integration opens new problem,such as:which are the best resources to loan from a public cloud based on current QoS requirement?Existing scheduling strategies based on static resource information cannot absolutely guarantee the successful completion of scientific workflow and satisfy the user’deadline requirements.In this paper,we propose an infrastructure,which is able to manage the execution of scientific workflow. Aimed at the scheduling of deadlinesensitive scientific workflow,the stochastic service model is adopt to model dynamic service capacity of grid resource and a metric called Default Risk of Task (DST) is offered to judge whether virtual resources should be loaned from cloud providers or not.Thus a scheduling algorithm (HCA_SASWD) is put forward.The experimental results show that HCA_SASWD achieves better performance than other algorithms on user’s deadline guarantee.

Key words: cloud;grid system;hybrid computing environment;workflow;deadline;default risk

阎朝坤1,2，胡志刚1，罗慧敏2. 混合计算环境中截止期约束下的科学工作流调度策略[J]. J4, 2012, 34(9): 40-46.

YAN Chaokun1,2，HU Zhigang1，LUO Huimin2. Scheduling Strategy for DeadlineSensitive Scientific Workflow on Hybrid GridCloud Infrastructure[J]. J4, 2012, 34(9): 40-46.

参考文献

［1］Strijkers R, Toorop W, van Hoof A, et al. AMOS: Using the Cloud for OnDemand Execution of eScience Applications［C］∥Proc of the 6th Int’l Conf on eScience,2010:331338.
［2］Bittencourt L F, Senna C R, Madeira E R M. Enabling Execution of Service Workflows in Grid/Cloud Hybrid Systems［C］∥Proc of the Int’l Conf on Network Operations and Management Symposium, 2010:343349.
［3］Ostermann S,Prodan R,Fahringer T.Resource Management for Hybrid Grid and Cloud Computing. In: Cloud Computing: Computer Communications and Networks［M］. Berlin: Springer Press,2010.
［4］Droegemeier K, Brewster K, Xue M, et al. ServiceOriented Environments for Dynamically Interacting with Mesoscale Weather［J］. Computing in Science and Engineering, 2005, 17(6):1229.
［5］Ramakrishnan L, Koelbel C, Kee Y, et al. VGrADS: Enabling eScience Workflows on Grids and Clouds with Fault Tolerance［C］∥Proc of the ACM/IEEE SC Conference on High Performance Computing，Networking, Storage and Analysis, 2009:369376.
［6］Vecchiola C, Calheiros R N, Karunamoorthy D,et al. DeadlineDriven Provisioning of Resources for Scientific Applications in Hybrid Clouds with Aneka［J］. Future Generation Computer Systems, 2012,28(1):5865.
［7］TeraGrid. TeraGrid Project［DB/OL］.［20101016］.http://www.teragrid.org/.
［8］Enabling Grids for EScience. EGEE Project［DB/OL］.［20101016］.http://public.euegee.org/.
［9］Kim H, el Khamra Y, Rodero I, et al. Parashar. Autonomic Management of Application Workflows on Hybrid Computing Infrastructure［J］.Scientific Programming,2011,19(23):7589.
［10］Vazquez C, Huedo E, Montero R S, et al. Dynamic Provision of Computing Resources from Grid Infrastructures and Cloud Providers［C］∥Proc of the Workshop at the Grid and Pervasive Computing Conference, 2009:113120.
［11］Reservior Project［DB/OL］.［20101016］. http://www.epractice.eu/en/cases/reservoir.
［12］Bittencourt L F, Senna C R, Madeira E R M. HCOC: A Cost Optimization Algorithm for Workflow Scheduling in Hybrid Clouds［J］. Journal of Internet Services and Applications,2011,2(3):207227.
［13］JOSANG A. Dirichlet Reputation System［C］∥Proc of the 2th Int’l Conf on Availability, Reliability and Security, 2007:112119.
［14］Yu J,Buyya R,Tham C K.Costbased Scheduling of Scientific Workflow Applications on Utility Grids［C］∥Proc of the 1st Int’l Conf on eScience and Grid Computing, 2005:40147.
［15］Yu Jia. QoSBased Scheduling of Workflows on Global Grids:［PhD Thesis］［D］.Australia:The University of Melbourne,2007.
［16］Amazon Elastic Compute Cloud［DB/OL］.［20111016］.http://aws.amazon.com/ec2/.
［17］Dong F, Akl S G. PFAS: A Resource Performance Fluctuation Aware Workflow Scheduling Algorithm for Grid Computing［C］∥Proc of the 21st Int’l Conf on Parallel and Distributed Processing Symposium, 2007:19.
［18］Iosup A, Li H, Jan M, et al. The Grid Workloads Archive［J］. Future Generation Computer Systems,2008, 24(7):672686.
［19］Yeo C S, Buyya R. Pricing for UtilityDriven Resource Management and Allocation in Clusters［J］. International Journal of High Performance Computing Applications, 2007,21(4):405418.

[1]	周兰凤1，赵鹏飞1，彭俊杰2. 基于云环境下一种小文件传输策略研究[J]. J4, 20160101, 38(01): 20-27.
[2]	李卫平1,2，武海燕2，杨杰1. 基于效益博弈的云计算资源动态可协调分配策略研究[J]. J4, 20160101, 38(01): 57-61.
[3]	刘阳, 粟航, 何倩, 申普, 刘鹏. 基于云-边协同变分自编码神经网络的设备故障检测方法[J]. 计算机工程与科学, 2023, 45(07): 1188-1196.
[4]	付伟, 谢振杰, 朱婷婷, 任正伟. 基于密文强不可分性的云数据确定性删除方案[J]. 计算机工程与科学, 2023, 45(03): 434-442.
[5]	吴昊天, 关叶青. 基于自然语言云化的TOPSIS方法及其应用[J]. 计算机工程与科学, 2023, 45(03): 565-570.
[6]	蒋欣秀, 常俊, 李波, 杨志军, 丁洪伟. 面向海洋节能边缘计算的任务卸载研究[J]. 计算机工程与科学, 2022, 44(09): 1563-1573.
[7]	吴亦奇, 韩放, 张德军, 何发智, 陈壹林. 基于特征通道和空间位置注意力的三维点云特征学习网络[J]. 计算机工程与科学, 2022, 44(07): 1239-1246.
[8]	郑思飞, 冯子婧, 刘成语, 陈日清, 柳晓龙. 云存储环境中基于矢量量化的图像伪装加密方法[J]. 计算机工程与科学, 2022, 44(06): 1030-1036.
[9]	刘李漫, 谭龙雨, 彭源, 刘佳. 基于全融合网络的三维点云语义分割[J]. 计算机工程与科学, 2022, 44(05): 862-869.
[10]	杨柏蔼, 赵山, 刘芳. 无服务器计算技术研究综述[J]. 计算机工程与科学, 2022, 44(04): 611-619.
[11]	朱良杰, 沈佳杰, 周扬帆, 王新, . 云际存储系统性能优化研究现状与展望[J]. 计算机工程与科学, 2021, 43(05): 761-772.
[12]	李波, 侯鹏, 牛力, 武浩, 丁洪伟. 基于软件定义网络的云边协同架构研究综述[J]. 计算机工程与科学, 2021, 43(02): 242-257.
[13]	廖建锦, 孙庆骁, 杨海龙, 栾钟治, 钱德沛. 满足工作流执行时限的可抢占虚拟机实例配置和调度方法研究[J]. 计算机工程与科学, 2020, 42(11): 1956-1964.
[14]	关川江, 李建鹏, 史国振, 毛明. 基于关联数据本地化的多密码作业流调度算法[J]. 计算机工程与科学, 2020, 42(11): 1988-1995.
[15]	牛淑芬, 王金风, 王伯彬, 陈敬民, 杜小妮. 区块链上支持多关键字检索的可搜索加密方案[J]. 计算机工程与科学, 2020, 42(11): 2005-2012.