• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2015, Vol. 37 ›› Issue (11): 2035-2044.

• 论文 • 上一篇    下一篇

数据流Eager传输:一种分布式流体系结构中的性能优化技术

李鑫1, 3,郭晓威1,林宇斐2   

  1. (1.国防科学技术大学高性能计算国家重点实验室,湖南 长沙 410073;
    2.国防科学技术大学研究生院,湖南 长沙 410073;3.总参第六十三研究所,江苏 南京 210007)
  • 收稿日期:2015-08-11 修回日期:2015-10-15 出版日期:2015-11-25 发布日期:2015-11-25
  • 基金资助:

    国家自然科学基金资助项目(61221491,61303071)

Stream Eager transmission:a performance optimization
technique for the distributed stream architecture 

LI Xin1,3,GUO Xiaowei1,LIN Yufei2   

  1. (1.State Key Laboratory of High Performance Computing,National University of Defense Technology,Changsha 410073;
    2.Graduate School,National University of Defense Technology,Changsha 410073;
    3.The 63rd Research Institute of PLA General Staff Headquarters,Nanjing 210007,China)
  • Received:2015-08-11 Revised:2015-10-15 Online:2015-11-25 Published:2015-11-25

摘要:

分布式流体系结构扩展了分布式环境下的流计算模型, 可在互联网上为大数据计算应用提供高效低成本的运行环境。互联网中较长的通信开销制约了计算性能。提出了一种数据流Eager传输的性能优化技术,以挖掘计算与通信之间的并行性,隐藏通信延迟。在分布式流体系结构原型系统中实现了该技术。实验结果表明,应用程序采用该优化技术之后的平均时间开销减少了19.58%,表明该优化技术能够显著提高应用的性能,具有良好的应用前景。

关键词: 分布式流体系结构, 性能优化, 数据流Eager传输技术

Abstract:

The distributed stream architecture extends the stream model in the distributed environment, which can provide an efficient and lowcost execution environment for big data computing applications in the Internet. Meanwhile, the long communication overhead in the Internet restricts the performance of the distributed stream architecture. We propose a data stream Eager transmission technique and implement it in a prototype system of the distributed stream architecture, which improves the performance of applications by exploring the parallelism between communications and computation, as well as hides communication latency. Experimental results show that the proposed technique averagely gains a 19.58% reduction of the execution time cost, significantly improves the performance of the applications and has a promising prospec.

Key words: distributed stream architecture;performance optimization;stream Eager transmission technique