• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2016, Vol. 38 ›› Issue (01): 20-27.

• 论文 • 上一篇    下一篇

基于云环境下一种小文件传输策略研究

周兰凤1,赵鹏飞1,彭俊杰2   

  1. (1.上海应用技术学院计算机科学与信息工程学院,上海 201418;
    2.上海大学计算机信息工程与科学学院,上海 200444)
  • 收稿日期:2015-08-19 修回日期:2015-10-29 出版日期:2016-01-25 发布日期:2016-01-25

A transfer strategy for small files
in cloud environment 

ZHOU Langfeng1,ZHAO Pengfei1,PENG Junjie2   

  1. (1.Institute of Computer Science and Information Engineering,Shanghai Institution of Technology,Shanghai 201418;2.School of Computer Engineering and Science,Shanghai University,Shanghai 200444,China)
  • Received:2015-08-19 Revised:2015-10-29 Online:2016-01-25 Published:2016-01-25

摘要:

基于互联网的文件传输策略将直接影响到文件传输效率和网络资源的使用效率,这一情况在各种资源集中的云计算环境表现得更为明显,特别是当传输大量小文件时尤为突出。针对这种现状,提出了一种基于打包策略的文件传输策略,给出了文件包优化处理机制,基于该策略,文件传输之前对小文件进行打包处理,然后进行传输,在接收端收到文件时首先进行解包再进行存储,从而减小传输过程中大量的IO操作,提升文件传输效率。大量的实验表明了本文所提策略的正确性,能够极大地提升云环境下小文件的传输效率,提高云资源的利用率。

关键词: 云环境, 小文件传输, 优化处理, 特定策略

Abstract:

File transfer strategies on the Internet directly affect the efficiency of resource utilization and file transfer, and this is more obvious in cloud computing environments where there are all kinds of resources, especially when transferring a large number of small files. Aiming at this problem, we present a transfer strategy for small files based on packing strategy, and an optimization mechanism for file packets as well. We pack small files before they are transferred and stored. Packaged files are unzipped and then stored at the serverend. The transfer process of IO operations is therefore greatly reduced and the efficiency of file transfer is also enhanced. Experimental results verify the correctness of the proposed strategy, which greatly improves the efficiency of small file transfer in cloud environments and resource utilization .

Key words: cloud environment;small file transfer;optimization;specific strategy