• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2013, Vol. 35 ›› Issue (10): 65-71.

• 论文 • Previous Articles     Next Articles

ECLHadoop: efficient big data processing strategy
based on Hadoop for electronic commerce logistics    

WEI Feifei   

  1. (1.School of Management,Huazhong University of Science and Technology,Wuhan 430074;
    2.School of Information Management,Hubei University of Economics,Wuhan 430205,China)
  • Received:2013-07-10 Revised:2013-09-23 Online:2013-10-25 Published:2013-10-25

Abstract:

With the rapid development of cloud computing, more and more electronic commerce applications are confronted with the problems of processing big data, such as big data from the social media posted by the customers of electronic commerce logistics .In order to improve the big data processing efficiency in electronic commerce logistics, an efficient big data processing strategy based on Hadoop is designed, which is named ECLHadoop. In ECLHadoop, those closely related data blocks are placed at the same nodes, which can help to reduce the MapReduce I/O cost, especially the I/O cost at the shuffling stage. The simulation experiment results show that, based on Hadoop, the ECLHadoop can improve the big data computing efficiency for dataintensive analysis in the electronic commerce logistics service.

Key words: big data;data placement;big data analysis;big data computing strategy;electronic commerce logistics