• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2016, Vol. 38 ›› Issue (02): 255-261.

• 论文 • Previous Articles     Next Articles

Distributed swarm pattern mining algorithm
in  big spatio-temporal trajectory data   

YU Yanwei1,2,QI Jianpeng1,LU Yunhui1,2,ZHAO Jindong1,ZHANG Yonggang2   

  1. (1.School of Computer and Control Engineering,Yantai University,Yantai 264005;2.Key Laboratory of Symbolic Computation and Knowledge
    Engineering of Ministry of Education,Jilin University,Changchun 130012,China)
  • Received:2015-09-03 Revised:2015-11-12 Online:2016-02-25 Published:2016-02-25

Abstract:

We propose an efficient distributed mining algorithm based on MapReduce for mining swarm pattern from big spatiotemporal trajectory data. We first define the objectclosed swarm pattern based on the maximum moving object set, and optimize the serial mining algorithm using the strategy of minimum time support set to minimize the computation costs. We then propose a parallel swarm mining model based on the time independence, and the clustering and the objectclosed swarm mining on the time domain are parallelized. Finally, we propose a distributed mining algorithm based on MapReduce chained architecture, which quickly discovers swarm patterns in big trajectory data by a 4stage framework. Experimental evaluations on the Hadoop platform, using massivescale real world traffic trajectory datasets, demonstrate the effectiveness and efficiency of the proposed distributed algorithm.

Key words: spatiotemporal trajectory mining;big data;swarm pattern;distributed;MapReduce