• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science

Previous Articles     Next Articles

A distributed storage and query method of
remote sensing data based on HBase

JING Weipeng,TIAN Dongxue   

  1. (College of Information and Computer Engineering,Northeast Forestry University,Harbin 150040,China)
  • Received:2017-11-06 Revised:2018-01-16 Online:2018-06-25 Published:2018-06-25

Abstract:

The storage and query of remote sensing image is an important content in geographic information processing and plays an important role in the realtime processing of massive remote sensing images. Aiming at the problem of single node failure, low scalability and low efficiency in traditional remote sensing image processing, this paper proposes a distributed storage and query scheme of remote sensing data based on HBase. In this method, the remote sensing image is divided by uniform mesh, and an index scheme based on grid ID and Hilbert curve is designed according to the block information. Then, the HBase filter mechanism is used to design the filter column family so as to achieve the purpose of screening data in the query. In addition, the MapReduce parallel processing method is adopted to write and query image data. The experimental results show that, compared with MySQL and MapFile, the proposed method can improve the query speed of data and has good scalability.
 

Key words: remote data, distributed storage, data query, HBase