• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2016, Vol. 38 ›› Issue (06): 1078-1085.

• 论文 • 上一篇    下一篇

气象数据归档元数据索引重组织的并行算法设计与验证

许婧1,任开军2   

  1. (1.国防科学技术大学计算机学院,湖南 长沙 410073;
    2.国防科学技术大学海洋科学与工程研究院,湖南 长沙 410073)
  • 收稿日期:2015-05-18 修回日期:2015-08-20 出版日期:2016-06-25 发布日期:2016-06-25
  • 基金资助:

    公益性行业(气象)科研专项(GYHY201306003)

Design and verification of parallel algorithm of metadata
index reorganization for meteorological data archiving  

XU Jing1,REN Kaijun2   

  1. (1.College of Computer,National University of Defense Technology,Changsha 410073;
    2.Academy of Ocean Science and Engineering,National University of Defense Technology,Changsha 410073,China)
  • Received:2015-05-18 Revised:2015-08-20 Online:2016-06-25 Published:2016-06-25

摘要:

气象资料归档和检索系统(MARS)实现了气象科学数据包括数值预报产品的归档和检索管理。但是,随着精细化数值预报技术的提高,MARS系统管理的气象科学数据呈海量增长趋势,对归档和检索处理技术提出了新的挑战。针对MARS系统归档操作时物理视图元数据索引结构串行更新效率低的问题,提出一种并行处理更新方法。该方法能够有效降低数据归档时物理索引结构再组织的系统开销。实验表明,相比原始的串行更新算法,采用索引结构并行更新的处理方法,使系统物理视图元数据索引结构的最大更新效率平均提高3倍左右,从而提高了气象科学数据快速归档效率。

关键词: 气象资料归档和检索系统;物理索引结构;并行更新;快速归档

Abstract:

Meteorological archival and retrieval system (MARS) enables archival and retrieval management for meteorological data,  including many numerical prediction products. However, with the refinement of numerical forecasting techniques, the data under the MARS management is soaring in a massive growing trend, which presents a new challenge to archival and retrieval techniques. As an archival issue in the physical view of MARS, the metadata index currently has very low update efficiency. To address the problem, we propose a parallel approach to accelerate index update speed, which reduces the index reorganizing overhead during data archiving time. Experimental results show that compared with the original serial one, our parallel approach accelerates the maximum update speed by 3 times on average, hence improving the efficiency of meteorological data archiving.

Key words: meterological archival and retrieval system (MARS);physical index structure;parallel updating;rapid archiving