• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2023, Vol. 45 ›› Issue (11): 1922-1928.

• 高性能计算 • 上一篇    下一篇

基于非易失混合内存的高速气象数据管理系统设计

陈超,顾青峰   

  1. (中国气象局气象发展与规划院,北京 100081) 
  • 收稿日期:2022-08-01 修回日期:2022-10-28 接受日期:2023-11-25 出版日期:2023-11-25 发布日期:2023-11-16
  • 基金资助:
    国家自然科学基金(61972275)

A high-speed meteorology data management system based on non-volatile memory

CHEN Chao,GU Qing-feng   

  1.  (Institute for Development and Programme Design,China Meteorological Administration,Beijing 100081,China) 
  • Received:2022-08-01 Revised:2022-10-28 Accepted:2023-11-25 Online:2023-11-25 Published:2023-11-16

摘要: 气象数据是典型的大数据,具有规模大、增速快和类型复杂等特点,而且气象模式数据由高性能计算机不断计算产生,同时也面临天气预报等气象业务的多种复杂查询,因此气象模式数据管理面临严峻的空间和性能挑战。非易失内存(NVM)是近年来应用的新型存储介质,具有性能高、存储密度高和非易失等优势,但同时也具有很多特殊的硬件特性,需要进行软件协同设计才能充分发挥其性能优势。因此,以非易失内存的硬件特征为出发点,设计了一种高速气象数据管理系统,相对于目前的内存数据管理系统,性能增幅为114.2%,且同时具有更大的存储容量和更低的单位容量成本。

关键词: 非易失内存, 数据管理, 模式数据, 气象

Abstract: As typical big data, meteorological data have the characteristics of large scale, fast growth, and complex types. Among them, the meteorological model data are continuously generated by high-performance computers, and they are also faced with various complex queries of meteorological services such as weather forecasts. Therefore, the management of meteorological model data faces severe space and performance challenges. Non-volatile memory (NVM) is a new emerging type of storage medium that is practically applied in recent years. NVM has the advantages of high performance, high storage density, and non-volatility. However, it also has many special hardware characteristics, which requires software-hardware co-design to leverage its performance advantage. Therefore, based on the hardware characteristics of NVM, a high-speed meteorological data management system is designed. It has 114.2% higher performance than the current memory data management system, and it has larger storage capacity and lower cost per byte at the same time.


Key words: non-volatile memory (NVM), data management, model data, meteorology