• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2023, Vol. 45 ›› Issue (11): 1911-1921.

• High Performance Computing • Previous Articles     Next Articles

Distributed Kriging interpolation algorithm optimization for  large region carbon satellite data

ZHOU Xiao-hua1,2,WANG Xue-zhi1,2,ZHOU Yuan-chun1,2,MENG Zhen1,2   

  1.  (1.Computer Network Information Center,Chinese Academy of Sciences,Beijing 100083;
    2.University of Chinese Academy of Sciences,Beijing 100049,China)
  • Received:2022-12-05 Revised:2023-02-05 Accepted:2023-11-25 Online:2023-11-25 Published:2023-11-16

Abstract: To address the issues of long computation time and difficulty in parallel acceleration when using the original Kriging algorithm for interpolation of carbon satellite data at a large regional scale, the Kriging algorithm and its key parts are restructured and optimized. The whole interpolation process is broken up into several fine-grained operations and then organized into a distributed DAG workflow based on dependency relationship and data features. Finally, a distributed computing framework based on the double-tier scheduling structure is designed to accelerate the interpolation workflow on the distributed computing cluster. Experiments show that methods and framework described above can perform Kriging interpolation of different regional scales with high efficiency, and the efficiency advantages are more significantly than Spark at the large regional scale.

Key words: carbon satellite, distributed interpolation, Kriging algorithm acceleration, workflow scheduling