• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2025, Vol. 47 ›› Issue (10): 1711-1925.

• 高性能计算 • 上一篇    下一篇

一种面向地球系统模式的高效并行计算框架

王冬,刘壮,黄小猛   

  1. (清华大学地球系统科学系,北京 100084)
  • 收稿日期:2024-11-14 修回日期:2024-12-11 出版日期:2025-10-25 发布日期:2025-10-28
  • 基金资助:
    国家重点研发计划(2022YFE0195900);国家自然科学基金(42125503,42430602)

An efficient parallel computing framework for earth system models

WANG Dong,LIU Zhuang,HUANG Xiaomeng   

  1. (Department of Earth System Science,Tsinghua University,Beijing 100084,China)
  • Received:2024-11-14 Revised:2024-12-11 Online:2025-10-25 Published:2025-10-28

摘要: 地球系统模式是理解过去气候与环境演变机理、预估未来全球变化情景的关键工具。然而,计算机技术的快速发展为模式开发带来了编程、移植和优化方面的巨大挑战。面向地球系统模式的自动并行计算框架OpenArray 2.0,通过提供自定义算子接口,结合隐式并行、计算流图优化、自动代码生成、即时编译和动态调度I/O等技术,实现了模式开发与计算机底层并行架构的解耦。OpenArray 2.0允许用户使用类似Matlab的串行语法编写模式,而底层可在x86、申威、GPU等多种异构平台上实现并行执行。基于OpenArray 2.0开发的模式在x86平台19 200核下,可达到75%的并行效率,运行速度接近手工优化代码;在申威平台百万核环境下,实现了70%的扩展性;在GPU平台上也展现出优异的执行效率。OpenArray 2.0为地球系统模式的发展提供了一种极具潜力的替代工具,有望显著提升模式开发效率和计算性能。

关键词: 算子, 隐式并行, 高性能计算, 地球系统模式

Abstract: Earth system models (ESMs) are pivotal tools for understanding the mechanisms of past climate and environmental evolution and projecting future global change scenarios. However, the rapid advancement of computer technology has introduced significant challenges in programming, porting, and optimizing model development. To address these issues, OpenArray 2.0, an automatic parallel computing framework designed for ESMs, decouples model development from underlying parallel computing architectures by employing technologies such as custom operator interfaces, implicit parallelism, computational graph optimization, automatic code generation, just-in-time compilation, and dynamic I/O scheduling. OpenArray 2.0 allows users to write models using Matlab-like serial syntax while enabling parallel execution across heterogeneous platforms, including x86, Sunway, and GPUs. Models developed with OpenArray 2.0 achieve 75% parallel efficiency on an x86 platform with 19 200 cores, delivering performance close to manually optimized code. On the Sunway platform with a million-core environment, it demonstrates 70% scalability, while also exhibiting exceptional execution efficiency on GPU platforms. As a highly promising alternative tool for ESM advancement, OpenArray 2.0 is poised to significantly enhance both model development efficiency and computational performance.

Key words: operator, implicit parallelism, high performance computing, earth system model