大规模三维频率域电磁积分方程法数值模拟

计算机工程与科学 ›› 2023, Vol. 45 ›› Issue (11): 1901-1910.

大规模三维频率域电磁积分方程法数值模拟

肖调杰1,2，周峰3，郑翾宇1,2，刘剑1,2，陈琳1,2，刘杰1,2，易明宽1,2，陈旭光1,2，龚春叶1,2,4，杨博1,2，甘新标1,2，李胜国1,2，左克1,2

（1.国防科技大学计算机学院，湖南长沙 410073；2.国防科技大学高端装备数字化软件实验室，湖南长沙 410073；
3.东华理工大学地球物理与测控技术学院，江西南昌 330013；4.国家超级计算天津中心,天津 300457）

收稿日期:2022-07-08 修回日期:2023-03-23 接受日期:2023-11-25 出版日期:2023-11-25 发布日期:2023-11-16
基金资助:
国家自然科学基金(42104078，42004061)；高性能国家重点实验室基金(202101-01)

Large-scale 3D electromagnetic modeling in frequency domain using integration equation method

XIAO Tiao-jie1,2,ZHOU Feng3,ZHENG Xuan-yu1,2,LIU Jian1,2,CHEN Lin1,2,LIU Jie1,2,YI Ming-kuan1,2,#br# CHEN Xu-guang1,2,GONG Chun-ye1,2，4,YANG Bo1,2,GAN Xin-biao1,2,LI Sheng-guo1,2,ZUO Ke1,2

1.College of Computer Science and Technology,National University of Defense Technology,Changsha 410073;
2.Laboratory of Digitizing Software for Frontier Equipment, National University of Defense Technology, Changsha 410073；
3.School of Geophysics and Measurement-Control Technology,East China University of Technology,Nanchang 330013;
4.National Supercomputer Center in Tianjin,Tianjin 300457,China)

Received:2022-07-08 Revised:2023-03-23 Accepted:2023-11-25 Online:2023-11-25 Published:2023-11-16

摘要/Abstract

摘要： 地电磁学频率域电磁法在地球深部结构探测、油气勘查、环境与工程勘探等领域有着广泛的应用，其数值模拟的精度、速度直接影响资料解释结果。然而，当前频率域电磁三维数值模拟存在着求解精度差、计算时间长、计算规模受限等问题。采用积分方程法和直接解法提高求解精度，采用多层级多粒度混合并行、分布式存储等技术，大幅减少计算时间，扩大计算规模。实现了一种频点间并行、阻抗矩阵并行填充、方程组并行直接求解的快速、高精度、高可扩展性的频率域电磁三维数值模拟。首先，详细介绍了积分方程法理论和并行实现方案。然后，选取典型案例，通过与前人计算结果进行对比验证了程序的正确性。最后，针对1个16频点、16 × 12495个未知量、861个观测点的大规模算例进行了可扩展性测试，相比于1个节点32个进程，当计算规模达到256个节点8 192个进程时，加速比为69.69，并行效率为27.22%。此大规模并行算法适用于大地电磁和可控源音频大地电磁积分方程法。

关键词: 电磁法, 频率域, 积分方程法, 并行算法, 高性能计算

Abstract: Electromagnetic method of geoelectrical frequency domain has a wide range of applications in exploring Earth's deep structure, petroleum exploration, environmental and engineering surveying, and its accuracy and efficiency of numerical simulation directly affect the interpretation results of data. However, there are currently issues with low accuracy and long computation time in three-dimensional numerical simulation of frequency domain electromagnetic fields, as well as limitations in computational scale. This paper proposes to use integral equation method and direct solution method to improve the solution accuracy, and adopt technologies such as hybrid parallel processing at multiple levels and multiple grain sizes, distributed storage, etc., to greatly reduce the computation time and expand the computational scale. This paper implements a fast, high-precision, and highly scalable three-dimensional numerical simulation method of frequency domain electromagnetic fields, which includes parallel processing between frequency points, parallel filling of impedance matrix, and parallel direct solution of equations. Firstly, the theoretical framework of integral equation method and its parallel implementation solution are introduced in detail. Then, typical cases are selected to verify the correctness of the program by comparing with previous calculation results. Finally, the scalability is tested for a large-scale example with 16 frequencies, 16×12 495 unknowns, and 861 observation points. Compared to a single node with 32 processes, when the computational scale reaches 256 nodes and 8 192 processes, the speedup ratio is 69.69 and the parallel efficiency is 27.22%. This large-scale parallel algorithm is applicable to both geomagnetic and controlled source audio geomagnetic integral equation methods.

Key words: electromagnetic method, frequency domain, integral equation method, parallel algorithm, high performance computing

肖调杰, 周峰, 郑翾宇, 刘剑, 陈琳, 刘杰, 易明宽, 陈旭光, 龚春叶, 杨博, 甘新标, 李胜国, 左克, . 大规模三维频率域电磁积分方程法数值模拟[J]. 计算机工程与科学, 2023, 45(11): 1901-1910.

XIAO Tiao-jie, ZHOU Feng, ZHENG Xuan-yu, LIU Jian, CHEN Lin, LIU Jie, YI Ming-kuan, CHEN Xu-guang, GONG Chun-ye, YANG Bo, GAN Xin-biao, LI Sheng-guo, ZUO Ke, . Large-scale 3D electromagnetic modeling in frequency domain using integration equation method[J]. Computer Engineering & Science, 2023, 45(11): 1901-1910.

[1]	许晓阳, 王斯棋. 基于粒子分解的SPH并行算法研究与应用[J]. 计算机工程与科学, 2022, 44(06): 964-970.
[2]	刘杰, 龚春叶, 杨博, 郭晓威, 甘新标, 李胜国, 李超, 陈旭光, 肖调杰, 穆利安, 宋敏, 赵冬勇, 鞠羽中. YH-ACT：热工流体力学并行应用程序[J]. 计算机工程与科学, 2021, 43(01): 58-69.
[3]	李雯, 迟利华, 张会, 张哲, 刘杰, . 潜艇使用自航式声诱饵防御鱼雷模型并行计算方法研究[J]. 计算机工程与科学, 2020, 42(12): 2163-2168.
[4]	王俊吉1,2,朱朝艳1,2,4,陈建军1,2,郑澎3，5,徐权3. 基于无锁原子操作的多线程并行Delaunay三角化算法[J]. 计算机工程与科学, 2018, 40(05): 773-779.
[5]	章子凯，武继刚，姜文超，刘竹松. 容错处理器阵列的多逻辑列并行重构算法[J]. 计算机工程与科学, 2018, 40(01): 24-33.
[6]	李娟1，汤德佑1，傅娟2，3. 一种基于蚁群算法的生物序列并行比对方法[J]. 计算机工程与科学, 2017, 39(09): 1610-1616.
[7]	宋威，吉红蕾，李晋宏. 一种高效用项集并行挖掘算法[J]. J4, 2015, 37(03): 422-428.
[8]	杨菊，吴卓锋，王刚，刘晓光. 多核平台PAML并行算法研究[J]. J4, 2013, 35(9): 15-19.
[9]	周琛，陈振杰，张帅. 基于边界代数法的矢量栅格化并行算法设计与实现[J]. J4, 2013, 35(4): 37-41.
[10]	王多雷，龙汉，陈璇. 组合打击下一类面目标易损性的并行计算研究[J]. J4, 2013, 35(4): 42-46.
[11]	刘立国，莫锦军，袁乃昌. 基于“天河一号”的并行电磁计算求解器[J]. J4, 2013, 35(3): 43-47.
[12]	焦善飞1,2，何晨2，豆育升2，唐红1,2. 短程力分子模拟在Hadoop上的实现及优化[J]. J4, 2013, 35(2): 26-31.
[13]	龚春叶1,2,3,包为民1,闵昌万1,张烨琛1，刘杰3. 分数阶微分方程的一种细粒度数据级并行算法[J]. J4, 2013, 35(11): 76-79.
[14]	徐莹，徐磊，姜恺. 三维NavierStokes方程分步法的并行算法在异构平台上实现初探[J]. J4, 2012, 34(9): 33-39.
[15]	徐莹，徐磊. 三维Navier-Stokes方程的差分-谱方法混合法在GPU上的实现与优化[J]. J4, 2012, 34(8): 53-58.