数千上万核上模拟结果的并行可视化

J4 ›› 2012, Vol. 34 ›› Issue (8): 160-165.

数千上万核上模拟结果的并行可视化

肖丽,艾志玮,王弘堃

(北京应用物理与计算数学研究所高性能计算中心,北京 100094)

收稿日期:2012-04-28 修回日期:2012-06-11 出版日期:2012-08-25 发布日期:2012-08-25
基金资助:
国家高技术研究发展计划(2010AA012402）;国家自然科学基金重点资助项目（61033009）

Parallel Visualization of the Simulations on Tens of Thousands of Cores

XIAO Li,AI Zhiwei,WANG Hongkun

（High Performance Computing Center,Institute of
Applied Physics and Computational Mathematics,Beijing 100094,China）

Received:2012-04-28 Revised:2012-06-11 Online:2012-08-25 Published:2012-08-25

摘要/Abstract

摘要：

在科学与工程计算中，在数千上万核上，模拟包含上亿网格单元的模型通常输出TB量级的时变数据集。这些数据集包含多个时刻的数据，每个时刻的数据分布存储在数千个文件，单时刻的数据量达到几GB甚至几十GB。为了并行地可视化这种时变数据集，本文设计了基于网格片的层次化数据结构，基于该数据结构改进和优化了并行可视化流程和数据通信算法。在集成到可视化软件后，实现了两个应用的模拟结果可视化。实测数据表明，对于单时刻5GB和32GB的数据，在数十上百个处理器核上，从数据读入到获得体绘制结果的时间分别为19秒和80秒，交互操作为2秒到10秒；三维面绘制在数秒钟内，切片分析在2秒以内。

关键词: 时变数据集, 并行可视化, 网格片

Abstract:

In scientific and engineering computing, some datasets generated by the simulations on tens of thousands of cores are measured in terabytes or even more. These datasets contain the data from multiple timesteps. The amount of each timestep dataset distributed to thousands of files is gigabytes or even tens of gigabytes. The hierarchical data structure based on the patch is designed to support the visualization of such scale dataset. And more, the parallel visualization pipeline and data communication algorithms are improved and optimized. Finally, two datasets coming from the code run on tens of thousands of cores are visualized. The measured result show that for the 5GB and 32GB data at single moments, on tens of thousands of processor cores, the time between the data imput and the result output is 19s and 80s respectively, and the interactive operation is between 2s and 10s; for the 3D rendering it is within several seconds, and the slicing is within 2s.

Key words: timevarying dataset;parallel visualization;patch

肖丽,艾志玮,王弘堃. 数千上万核上模拟结果的并行可视化[J]. J4, 2012, 34(8): 160-165.

XIAO Li,AI Zhiwei,WANG Hongkun. Parallel Visualization of the Simulations on Tens of Thousands of Cores[J]. J4, 2012, 34(8): 160-165.

参考文献

［1］Mo Z,Zhang A,Cao X,et al. JASMIN:A Parallel Software Infrastructure for Scientific Computing［J］.Front Comput Sci China, 2010,4(4):480488.
［2］Bowers K J,Albright B J,Yin L, et al.Ultrahigh Performance ThreeDimensional ElectroMagnetic Relativistic Kinetic Plasma Simulation［J］.Physics of Plasmas,2008,15(5):17.
［3］曹小林，郑春阳，张爱清,等.面向数千处理器的三维等离子体粒子模拟程序研制［J］. 自然科学进展，2009,19(5):544550.
［4］莫则尧，张爱清. 并行自适应结构网格应用支撑软件框架用户指南［R］. 北京应用物理与计算数学研究所，技术文档 T09JMJL01,2008.
［5］Miller M,Reus J F,Matzke R P，et al.Enabling Interoperation of High Performance,Scientific Computing Application:Modeling Scientific Data With the Sets & Fields (SAF) Modeling System［C］∥Proc of ICCS01,2001:158170.
［6］Law C C,Henderson A,Ahrens J.An Application Architecture for Large Data Visualization:A Case Study［C］∥Proc of the IEEE 2001 Symposium on Parallel and Largedata Visualization and Graphics,2001:125128.
［7］Ma KL, Crockett T.A Scalable Parallel Cellprojection Volume Rendering Algorithm for 3d Unstructured Data［C］∥Proc of 1997 Symposium on Parallel Rendering,1997:95104.
［8］Wang Chaoli,Gao Jinzhu,Shen HanWei.Parallel Multiresolution Volume Rendering of Large Data Sets with Errorguided Load Balancing［C］∥Proc of Eurographics/ACM SIGGRAPH Parallel Graphics and Visualization,2004:2330.
［9］Childs H,Duchaineau M A,Ma KwanLiu.A Scalable,Hybrid Scheme for Volume Rendering Massive Data Sets［C］∥Eurographics Symposium on Parallel Graphics.and Visualization,2006:153162.
［10］Gao Jinzhu,Huang Jian,Johnson C R,et al.Distributed Data Management for Large Volume Visualization［C］∥Proc of the Conference on Visualization’05,2005:183190.
［11］Upson C,Faulhaber Jr T,Kamins D,et al.The Application Visualization System:A Computational Environment for Scientific Visualization［J］.Computer Graphics and Applications,1989,9(4):3042.
［12］Abram G, Treinish L A.An Extended DataFlow Architecture for Data Analysis and Visualization［R］.Research Report RC 20001 (88338),IBM T J Watson Research Center,Yorktown Heights,NY,USA, 1995.
［13］Schroeder W J, Martin K M, Lorensen W E.The Design and Implementation of an ObjectOriented Toolkit for 3d Graphics and Visualization［C］∥Proc of the Conference on Visualization’96,1996:93100.