Abstract:

In scientific and engineering computing, some datasets generated by the simulations on tens of thousands of cores are measured in terabytes or even more. These datasets contain the data from multiple timesteps. The amount of each timestep dataset distributed to thousands of files is gigabytes or even tens of gigabytes. The hierarchical data structure based on the patch is designed to support the visualization of such scale dataset. And more, the parallel visualization pipeline and data communication algorithms are improved and optimized. Finally, two datasets coming from the code run on tens of thousands of cores are visualized. The measured result show that for the 5GB and 32GB data at single moments, on tens of thousands of processor cores, the time between the data imput and the result output is 19s and 80s respectively, and the interactive operation is between 2s and 10s; for the 3D rendering it is within several seconds, and the slicing is within 2s.

Key words: timevarying dataset;parallel visualization;patch