Abstract:

Parallel computing is the main technology to implement high performance computing. This paper reviews the history of parallel computing over the past 60 years, and reaffirms the fact that the measurement equations for parallel scalability have played an important role in the development of parallel computing. Based on our analysis of challenges in exascale computing in the future, new scalability measurement model for parallel computing has been built, in which factors affecting performance of exascale computing are considered, including memory access, communication, reliability and power consumption. Through quantitative analysis, it has been found that there are some scalability "walls" during the development when parallel computing advances to higher performance. Finally, in consideration of the conditions of our country, the author proposes some suggestions for the development of high performance computing in our country.

Key words: parallel;scalability;high productivity;exascale computing