Abstract: Parallel file system is an essential component of the software stack in high performance computing systems. The driver designed for high-speed networks is a crucial aspect of parallel file systems in providing efficient data access. A parallel file network driver based on the Tianhe high-speed interconnect network (TH-Express), named GLND, has been designed and implemented. GLND has been optimized specifically in three areas: parallelization, communication protocol, and fault tolerance. It achieves high throughput through VP-level parallelism combined with appropriately balanced pipeline partitioning. It adaptively selects the underlying communication protocol based on factors such as message size differences, implementing a NUMA-aware memory management mechanism. Additionally, an adaptively adjustable timeout mechanism is employed to avoid the impact of abnormal timeouts at the software layer on the completion of communication operations. Experimental results show that under the same hardware conditions, GLND improves write bandwidth by an average of 23.69% and read bandwidth by an average of 79.25% compared to TCP.

Key words: parallel file system, interconnect, network programming interface