基于InfiniBand的RPC优化

J4 ›› 2013, Vol. 35 ›› Issue (7): 23-30.

基于InfiniBand的RPC优化

明亮，冯丹，王芳，陈碧砚

(华中科技大学计算机学院，湖北武汉 430074)

收稿日期:2012-05-17 修回日期:2012-09-21 出版日期:2013-07-25 发布日期:2013-07-25
基金资助:
国家973计划资助项目（2011CB302301）

Optimization of RPC based on InfiniBand

MING Liang,FENG Dan,WANG Fang,CHEN Biyan

(School of Computer Science,Huazhong University of Science and Technology,Wuhan 430074,China)

Received:2012-05-17 Revised:2012-09-21 Online:2013-07-25 Published:2013-07-25

摘要/Abstract

摘要：

随着无限带宽（IB）网络技术的发展，IB网络以其高性能、低延迟以及低功耗和低成本的优势逐渐在数据中心占据重要的地位。而作为重要的网络通信模型，远程过程调用（RPC）协议如何利用IB网络的远程内存直接访问RDMA特性是一个重要议题。NFSover RDMA 解决了内核态下网络文件系统（NFS）利用RDMA协议传输数据的问题。然而，面向跨越内核态和用户态的RPC应用，目前仍然没有基于IB的RPC相关优化。通过将IB协议族中的套接字直接协议（SDP）集成到现有RPC协议中，使内核态以及用户态RPC程序都能使用IB网络的RDMA协议，从而提升网络传输性能。经测试，此方案与传统的基于TCP/IP协议的RPC实现相比，用户态RPC与内核态RPC可分别获得10%和35%的性能提升。

关键词: 无限带宽技术；远程过程调用；套接字直接协议；分布式文件系统

Abstract:

Along with the development of InfiniBand (IB) network, IB is becoming an important component in the data center due to its characteristics such as high performance, low latency, low power consumption and low price. As an important communication protocol, it is a significant problem that how the Remote Procedure Call (RPC) utilizes the RDMA feature of IB. NFS over RDMA solves the problem that the NFS transfers data by RDMA protocol in the kernelspace. However, there is no RPC optimization on InifiniBand in the userspace communication and the communication between userspace and kernelspace. In this paper, we integrate the Socket Direct Protocol into the RPC so as to achieve the RDMA feature of IB in both userspace and kernelspace. Through the experiments, we can obtain 10% and 35% peak performance improvement in userspace and kernelspace communication respectively.

Key words: InfiniBand;remote procedure call;socket direct protocol;distributed file system

明亮，冯丹，王芳，陈碧砚. 基于InfiniBand的RPC优化[J]. J4, 2013, 35(7): 23-30.

MING Liang,FENG Dan,WANG Fang,CHEN Biyan. Optimization of RPC based on InfiniBand [J]. J4, 2013, 35(7): 23-30.