A performance enhanced user-space remote procedure call on InfiniBand

Liang Ming; Dan Feng; Fang Wang

doi:10.1117/12.916937

25 January 2012 A performance enhanced user-space remote procedure call on InfiniBand

Liang Ming, Dan Feng, Fang Wang

Proceedings Volume 8331, Photonics and Optoelectronics Meetings (POEM) 2011: Optical Communication Systems and Networking; 83310K (2012) https://doi.org/10.1117/12.916937
Event: Photonics and Optoelectronics Meetings 2011, 2011, Wuhan, China

Abstract

Remote Procedure Call (RPC) is widely used for constructing distributed, client-server based applications. Many distributed file systems, such as Lustre, pNFS, Panasas File System, Google File System use the RPC to exchange data and metadata between client nodes and server nodes. We have built a distribute file system called Cappella to meet the next generation high performance computing requirement, which uses the RPC as the communication protocol. But as we deployed the user-space open source RPC on our system, we found that it can't take full advantage of our 40 Gb/s InfiniBand network. This paper shared the problem that we observed during our RPC deployment and proposed a multithread method to enhance the performance of user-space RPC. And we also implemented a Socket Direct Protocol (SDP) based RPC protocol to use the RDMA capability of InfiniBand to transport data. And the experiments showed that our multi-thread user-space RPC had improved the performance over 60%.

Citation Download Citation

Liang Ming, Dan Feng, and Fang Wang "A performance enhanced user-space remote procedure call on InfiniBand", Proc. SPIE 8331, Photonics and Optoelectronics Meetings (POEM) 2011: Optical Communication Systems and Networking, 83310K (25 January 2012); https://doi.org/10.1117/12.916937

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available