RDMA Core Userspace Libraries and Daemons

This is the userspace components for the Linux Kernel's drivers/infiniband subsystem. Specifically this contains the userspace libraries for the following device nodes:

• /dev/infiniband/uverbsX (libibverbs)
• /dev/infiniband/rdma_cm (librdmacm)
• /dev/infiniband/umadX (libumad)
• /dev/infiniband/ucmX (libibcm, deprecated)

The userspace component of the libibverbs RDMA kernel drivers are included under the providers/ directory. Support for the following Kernel RDMA drivers is included:

• iw_cxgb3.ko
• iw_cxgb4.ko
• hfi1.ko
• i40iw.ko
• ib_qib.ko
• mlx4_ib.ko
• mlx5_ib.ko
• ib_mthca.ko
• iw_nes.ko
• ocrdma.ko
• rdma_rxe.ko

Additional service daemons are provided for:

• srp_daemon (ib_srp.ko)
• iwpmd (for iwarp kernel providers)

Building

This project uses a cmake based build system. Quick start:

$ mkdir build
$ cd build
$ cmake -GNinja ..
$ ninja

build/bin will contain the sample programs and build/lib will contain the shared libraries.

NOTE: It is not currently easy to run from the build directory, the plugins only load from the system path.

Debian Derived

$ apt-get install build-essential cmake gcc libnl-3-dev libnl-route-3-dev ninja-build pkg-config valgrind

Fedora

$ dnf install cmake gcc libnl3-devel pkgconfig valgrind-devel ninja-build

NOTE: Fedora Core uses the name 'ninja-build' for the ninja command.

OpenSuSE

$ zypper install cmake gcc libnl3-devel ninja pkg-config valgrind-devel

Building on CentOS 6/7

Install required packages:

$ yum install cmake gcc libnl3-devel make pkgconfig valgrind-devel

For end users, the package can be built using GNU Make and the old cmake included with the distro:

$ mkdir build
$ cd build
$ cmake  ..
$ make

Developers are suggested to install more modern tooling for the best experience.

$ yum install epel-release
$ yum install cmake3 unzip
$ curl -OL https://github.com/ninja-build/ninja/releases/download/v1.7.1/ninja-linux.zip
$ unzip ninja-linux.zip
$ install -m755 ninja /usr/local/bin/ninja

Use the 'cmake3' program in place of cmake in the above instructions.

Reporting bugs

Bugs should be reported to the [email protected] mailing list In your bug report, please include:

• Information about your system:

  • Linux distribution and version
  • Linux kernel and version
  • InfiniBand hardware and firmware version
  • ... any other relevant information

• How to reproduce the bug.

• If the bug is a crash, the exact output printed out when the crash occurred, including any kernel messages produced.

Submitting patches

Patches should also be submitted to the [email protected] mailing list. Please use unified diff form (the -u option to GNU diff), and include a good description of what your patch does and why it should be applied. If your patch fixes a bug, please make sure to describe the bug and how your fix works.

Make sure that your contribution can be licensed under the same license as the original code you are patching, and that you have all necessary permissions to release your work.