Chelsio Communications Chelsio T4 Betriebsanweisung PDF herunterladen (Seite 69)

100

101

Chapter IV. iWARP (RDMA)

i. Set MVAPICH2 with mpi-selector (do this on all nodes).

[root@host]# mpi-selector --set mvapich2-1.7

ii. Edit .bashrc and add these lines:

export MVAPICH2_HOME=/usr/mpi/gcc/mvapich2-1.7/

export MV2_USE_IWARP_MODE=1

export MV2_USE_RDMA_CM=1

iii. Logout & log back in.

iv. Populate mpd.hosts with node names.

v. On each node, create /etc/mv2.conf with a single line containing the IP address of the local

T4 interface. This is how MVAPICH2 picks which interface to use for RDMA traffic.

vi. Run the MPI application as :

mpirun_rsh -ssh -np 8 -hostfile mpd.hosts $MVAPICH2_HOME/tests/IMB-3.2/IMB-

MPI1

4.3. Setting up NFS-RDMA

For NFS-RDMA to work we need to compile and build 2 modules - RNFS-UTILS and

NFSRDMA from OFED during installation. The following section explains how to setup NFS-

RDMA depending upon the version of OFED used:

4.3.1. Building and Installing NFS-RDMA

Using OFED-1.5.3.x

i. Download OFED-1.5.3.x package from the following location

http://www.openfabrics.org/downloads/OFED/ofed-1.5.3/

ii. Untar the package using the following command:

[root@host]# tar -xf <path to OFED package>

1 2 ... 64 65 66 67 68 69 70 71 72 73 74 ... 373 374

Kommentare zu diesen Handbüchern

Keine Kommentare

Chelsio Communications Chelsio T4 Betriebsanweisung Seite 69

Kommentare zu diesen Handbüchern