InfiniBand NFS share troubleshooting(MTU size 2044 to 65520)

문제점

 : MTU 사이즈를 65520으로 설정을 하였으나 최대 2044까지 설정이 가능

 

# cat /etc/sysconfig/network-scripts/ifcfg-ib0

DEVICE=ib0
IPADDR=10.6.1.9
NETMAST=255.255.0.0
ONBOOT=yes
MTU=65520

 

# /etc/sysconfig/network-scripts/ifup ib0

 

# ip addr show ib0

4: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc pfifo_fast state UP qlen 256
    link/infiniband 80:00:00:48:fe:80:00:00:00:00:00:00:00:02:c9:03:00:4b:2a:09 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.6.1.9/8 brd 10.255.255.255 scope global ib0
    inet6 fe80::202:c903:4b:2a09/64 scope link
       valid_lft forever preferred_lft forever

 

해결 방법

 : 기존에 번들로 들어있는 Driver를 제거한 후 Mellanox OFED 1.5.3 버젼 설치

설치방법 : http://isbyeon.tistory.com/227

확인

# ip addr show ib0

4: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc pfifo_fast state UP qlen 1024

    link/infiniband 80:00:00:48:fe:80:00:00:00:00:00:00:00:02:c9:03:00:4b:2a:09 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff

    inet 10.6.1.9/8 brd 10.255.255.255 scope global ib0

    inet6 fe80::202:c903:4b:2a09/64 scope link 

       valid_lft forever preferred_lft forever