Page 1 of 1

[solved] Link aggregation problems

Posted: 10 Dec 2013 12:44
by spammeatwill
Hi,

I have setup N4F with link aggregation using two gigabit NIC and I am finding weird behaviours:

1 - If I set the port to DHCP, it gets a lease and I can reach N4F using the leased IP address. However, if I set it to static IP address, it does not work. The interface seems up, the IP is there, but won't communicate.

2 - It seems that the lagg0 interface is missing one laggport, only re0 appears in ifconfig. I believe I should have the two?

Following my current ifconfig. LAN interface is "em0" and LAGG is "re0" + "re1".

Code: Select all

em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO>
        ether 00:1c:c0:05:bf:9c
        inet 10.254.254.1 netmask 0xffffff00 broadcast 10.254.254.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=82098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet6 fe80::821f:2ff:fe00:40bc%re0 prefixlen 64 scopeid 0x5
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex,master>)
        status: active
re1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 00:80:5a:68:b0:bc
        inet6 fe80::280:5aff:fe68:b0bc%re1 prefixlen 64 scopeid 0xa
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex,master>)
        status: active
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0xc
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=82098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet 192.168.1.120 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        groups: lagg
        laggproto lacp lagghash l2,l3,l4
        lag id: [(8000,80-1F-02-00-40-BC,01B0,0000,0000),
                 (0001,00-22-57-9F-0F-20,0019,0000,0000)]
        laggport: re0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3D
                [(8000,80-1F-02-00-40-BC,01B0,8000,0005),
                 (0001,00-22-57-9F-0F-20,0019,0001,000D)]
Notice at the end of ifconfig there is only "laggport: re0", I think "laggport: re1" is missing.

Thanks.

Re: Link aggregation problems

Posted: 10 Dec 2013 20:06
by raulfg3
destroy your actual lagg and restore mtu from em0 and re0 and re1 to 1500.

re0 do not support 9000 on MTU, and I suspect this cause your problems.

once done, create lagg and do not change MTU until tested, once work, you may experiment to up MTU to 9000 if only involve em0 and em1 and to 6000 if you use re0 or re1

Re: Link aggregation problems

Posted: 23 Dec 2013 16:06
by spammeatwill
Hi,

raulfg3, thanks for the tip!

I have followed your instructions and the interface seems good now:

Code: Select all

lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet 192.168.1.120 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        laggproto lacp lagghash l2,l3,l4
        laggport: re1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: re0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
I think I will try the bigger MTU only when I really have the need for it.

Testing this interface is still pending, but the configuration seems ok now.

Thanks! :)

Re: [solved] Link aggregation problems

Posted: 02 Jan 2014 15:51
by spammeatwill
Looking stable after some days, I have to conclude that MTU was the problem.