[solved] Link aggregation problems

[spammeatwill]

Hi,

I have setup N4F with link aggregation using two gigabit NIC and I am finding weird behaviours:

1 - If I set the port to DHCP, it gets a lease and I can reach N4F using the leased IP address. However, if I set it to static IP address, it does not work. The interface seems up, the IP is there, but won't communicate.

2 - It seems that the lagg0 interface is missing one laggport, only re0 appears in ifconfig. I believe I should have the two?

Following my current ifconfig. LAN interface is "em0" and LAGG is "re0" + "re1".

Code: Select all

em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO>
        ether 00:1c:c0:05:bf:9c
        inet 10.254.254.1 netmask 0xffffff00 broadcast 10.254.254.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=82098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet6 fe80::821f:2ff:fe00:40bc%re0 prefixlen 64 scopeid 0x5
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex,master>)
        status: active
re1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 00:80:5a:68:b0:bc
        inet6 fe80::280:5aff:fe68:b0bc%re1 prefixlen 64 scopeid 0xa
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex,master>)
        status: active
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0xc
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=82098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet 192.168.1.120 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        groups: lagg
        laggproto lacp lagghash l2,l3,l4
        lag id: [(8000,80-1F-02-00-40-BC,01B0,0000,0000),
                 (0001,00-22-57-9F-0F-20,0019,0000,0000)]
        laggport: re0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3D
                [(8000,80-1F-02-00-40-BC,01B0,8000,0005),
                 (0001,00-22-57-9F-0F-20,0019,0001,000D)]

Notice at the end of ifconfig there is only "laggport: re0", I think "laggport: re1" is missing.

Thanks.

[raulfg3]

destroy your actual lagg and restore mtu from em0 and re0 and re1 to 1500.

re0 do not support 9000 on MTU, and I suspect this cause your problems.

once done, create lagg and do not change MTU until tested, once work, you may experiment to up MTU to 9000 if only involve em0 and em1 and to 6000 if you use re0 or re1

[spammeatwill]

Hi,

raulfg3, thanks for the tip!

I have followed your instructions and the interface seems good now:

Code: Select all

lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 80:1f:02:00:40:bc
        inet 192.168.1.120 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        laggproto lacp lagghash l2,l3,l4
        laggport: re1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: re0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>

I think I will try the bigger MTU only when I really have the need for it.

Testing this interface is still pending, but the configuration seems ok now.

Thanks!

[spammeatwill]

Looking stable after some days, I have to conclude that MTU was the problem.