Link aggregation and vlans

[nadir.latif]

Hello,

I am trying to setup setup vlans and laggs on our nas4free server. I did not find any useful documentation on the nas4free wiki. What steps do we need to follow in order to setup vlans and laggs on our server. we have 2 physical nics that we would like to have bonded. We would like the bonded interface to have a single ip on a vlan.

Thanks,

Nadir Latif

[crowi]

Configuring LAGG I can help, I just tried this little howto from another user:

backup your configuration
go to Network -> Interface Management

in management create
- Interface OPT1 (NIC2)
in LAGG create
- Interface lagg0 with LACP and NIC1 & 2

In Management
- set the order of Interfaces
LAN = lagg0
OPT1 = igb0 (NIC1)
OPT2 = igb1 (NIC2)

reboot

from the console menu start the shell and adjust the rc.conf (folder /etc)

so, go to /etc/

use nano to edit rc.conf:

Code: Select all

nano rc.conf

delete the two lines showing the ipv4: (in my case it was)
ipv4_addrs_igb0="192.168.178.50/24"
ipv4_addrs_res0="192.168.178.50/24"

save file and exit nano (ctrl-x then y to save)

reboot and LAGG is activated

Good luck,
Crowi

[Northwinds]

Hi there
I just decided to go from 9.2 to 10.0.0.2 today and am having real problems setting up my lagg again.
Would you be able to advise me?
Many thanks.

[Northwinds]

Hi again
After much mucking around I have reverted to 9.3 as 10 has a setting - lacp_strict_mode - that is mucking up my lagg.
Did you come across this problem in 10?
Thanks.

[jediknightjason]

help i.ve followed your instructions up to editing the rc.conf file but when i edit such file the lines you mention do not exist....at this point my system has set 192.168.1.250 as the lan network ip v4 addresss and the lagg0 as the network interface. and i have bce0 as OPT1 and bce1 as OPT2 but i have no access via web gui and the nas box doesnt even show up in my windows network. only way it works is if i turn off the lagg and just use one port...but that defeats the purpose of the lagg....i have 2 dual port gigabit nics in this machaine and a gigabit lan on the motherboard i want to utilize.

[Parkcomm]

Hey Jason I don't have the ports to test this now - but are you trying to use VLANs as the title of the thread suggests.
https://plone.lucidsolutions.co.nz/stor ... g-and-vlan

If not I'd suggest you start a new thread - also look here
https://www.freebsd.org/doc/handbook/ne ... ation.html - in particular 30.7.1, it even includes the setup for the cisco router.

Also just a note - I do not know why Crowl has suggested editing the rc.conf, and as I said I cant test it. There are two important stesp Crowl does not mention:

• You need to have your switch set up matching the LAGG method you use (e.g. LACP), and
• You need to to configure the ipV4 for the LACP interface, in particular once lagg0 is set up as the LAN interface go to Network|LAN Management and configure it to use DHCP or set up a static ipv4 address

[daoyama]

Also just a note - I do not know why Crowl has suggested editing the rc.conf, and as I said I cant test it.

I think you don't need to edit files if you don't use lagg member as OPT1, OPT2,...
Using lagg0 as LAN only is enough. (not tested)

[lindsay]

For me it is working without edit a thing with quad intel card connected to an cisco small business switch

[jediknightjason]

ok so i was configureing it right i just need a compatible switch then?
i have the server plugged into a little 5 port netgear gigabit switch at the moment but i plan to plug it permanently into my TP-LINK 16-Port gigabit Ethernet Switch TL-SG1016D Version 4.0
will it work with that switch or do i need to get something else?

My wired network consists of a cisco wrvs4400n small buisness router and a 16 port gigabit switch and 2 little 5 port netgear gigabit switches, one on my workbench and one in my bedroom...i have 5 pc's on this network and 3 small dlink nas boxes of which i hope to replace with this 12 terabye server i.m building..i also have a line from the big switch run downstairs with a verizon wireless router/extender attacted to the end serving as a hotspot for all my downstairs neighbors phones and tablets!.
jason

[Parkcomm]

Both ends of a Lagg need to support the prototcol, so it needs to be a managed switch. HP Procurve 1810 / Cisco SG300-10 / Netgear GSM712,

look for lagg or link aggregation in the specs

FYI - with LACP each end device goes through only one of the interfaces (actually each mac address) so you will only get 1G to any one endpoint, but you multiplex several devices through the switch to fill the 2G lagg link.

[lindsay]

As you can see here on my cisco switch



I have also set the interfaces to Trunk

[daoyama]

As you can see here on my cisco switch

Thank you providing image. Here is one of my switches image.
Dell Power Connect 5324/24 port switch.

20151107B.png

Note: I'm going 10GbE, it's only used for old machine which does not have 10GbE card for multiple ESXi servers for iSCSI link.

The lagg shows like this:

Code: Select all

# ifconfig lagg0
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 00:1b:21:49:ec:5c
        inet 172.16.0.98 netmask 0xffff0000 broadcast 172.16.255.255
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: active
        laggproto lacp lagghash l2,l3,l4
        laggport: igb0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: igb1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>

ESXi side:

20151107C.png

[lindsay]

@daoyama
One tiny problem as i can see it is when using Kodi it starts to buffer content (movies).
Filetransfer though works like a charm, it do not max out at 125MB/s per interface but 110 in average on each interface

Edit: it do not buffering at all on another client, it has to be the client wich cause it
Edit2: It was also connected to an 100Mbps switch
Have not split the clients in the livingroom

[jediknightjason]

thankyou guys for all the info....i've been thinking about upgrading my network to 10gb ethernet and i think that might be the better way to go. thanks again!

[Parkcomm]

All - I've just been trying to set up LACP on two interfaces, an intel (em0) and a broadcom (bge0). The broadcom does not support jumbo frames.

If I have both interfaces configured, cables plugged in and set the lagg for DHCP, I get cyclic reboots. I think the MTU might be the issue, but I would expect it to config the lagg with the size of the first interface and the not add bge0, not a reboot.

Anyone seen anything similar?

[Parkcomm]

Well - I think I've found the problem, and it in fact stops the work around.

The /etc/rc.conf created by nas4free has the following:

Code: Select all

hostname="mightymouse.lan"
ifconfig_lagg0="syncdhcp media 1000baseTX mediaopt full-duplex laggproto lacp laggport em0 laggport bge0"
cloned_interfaces="lagg0"
ifconfig_em0="up mtu 1500"
ifconfig_bge0="up mtu 1500"

whereas the freebsd handbook says

Code: Select all

ifconfig_fxp0="up"
ifconfig_fxp1="up"
cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto failover laggport fxp0 laggport fxp1 10.0.0.15/24"

the laggports have to be up before you create the lagg interface

this causes the following errors

Code: Select all

can't re-use a leaf (tx_test)!
can't re-use a leaf (rx_test)!
can't re-use a leaf (lacp_strict_mode)!
bge0: interface stopped DISTRIBUTING, possible flapping

and switch sets its trunk port to bge0 to DOWN

I think this is the problem here

Hi again
After much mucking around I have reverted to 9.3 as 10 has a setting - lacp_strict_mode - that is mucking up my lagg.
Did you come across this problem in 10?
Thanks.

anyone else seen this?

I'm also suspicious lagg doesn't play well with vlans, but the problem above got in the way of diagnosing the vlan issue.

[daoyama]

The /etc/rc.conf created by nas4free has the following:

Code: Select all

hostname="mightymouse.lan"
ifconfig_lagg0="syncdhcp media 1000baseTX mediaopt full-duplex laggproto lacp laggport em0 laggport bge0"
cloned_interfaces="lagg0"
ifconfig_em0="up mtu 1500"
ifconfig_bge0="up mtu 1500"

whereas the freebsd handbook says

Code: Select all

ifconfig_fxp0="up"
ifconfig_fxp1="up"
cloned_interfaces="lagg0"
ifconfig_lagg0="laggproto failover laggport fxp0 laggport fxp1 10.0.0.15/24"

the laggports have to be up before you create the lagg interface

If you say about line order of rc.conf, it's nothing affect running commands.
rc.conf is definition of variables used by rc.d scripts.

[Parkcomm]

So the order does not matter at all?

I can recreate the problem by entering the commands in the same order as rc.conf in the terminal. What I can say is it looks as if the bge0 has not come up before lagg0 and when I do that in the terminal I see a similar problem with bge0.