Mellanox ConectX EN mlxen driver

[marvias]

Hello,

would it be possible to add mlxnet support for 10GE Mellanox cards into official nas4free release ? I tried to create my own build according nas4free wiki, but it fails on either applying kernel patches or kernel compile.

Thanks,
Martin

[zoon01]

Hello marvias, check your pm.

Regards,
zoon01

[Rocketnas]

Hello, zoon01 ! I need help ! I need release Nas4Free with support mlx4_en driver, so, i try connect Mellanox to switch - link Up and down, not working correctly. Thanks zoon01.

[Onichan]

So I was looking into something faster than 1Gb and seems like Mellanox Infiniband is a popular and cheap way. From searching the forums though it looks like nobody has a 9.3 build with driver support for it. Has anybody built the 9.3 kernel with Mellanox support?

Also while on the subject I found somebody mention Chelsio 10Gb SFP NICs. Looks like it requires the cxgb driver and that is normally in 9.3 release, but does anybody know if NAS4Free has it? I looked through my install, but didn't cxgb or t3_tom.ko so looks like it's not installed.

[marvias]

I thought that since 9.2 b972 it is in the OS so there should be no problems with 9.3 branch.

Mellanox makes also ethernet cards (without IB support).
MNPA19-XTR seem to be really cheap now. Tho you need to add twinax copper cable or fiber transceivers depending on your connection length.

[daoyama]

Also while on the subject I found somebody mention Chelsio 10Gb SFP NICs. Looks like it requires the cxgb driver and that is normally in 9.3 release, but does anybody know if NAS4Free has it? I looked through my install, but didn't cxgb or t3_tom.ko so looks like it's not installed.

I don't check the card, but all drivers(except some mandatory) exist in /cf/boot/kernel.
Also kldconfig is configured to load from /cf/boot/kernel, so you only need kldload XXX.ko. (or use loader.conf)
At least 9.3.0.2.1349 have t3_tom.ko and t4_tom.ko. (if_cxgb is in kernel)

[Vitaliy_R]

Hello,

You can use recompiled drivers x64 attached below.

Do not forget add to /boot/loader.conf lines in order to load driver.

mlx4_load="YES"
mlxen_load="YES"

Driver support al ConnectX-2 and ConnectX-3 cards include Pro.
In my build it's working perfect:

Version 10.2.0.2 - Prester (revision 1814)
Build date Sun Aug 30 21:05:02 CEST 2015
Platform OS FreeBSD Revision: 199506
FreeBSD 10.2-RELEASE-p2 #0 r287260M: Fri Aug 28 18:38:18 CEST 2015

Please let me know if you have any problem.

Regards,

Vitaliy

[daoyama]

You can use recompiled drivers x64 attached below.

Do not forget add to /boot/loader.conf lines in order to load driver.

mlx4_load="YES"
mlxen_load="YES"

mlxen.ko and mlx4.ko are bundled in NAS4Free 10.x series. You don't need add it.
Also x64-embedded will load it by default. So you don't need touch loader.conf.
However, full installation does not add it to loader.conf. Yes, it's a bug of NAS4Free.
I never use full installation on physical machine....

For more 10GbE, read this info.
viewtopic.php?f=4&t=9761

[alexplatform]

Is there a way to enable ipoib instead of/in addition to connectx en?

Thanks!

Alex

[viniciusferrao]

Is there a way to enable ipoib instead of/in addition to connectx en?

Thanks!

Alex

I'm interested on this too. Any success with IPoIB mode?

[Vitaliy_R]

Is there a way to enable ipoib instead of/in addition to connectx en?

Thanks!

Alex

I'm interested on this too. Any success with IPoIB mode?

Hello guys,

Sorry for late answer.

AFAIK Infiniband stack is not included in NAS4Free 11.0.0.4.4195, but you can use the latest ConnectX-4 EN adapters
by adding to /boot/loader.conf line in order to load driver.

mlx5en_load="YES"

Vitaliy