Page 1 of 1

Severe performance issues after RAM upgrade, help

Posted: 30 Aug 2015 22:46
by rmoody
I need help please. I just upgraded my NSD4Free system from 4gb to 16gb and am having severe performance issues when copying large files using samba.

Version 10.2.0.2 - Prester (revision 1810)
Platform OS FreeBSD Revision: 199506
FreeBSD 10.2-RELEASE-p2 #0 r287260M: Fri Aug 28 18:38:18 CEST 2015
Platform x64-embedded on AMD Phenom(tm) II X4 955 Processor
System ASUSTeK Computer INC. M4N68T-M-V2
System bios American Megatrends Inc. version: 1001 12/21/2011

I have used ZFS Kernel tune and set it to 16gb and as follows:

Disable prefetch checked
txg.timeout 5
vdev.max_pending 5
vdev.min_pending 4
write_limit_override 0
no_write_throttle 0

CIFS/SMB settings are as follows:

Max Protocol SMB2
Send Buffer Size 128480
Receive Buffer Size 128480
Large read/write enabled
Use sendfile disabled
EA support enabled
Store DOS attributes disabled
Asynchronous I/O (AIO) enabled
AIO read size 1024
AIO write size 1024

When I try to send a large file (over 1gb) the ram usage goes up, cpu not much, NIC activity is just up and down like crazy. Eventually, it stops sending data for so long that windows and clonezilla both choke and say the network resource cannot be found. When this happens, the NAS is completely unreachable via samba or ftp.

What gives? What do I need to do here?
I have an Intel NIC on the way to get rid of this onboard junk NIC.
But this "upgrade" of my RAM is really turning into a complete

I've tried using NFS but it's worse because the second a torrent is added to my transmission system and it starts to download, it instantly looses write access (seriously, what's up with that also?).

Anyone have any advise?

My system log is attached.

Re: Severe performance issues after RAM upgrade, help

Posted: 31 Aug 2015 22:51
by crowi
Go through this to identify the bottleneck
http://n4f.siftusystems.com/index.php/2 ... eshooting/

Re: Severe performance issues after RAM upgrade, help

Posted: 01 Sep 2015 00:44
by rmoody
Thank you, that will this weekends chores. New NIC should be in by then also.

I sent the ram back after discovering my board can use ECC. I'm in talks with the admins at work to see if they have pulled any 8GB sticks. Around there, them are good for leveling table legs. Never know!

Say, did the ZIL/L2ARC drive make a difference on your setup?

Re: Severe performance issues after RAM upgrade, help

Posted: 01 Sep 2015 17:49
by crowi
The ZIL/L2ARC in my setup gave a little performance boost, not much but noteable.

Re: Severe performance issues after RAM upgrade, help

Posted: 27 Sep 2015 21:32
by rmoody
What a journey!

After checking the array performance, it was clear that I had a severe issue with one of the arrays. My newer one, of course. I searched, read, learned things.

I returned the desktop RAM and purchased 16GB of ECC RAM after discovering that my motherboard supported ECC RAM.
I purchased a dual port Intel PCIe NIC.
Purchased a Dell PERC 200 that was then flashed to IT firmware (also have a spare).
Discovered that my motherboard could not support both the HBA and the NIC, not enough x16 PCIe slots.
Installed a dual port Intel PCI NIC which led me to find that my motherboard was having some issues with the PCI ports (could have been the cause of this entire thing).
Ordered a new motherboard with two x16 PCIe slots and 4 RAM slots.
Ordered another 16GB of ECC RAM giving a total of 32GB now.
The new motherboard did not have on board video and all my old PCI video cards either exploded (literally) or could not handle the BIOS graphics, they were that old.
Ordered a x1 PCIe video card (not the easiest to find but found a Nvidia Quatro with no fan).
After installing the HBA one of the drives went offline, bad cable.
Ordered a replacement cable.
Managed to get online with the new motherboard and an old PCI video card with the low profile bracket removed and one drive connected to the on board SATA until the replacement PCIe video card and HBA cable arrived.
New video card installed, HBA cable replaced, PCIe NIC reinstalled, seems to be ok...for now.

Outside the server, I purchased a Cisco SG200 switch. Much faster than my previous switch, but it spontaneously rebooted the other night, monitoring that.

Transfer speed is much improved now. I still need to test running clonezilla which is what brought the system to it's breaking point previously but I just don't feel like it yet.

Thanks for pointing me in the right direction crowi. I think the crisis it mostly over and the bank account can begin to recover now so I can feed my audio hobby after hearing a set of MrSpeakers Ether C headphones, just wow.