I have read for hours different postings and saw things like Realtek nic only supporting jumbo frames at 6000.
Setup is server 2012 either using Broadcom or intel with jumbo frames 9014 and a cat6 6ft cable crossover between the 2 boxes (testing)
When I start a transfer from server to NAS4Free, it starts out at 400+MB/s then after 15sec or so drops to abysmal speeds sometimes 0. then up and down in small amounts never getting back to 100+ speeds on the transfer.
Server Dell2950 - OS 2012 - Dual Quad core 16GB Ram, raid 10 setup across 8 sas drives Copying 50gb MP3's as a test
NAS4Free 9.1.0.1.690 - Tyan Server Mb is Dual Operton 16gb Ram and has 4xPCI-x slots, 20 1TB Hitachi drives and 4 SSD's in Norco RPC Case connected by 3xAOC-SAT2-M2 controllers
Config - added all drives as vdevs, created 1 pool Raidz2 using all hitachi drives, added mirror zil (2 60GB SSD), added 2 SSD Cache.
All drives online, no errors.
Test- Created a 100GB Volume and Extent, setup iscsi and can see the drive G:\ on windows 2012.. (no security yet) I can read and write to drive.
I start folder copy containing mp3's.. and as stated above it starts out at like 400+MB/s then drops.. sometimes to 0 and then is not steady
It does not go back up to 100MB/s or more.
Server 2012 - no services are installed (server is not performing any other tasks) just an empty test server with some folders to test copy speed to SAN
SAN - Empty except the folder I copy to SAN and then Delete.
I was really hoping to see sustained speeds above the normal server to server copy speed of around 30MB/s..
Is my expectation Wrong or what do I need to change / tweak to get 100mb/s or more sustained speeds?
Shouldn't a single Nic with Jumbo frames be above 60MB/s sustained?
I also read that ZFS has a sleep issue when going from cache to SAN Drives? Anyway to smooth this out.
I guess I was thinking that this setup with raid 10 sas on one side and 20+ drives on the other side that the nic throughput would stay maxed out not drop off.
This board also has dual Broadcom gb nics and also a single intel gig pci-x dual or quad nic
added all drives
I am using a crossover cable so no switch at the moment.. either cat 5e or cat 6 tried both.
I have tried with no changes to nics, I have tried with turning everything off except jumbo frames I have tried Broadcom to Broadcom and intel to intel.
Maybe someone has some ideas I can try, as i'm out of them.
Turn off all write caching, (both on Windows and on nas4free) and you will see a very large performance increase. (But you better have a good UPS.)