Just wondering what the best setup might be for 8x 4TB disks. I need at least 25TB of usable storage and 2 disk redundancy.
I was thinking of putting all 8 disks in a raidZ2 vdef and putting it all as one disk in a pool. But will this give me the best performance?
Right now with 3 x 4TB disks in Raidz2 I get 70MB writes and 350MB reads... I would like to get better writes... or should I put in an SSD cache?
THX for suggestions!.
This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
Best setup for 8x 4TB with 2 disk redundancy.
-
helloha
- Starter

- Posts: 18
- Joined: 23 Jan 2014 14:49
- Status: Offline
Best setup for 8x 4TB with 2 disk redundancy.
Supermicro X7DWN+ - Dual Xeon 5130 - 56GB Ram - 8x 4TB Seagate ST4000DM000 - 2x 4TB HGST HDN724040ALE640 - 1x 256GB Crucial_CT256MX100SSD1 - TDK LoR TF30 USB 3.0 PMAP (boot) - Dell H310 SAS/SATA Controller - 2x HP360T Gb NIC - Supermicro SC825 2U Chassis 920Watt Platinum PSU.
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: Best setup for 8x 4TB with 2 disk redundancy.
if have the opportunity to do test, try:
2 vdev in one pool , each vdev 4x4TB in RaidZ1 ( yes only one disk redundancy per vdev, but 2 disk redundancy in pool, and probably better speed, try it).
2 vdev in one pool , each vdev 4x4TB in RaidZ1 ( yes only one disk redundancy per vdev, but 2 disk redundancy in pool, and probably better speed, try it).
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
- apollo567
- Site Admin

- Posts: 675
- Joined: 23 Jun 2012 06:37
- Location: Ludwigshafen, Germany
- Status: Offline
Re: Best setup for 8x 4TB with 2 disk redundancy.
Hello,
Go at least for 16 Gb RAM perhaps up to 32 GB , and optimize the Configuration in the Loader Conf (Princo gave some very good Configuration tipps).
I have good Experiences with big Samba Cache of 1GB each for send and receive (reduces spikes and increases Speed)
For 25 GB real Space you will need more Disks. With RaidZ2 you will loose 2 disks and 8% for the File system, so u will need one extra disk.
Regards
apollo
Go at least for 16 Gb RAM perhaps up to 32 GB , and optimize the Configuration in the Loader Conf (Princo gave some very good Configuration tipps).
I have good Experiences with big Samba Cache of 1GB each for send and receive (reduces spikes and increases Speed)
For 25 GB real Space you will need more Disks. With RaidZ2 you will loose 2 disks and 8% for the File system, so u will need one extra disk.
Regards
apollo
my NAS and its development until today: viewtopic.php?f=63&t=39&sid=039fed830cf ... 4d0abe4a04
-
helloha
- Starter

- Posts: 18
- Joined: 23 Jan 2014 14:49
- Status: Offline
Re: Best setup for 8x 4TB with 2 disk redundancy.
So if 2 disks in one vdef fail you are out of luck?raulfg3 wrote:if have the opportunity to do test, try:
2 vdev in one pool , each vdev 4x4TB in RaidZ1 ( yes only one disk redundancy per vdev, but 2 disk redundancy in pool, and probably better speed, try it).
Supermicro X7DWN+ - Dual Xeon 5130 - 56GB Ram - 8x 4TB Seagate ST4000DM000 - 2x 4TB HGST HDN724040ALE640 - 1x 256GB Crucial_CT256MX100SSD1 - TDK LoR TF30 USB 3.0 PMAP (boot) - Dell H310 SAS/SATA Controller - 2x HP360T Gb NIC - Supermicro SC825 2U Chassis 920Watt Platinum PSU.
-
helloha
- Starter

- Posts: 18
- Joined: 23 Jan 2014 14:49
- Status: Offline
Re: Best setup for 8x 4TB with 2 disk redundancy.
Hi, yes got 24GB of ram.apollo567 wrote:Hello,
Go at least for 16 Gb RAM perhaps up to 32 GB , and optimize the Configuration in the Loader Conf (Princo gave some very good Configuration tipps).
I have good Experiences with big Samba Cache of 1GB each for send and receive (reduces spikes and increases Speed)
For 25 GB real Space you will need more Disks. With RaidZ2 you will loose 2 disks and 8% for the File system, so u will need one extra disk.
Regards
apollo
2x Xeon E5420
Do you have any links to the Princo tips?
Also perhaps important detail is that I'm running over AFP?
Cheers!
K.
Supermicro X7DWN+ - Dual Xeon 5130 - 56GB Ram - 8x 4TB Seagate ST4000DM000 - 2x 4TB HGST HDN724040ALE640 - 1x 256GB Crucial_CT256MX100SSD1 - TDK LoR TF30 USB 3.0 PMAP (boot) - Dell H310 SAS/SATA Controller - 2x HP360T Gb NIC - Supermicro SC825 2U Chassis 920Watt Platinum PSU.
- apollo567
- Site Admin

- Posts: 675
- Joined: 23 Jun 2012 06:37
- Location: Ludwigshafen, Germany
- Status: Offline
Re: Best setup for 8x 4TB with 2 disk redundancy.
Hello,
here are the value for 8GB RAM, u have to adjust the first 3 topics for 24 GB. You have to add them in the loader Conf.
vm.kmem_size="6656M"
vfs.zfs.arc_min="5120M"
vfs.zfs.arc_max="5120M"
vfs.zfs.prefetch_disable="0"
vfs.zfs.txg.timeout="5"
vfs.zfs.vdev.max_pending="10"
vfs.zfs.vdev.min_pending="4"
vfs.zfs.write_limit_override="0"
vfs.zfs.no_write_throttle="0"
I have no experience with AFP (I don't use anything from apple
). If u use Samba, as mentioned I have good experiences with a very big cache.
here are the value for 8GB RAM, u have to adjust the first 3 topics for 24 GB. You have to add them in the loader Conf.
vm.kmem_size="6656M"
vfs.zfs.arc_min="5120M"
vfs.zfs.arc_max="5120M"
vfs.zfs.prefetch_disable="0"
vfs.zfs.txg.timeout="5"
vfs.zfs.vdev.max_pending="10"
vfs.zfs.vdev.min_pending="4"
vfs.zfs.write_limit_override="0"
vfs.zfs.no_write_throttle="0"
I have no experience with AFP (I don't use anything from apple
my NAS and its development until today: viewtopic.php?f=63&t=39&sid=039fed830cf ... 4d0abe4a04