This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

[SOLVED] Can I expand my pool? ZFS expand question?

Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
nrap
NewUser
NewUser
Posts: 3
Joined: 01 Aug 2012 23:20
Status: Offline

[SOLVED] Can I expand my pool? ZFS expand question?

Post by nrap »

Hello,

I'm new to the ZFS and nas4free. I have an HP microserver with 2 HDDs 1.5TB WD Green.
I have created a virtual disk with those two hdds, and afterwards a zpool like this:

nas4free:~# zpool status FirstPool
pool: FirstPool
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
FirstPool ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
ada0 ONLINE 0 0 0
ada1 ONLINE 0 0 0

errors: No known data errors

Now I've bought another hdd 2TB WD, HOW can I put the hard drive to the FirstPool in order to create a 3 drive zfs pool??
As far as I have read I think I should destroy the pool (probably copy all the files to another drive) recreate the Virtual device with all 3 devices and recreate the pool (???))
Isn't there another way?
Thanks
Nick.
Last edited by al562 on 31 Dec 2012 07:38, edited 1 time in total.
Reason: Adjusted Subject. Added [SOLVED] Tag.

rocket
Starter
Starter
Posts: 52
Joined: 25 Jun 2012 00:48
Location: california
Status: Offline

Re: ZFS expand question

Post by rocket »

as far as I know, there isn't any other way.
older system:
Platform x64-full on AMD Phenom(tm) II X2 555 Processor
System ASUSTeK Computer INC. M4A785T-M Bios: 2002 03/18/2010
10tb pool

shiny new system:
Platform x64-embedded on Intel(R) Core(TM) i5 CPU 760 @ 2.80GHz
System ASUSTeK Computer INC. P7P55D-E LX
12gb RAM
running 11.20.4 - Omnius (revision 6766)

60tb, 15tb, and 10tb pools

rocketgirls know how to have fun

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS expand question

Post by raulfg3 »

You can grow pools whithout losing data in two ways ,

1 change all disk in the pool, one by one doing a resilver in each change, when resilver last disk, your pool grow to new size.
2 create a new pool and add to the existing one.

Eg case 2: You have a Raidz1 of 3 disk, each disk of 1 TB = 2TB free, If you add 3 new disk of 1 TB, to create a new pool, and add this new pool to the existing one, You have a new pool of 4 TB. (1 pool = 2 vdev, 1 vdev = 3 disk)
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

rocket
Starter
Starter
Posts: 52
Joined: 25 Jun 2012 00:48
Location: california
Status: Offline

Re: ZFS expand question

Post by rocket »

raulfg3 wrote: 2 create a new pool and add to the existing one.

Eg case 2: You have a Raidz1 of 3 disk, each disk of 1 TB = 2TB free, If you add 3 new disk of 1 TB, to create a new pool, and add this new pool to the existing one, You have a new pool of 4 TB. (1 pool = 2 vdev, 1 vdev = 3 disk)
Ooh, I didn't know this, nice loophole!
older system:
Platform x64-full on AMD Phenom(tm) II X2 555 Processor
System ASUSTeK Computer INC. M4A785T-M Bios: 2002 03/18/2010
10tb pool

shiny new system:
Platform x64-embedded on Intel(R) Core(TM) i5 CPU 760 @ 2.80GHz
System ASUSTeK Computer INC. P7P55D-E LX
12gb RAM
running 11.20.4 - Omnius (revision 6766)

60tb, 15tb, and 10tb pools

rocketgirls know how to have fun

cancerman
Starter
Starter
Posts: 33
Joined: 23 Jun 2012 07:27
Status: Offline

Re: ZFS expand question

Post by cancerman »

ZFS supports ORE, Online RAID Expansion, as stated above. Replace each disk with a larger one until all are replaced and the RAID grows.

It doesn't support RLM, RAID Level Migration. Taking a 3 drive RAID, adding a drive and turning it into a 4 drive RAID, while online.
Nas4Free 9.1.0.1.775. EP43T-UD3L, 12GB, Q6600, Supermicro USAS-L8i with IT firmware, 4x 2TB WD Green, 4x 1.5TB WD Green, 3x 1TB Samsung F4, 3x 1TB Seagate Barracuda, 2x 1TB Hitachi Deskstar, OCZ SSD for L2ARC, Mirrored Corsair SSDs for ZIL.

oleost
NewUser
NewUser
Posts: 12
Joined: 11 Sep 2012 10:15
Status: Offline

Re: ZFS expand question

Post by oleost »

cancerman wrote:It doesn't support RLM, RAID Level Migration. Taking a 3 drive RAID, adding a drive and turning it into a 4 drive RAID, while online.
You write "While online", does it support to do so if you take the raid offline ?

Onichan
Advanced User
Advanced User
Posts: 238
Joined: 04 Jul 2012 21:41
Status: Offline

Re: ZFS expand question

Post by Onichan »

oleost wrote:
cancerman wrote:It doesn't support RLM, RAID Level Migration. Taking a 3 drive RAID, adding a drive and turning it into a 4 drive RAID, while online.
You write "While online", does it support to do so if you take the raid offline ?
No it doesn't.

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Can I Expand My Pool?

Post by ...alex »

I'm sure this question has been answered many times but i couldn't find anything when searching!

Currently, i have 3x2TB disks setup with RADIZ1.

I am starting to run out of space so i would like to add some more disks.

Can i simply purchase identicle disks and expand the Pool?

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

are you try to find expand pool in search bar?:
viewtopic.php?f=66&t=823&p=2442&hilit=expand+pool#p2442
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Re: Can I Expand My Pool?

Post by ...alex »

I did read that thread, but obviously not well enough >_<

I guess i will need to buy all new disks! :( Even if i replace each disk with a larger one, i will only ever be able to have a 3 disk array, right?
Last edited by ...alex on 24 Oct 2012 08:17, edited 1 time in total.

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

No you can add a new vded , so you can have your actual 3 Disk plus new ones eg: 3x2TB+3x2Tb = 8TB usable
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

anicesteak
NewUser
NewUser
Posts: 7
Joined: 23 Oct 2012 05:10
Status: Offline

Re: Can I Expand My Pool?

Post by anicesteak »

If I recall, the way to do it is replace your 2TB disks with 3TB one disk at a time, waiting for things to sync up in between. Then you can add another disk.

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Re: Can I Expand My Pool?

Post by ...alex »

anicesteak wrote:If I recall, the way to do it is replace your 2TB disks with 3TB one disk at a time, waiting for things to sync up in between. Then you can add another disk.
And then add another disk? So you mean... if i have an array with 3 disks, i replace all three with larger disks, i can add a 4th disk to the array? If that's the case, why could i not just add another disk to the array as it stands now?

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

...alex wrote:if i have an array with 3 disks, i replace all three with larger disks, i can add a 4th disk to the array?
NO.

Add a 4th disk do ont work
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

PD: have a look at this post:
viewtopic.php?f=66&t=1528

In latest version of Nas4Free autoexpand=on is on by default, but revise it.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Re: Can I Expand My Pool?

Post by ...alex »

Ok, got it. So i have three options:
1) Replace all three disks with bigger disks e.g. 3TB. My array will only ever be able to have 3 disks.
2) Create a new VDev with new disks (this requires an extra disk for redundancy).
3) Copy the data to a temp location, create a new pool with more disks and then copy the data back.

Personally, i think option 3 is the best.

What's the best way to plan for future expansion?

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

I can say my future plan.
I actually have a poll of 5 disk in raidz1 = 5x2TB = 8TB free more or less , in fact 7,15TB real size).
My plan is to expand my pool adding 5 new disk in raidZ1 = 5x2TB = 8TB plus actual 8TB = 16 TB = 14TB real

PD: To do , I need a new SATA controller because motherboard only have 6 SATA Port, but my case support 18 disk.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Re: Can I Expand My Pool?

Post by ...alex »

Cool!

Your way means that you have two disks dedicated to redundancy, whereas if you had it in one giant raidz1 array you would only need 1 disk for redundancy.

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

...alex wrote: whereas if you had it in one giant raidz1 array you would only need 1 disk for redundancy
YES, but is not recomended, because fails increase with the number of disk, and because of this is not recomended to have more that 9 disk in a raidz1 ( you can have 90 disk in raidz1 but is recomended that you use 10 pools of 9 disk in raidz1 each one) = 10 disk lost in parity , but more robutness.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

...alex
NewUser
NewUser
Posts: 9
Joined: 12 Jul 2012 08:48
Status: Offline

Re: Can I Expand My Pool?

Post by ...alex »

It's all very clear now. Thanks for all of your help!

User avatar
ChriZathens
Forum Moderator
Forum Moderator
Posts: 758
Joined: 23 Jun 2012 09:14
Location: Athens, Greece
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by ChriZathens »

raulfg3 wrote:
PD: To do , I need a new SATA controller because motherboard only have 6 SATA Port, but my case support 18 disk.
Sorry for the off topic but what case do you have that supports 18 disks?
My Nas
  1. Case: Fractal Design Define R2
  2. M/B: Supermicro x9scl-f
  3. CPU: Intel Celeron G1620
  4. RAM: 16GB DDR3 ECC (2 x Kingston KVR1333D3E9S/8G)
  5. PSU: Chieftec 850w 80+ modular
  6. Storage: 8x2TB HDDs in a RaidZ2 array ~ 10.1 TB usable disk space
  7. O/S: XigmaNAS 11.2.0.4.6625 -amd64 embedded
  8. Extra H/W: Dell Perc H310 SAS controller, crosflashed to LSI 9211-8i IT mode, 8GB Innodisk D150SV SATADOM for O/S

Backup Nas: U-NAS NSC-400, Gigabyte MB10-DS4 (4x4TB Seagate Exos disks in RaidZ configuration - 32GB RAM)

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

sharkoon rebel 12
rebel12_b_value.jpg
rebel12_b_2.jpg
You do not have the required permissions to view the files attached to this post.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
ChriZathens
Forum Moderator
Forum Moderator
Posts: 758
Joined: 23 Jun 2012 09:14
Location: Athens, Greece
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by ChriZathens »

Nice!
I guess you use 5,25" to 3,5" hdd cages, then??
My Nas
  1. Case: Fractal Design Define R2
  2. M/B: Supermicro x9scl-f
  3. CPU: Intel Celeron G1620
  4. RAM: 16GB DDR3 ECC (2 x Kingston KVR1333D3E9S/8G)
  5. PSU: Chieftec 850w 80+ modular
  6. Storage: 8x2TB HDDs in a RaidZ2 array ~ 10.1 TB usable disk space
  7. O/S: XigmaNAS 11.2.0.4.6625 -amd64 embedded
  8. Extra H/W: Dell Perc H310 SAS controller, crosflashed to LSI 9211-8i IT mode, 8GB Innodisk D150SV SATADOM for O/S

Backup Nas: U-NAS NSC-400, Gigabyte MB10-DS4 (4x4TB Seagate Exos disks in RaidZ configuration - 32GB RAM)

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Can I Expand My Pool?

Post by raulfg3 »

yes
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

degen
Status: Offline

Re: Can I Expand My Pool?

Post by degen »

Moin,
expanding storage if you don't use stripe setup is always a pain.
I would just replace the drives by bigger ones, but as we know drives a damn expensive these day's.
A while back I decide to reorganize my drives to have the possibility for cheap expansion of storage.

I have two arrays/pools
1) heaven, which is a just a simple stripe (here 2x2TB==4TB usable)
2) hell, which is usually a mirror out of two drives (here 2x1TB = 1TB usable). I have this spare disks from my last heaven upgrade

Heaven dont need redundancy cause it completly backed up once a month.
Hell, contain all new files.

Once a month I copy my files from hell to heaven, then I recreate my full backup, test the backup and delete the files on hell.

If I need more space I add a disk to heaven and sometimes I need a new drive for backup too (depends on compression etc.)
The benefit I have is that I dont need two identical new drives at the same time. My money dictate me which drives I can buy.
Yes, you need double space since every file is mirrored (hell) or on the backup. But this is OK, since I can easy expand storage and always have a REAL backup.

degen

Post Reply

Return to “ZFS (only!)”