This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
Root on ZFS?
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Root on ZFS?
Why there are still UFS? Is there any way to move root from ufs to zfs without a pain?..
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: Root on ZFS?
NO.MrWhite wrote:Is there any way to move root from ufs to zfs without a pain?..
Root on ZFS is used on FreeNAS install as default so perhaps need some time to do the same here.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
-
armandh
- Advanced User

- Posts: 398
- Joined: 23 Jun 2012 04:15
- Location: St Louis County Missouri USA
- Status: Offline
Re: Root on ZFS?
I know of no hardware that can read a ZFS file directly and boot an OS from it.
there for, I assume, an OS that can read ZFS must be booted from something else.
one of those "you can't get there from here" problems
there for, I assume, an OS that can read ZFS must be booted from something else.
one of those "you can't get there from here" problems
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: Root on ZFS?
FreeNAS boot disk does, please try on a VM or real hardware to test it.armandh wrote:I know of no hardware that can read a ZFS file directly and boot an OS from it.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
PC hardware knows nothing about FS you use on your disks. (except for uefi and fat32 in modern mb's).armandh wrote:I know of no hardware that can read a ZFS file directly and boot an OS from it.
there for, I assume, an OS that can read ZFS must be booted from something else.
one of those "you can't get there from here" problems
What about FreeBSD - there are a lot of different methods, to boot from ZFS. You can read about it here: https://wiki.freebsd.org/RootOnZFS
-
armandh
- Advanced User

- Posts: 398
- Joined: 23 Jun 2012 04:15
- Location: St Louis County Missouri USA
- Status: Offline
Re: Root on ZFS?
from the linkMrWhite wrote:PC hardware knows nothing about FS you use on your disks. (except for uefi and fat32 in modern mb's).
What about FreeBSD - there are a lot of different methods, to boot from ZFS. You can read about it here: https://wiki.freebsd.org/RootOnZFS
1.1.1. UFS /boot
This installation boots FreeBSD from UFS filesystem /boot filesystem, and then mounts FreeBSD-ZFS partition as the root filesystem (/).
Installing FreeBSD Root on ZFS using UFS /boot
you are not "cold" booting from ZFS files
PC hardware and bios must be compatible with the initial boot storage file system.
Last edited by armandh on 04 Sep 2015 20:26, edited 1 time in total.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
"UFS filesystem /boot " - this is just one of the several available methods. Read more. Especially about FreeBSD-Boot partition. Which is not UFS.armandh wrote: from the link
1.1.1. UFS /boot
PC hardware and bios must be compatible with the initial boot storage file system.
Initial boot storage - in general, is the first sectors of the disk / fat32 partition in case of uefi boot.
PC Hardware or bios knows nothing about UFS, EXT2, EXT3, EXT4, NTFS, or other known FS. Except for fat32 in case of uefi boot.
-
armandh
- Advanced User

- Posts: 398
- Joined: 23 Jun 2012 04:15
- Location: St Louis County Missouri USA
- Status: Offline
Re: Root on ZFS?
I can see creating a MBR slice for a ZFS reader
it is still not booting directly from a zfs file format
but at this point it is splitting hairs.
it is still not booting directly from a zfs file format
but at this point it is splitting hairs.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
MBR slice on GPT. Ooookay....armandh wrote:I can see creating a MBR slice for a ZFS reader.
-
armandh
- Advanced User

- Posts: 398
- Joined: 23 Jun 2012 04:15
- Location: St Louis County Missouri USA
- Status: Offline
Re: Root on ZFS?
The MBR holds the information on how the logical partitions, containing file systems, are organized on that medium. Besides that, the MBR also contains executable code to function as a loader for the installed operating system—usually by passing control over to the loader's second stage, or in conjunction with each partition's volume boot record (VBR). This MBR code is usually referred to as a boot loader.
OK it is not a file system but holds executable code
call it whatever you will it still smells like a file system to me
one the hardware can read directly.
but it gets even more confusing
back in the day when one specified the heads and sectors one tailored the compatibility then partitioned/formatted the drive
now all done by drive firmware, bios and boot loader. so I'll concede the point with a custom boot loader ZFS will boot.
so where is the check box for making the ZFS format bootable?
OK it is not a file system but holds executable code
call it whatever you will it still smells like a file system to me
one the hardware can read directly.
but it gets even more confusing
back in the day when one specified the heads and sectors one tailored the compatibility then partitioned/formatted the drive
now all done by drive firmware, bios and boot loader. so I'll concede the point with a custom boot loader ZFS will boot.
so where is the check box for making the ZFS format bootable?
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: Root on ZFS?
congratulations, you can use HOWTO by JoseMR to do that: viewtopic.php?f=66&t=9522
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
There are only two commonly used partition formats - MBR and GPT. Almost all hardware supports it. And, there are hundreds filesystems, that hardware knows nothing about.
You still needs to partition drive and format that partitions (create filesystems on partitioned space).
Why there are still root UFS in nas4free? 
I've experimenting with nas4free, and was able to move it to zfs root. But, got tons of errors during boot, especially from /etc/rc.d/rcconf script (as far as i remember). Looks like startup scripts trying to mount fs by ufsid, and execute commands on this, but there are no ufsid anymore.
Despite this, it seems everything is working.
Anyways, i've decided to wait until guys implement zfs root on nas4free. Hope, some day it will be implemented.
Only heads/sectors set automatically by bios.armandh wrote:now all done by drive firmware, bios and boot loader.
There is no need of custom ones. Original boot loaders, that came with freebsd started from v7 (or v8) - 'gptzfsboot' or 'zfsboot' - able to boot from mbr or gpt partitioned disks with zfs.armandh wrote:so I'll concede the point with a custom boot loader ZFS will boot.
That was my initial question.armandh wrote:so where is the check box for making the ZFS format bootable?
I've experimenting with nas4free, and was able to move it to zfs root. But, got tons of errors during boot, especially from /etc/rc.d/rcconf script (as far as i remember). Looks like startup scripts trying to mount fs by ufsid, and execute commands on this, but there are no ufsid anymore.
Despite this, it seems everything is working.
Anyways, i've decided to wait until guys implement zfs root on nas4free. Hope, some day it will be implemented.
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
Nope, this is not what i'm asking about. The question was about zfs on root. It means, no ufs at all, only zfs.raulfg3 wrote:congratulations, you can use HOWTO by JoseMR to do that: viewtopic.php?f=66&t=9522
There are no any problems of making data partition with zfs.
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: Root on ZFS?
sorry you are right, I missread post and think that the described trick is suitable for partition 1 or 2 ( boot partition), I re-read and is clear that is not the case.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
- b0ssman
- Forum Moderator

- Posts: 2438
- Joined: 14 Feb 2013 08:34
- Location: Munich, Germany
- Status: Offline
Re: Root on ZFS?
if you want to boot a zfs parition you need grub2
see here for the parameter to boot freebsd using grub2 from zfs.
see here for the parameter to boot freebsd using grub2 from zfs.
Nas4Free 11.1.0.4.4517. Supermicro X10SLL-F, 16gb ECC, i3 4130, IBM M1015 with IT firmware. 4x 3tb WD Red, 4x 2TB Samsung F4, both GEOM AES 256 encrypted.
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
Will grub2 let me avoid all errors i've got from rcconf nas4free script?b0ssman wrote:if you want to boot a zfs parition you need grub2
see here for the parameter to boot freebsd using grub2 from zfs.
Because to boot freebsd from zfs i don't need grub2. I can move nas4free to zfs root, but get tons of errors during boot process, from rcconf script. It seems this scriot uses ufsid's (and there is no any ufs at all).
- daoyama
- Developer

- Posts: 394
- Joined: 25 Aug 2012 09:28
- Location: Japan
- Status: Offline
Re: Root on ZFS?
At least, single pool is not an option for N4F.MrWhite wrote:That was my initial question.Why there are still root UFS in nas4free?
If you get an error/trouble on ZFS pool, you cannot read config required by WebGUI on it.
(it's high risk even if you have hotswap bay.)
Also UFS is stable under low free memory / heavy load.
Note:
Not all mother board support GPT boot.
We cannot ignore it since N4F concept is reuse PC/hardware.
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1
-
MrWhite
- NewUser

- Posts: 8
- Joined: 03 Sep 2015 14:28
- Status: Offline
Re: Root on ZFS?
If webgui cannot read config - then how it works?daoyama wrote:At least, single pool is not an option for N4F.MrWhite wrote:That was my initial question.Why there are still root UFS in nas4free?
If you get an error/trouble on ZFS pool, you cannot read config required by WebGUI on it.
(it's high risk even if you have hotswap bay.)
Also UFS is stable under low free memory / heavy load.
If UFS is stable under low free memory/heavy load - why there are zfs for storage pools? Why not only ufs?
That's why freebsd perfectly boots from mbr with root on zfs.daoyama wrote: Note:
Not all mother board support GPT boot.
We cannot ignore it since N4F concept is reuse PC/hardware.
By the way. I've got router, working on freebsd10.1, boots from gpt partitioned drive. Now, it works on gigabyte GA-8IPE1000, first bios for this motherboard was released on 15/05/2003 (12 years ago!). It knows nothing about gpt or uefi. And it boots without any problems, from gpt partitioned drive.
There is no need of supporting gpt by mother board. Grub2 does, and freebsd boot loader does. https://www.freebsd.org/cgi/man.cgi?que ... TSTRAPPING - there are quite detailed description of freebsd boot process:
...
Both types of bootstrap code are used to boot from the GUID Partition Ta-
ble. First, a protective MBR is embedded into the first disk sector from
the /boot/pmbr image. It searches through the GPT for a freebsd-boot
partition (see the PARTITION TYPES section) and runs the next bootstrap
stage from it. The freebsd-boot partition should be smaller than 545 KB.
It can be located either before or after other FreeBSD partitions on the
disk. There are two variants of bootstrap code to write to this parti-
tion: /boot/gptboot and /boot/gptzfsboot.
...
/boot/gptzfsboot is used to boot from ZFS. It searches through the GPT
for freebsd-zfs partitions, trying to detect ZFS pools. After all pools
are detected, /boot/zfsloader is started from the first one found.
-
armandh
- Advanced User

- Posts: 398
- Joined: 23 Jun 2012 04:15
- Location: St Louis County Missouri USA
- Status: Offline
Re: Root on ZFS?
and circuitously grub2 in that case wont be in ZFS
[if I understand this]
[if I understand this]
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]
- JoseMR
- Hardware & Software Guru

- Posts: 1058
- Joined: 16 Apr 2014 04:15
- Location: PR
- Contact:
- Status: Offline
Re: Root on ZFS?
Sorry for the old thread
, but interested/experienced users digging about this topic, can play/test on a VM with my RootOnZFS installer for NAS4Free 10.x, currently supports GPT single ZFS disk and ZFS mirror installs, for Full platforms only.
RootOnZFS: viewtopic.php?f=17&t=9959#p62256
Regards
RootOnZFS: viewtopic.php?f=17&t=9959#p62256
Regards
System: FreeBSD 12 RootOnZFS Mirror, MB: Supermicro X8SI6-F, Xeon X3450, 16GB DDR3 ECC RDIMMs.
XigmaNAS RootOnZFS
Addons at GitHub
BastilleBSD
Boot Environments Intro
Resources Home Page
XigmaNAS RootOnZFS
Addons at GitHub
BastilleBSD
Boot Environments Intro
Resources Home Page
-
danmero
- NewUser

- Posts: 8
- Joined: 16 Feb 2016 04:23
- Status: Offline
Re: Root on ZFS?
ZFS is not a partion nor a filesystem known by BIOS , please take a look at Booting From a ZFS Root File System,MrWhite wrote:That was my initial question.Why there are still root UFS in nas4free?
The "the boot device specifier" is located in the filesystem >> located in the active partition(GPT or MBR) >> that is recognized by BIOS.Booting from a ZFS file system differs from booting from a UFS file system because with ZFS, the boot device specifier identifies a storage pool, not a single root file system."
Hi Everybody , sorry for my ugly first post