This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

Root on ZFS?

New installs of XigmaNAS.
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Root on ZFS?

Post by MrWhite »

Why there are still UFS? Is there any way to move root from ufs to zfs without a pain?..

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Root on ZFS?

Post by raulfg3 »

MrWhite wrote:Is there any way to move root from ufs to zfs without a pain?..
NO.

Root on ZFS is used on FreeNAS install as default so perhaps need some time to do the same here.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Root on ZFS?

Post by armandh »

I know of no hardware that can read a ZFS file directly and boot an OS from it.
there for, I assume, an OS that can read ZFS must be booted from something else.

one of those "you can't get there from here" problems
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Root on ZFS?

Post by raulfg3 »

armandh wrote:I know of no hardware that can read a ZFS file directly and boot an OS from it.
FreeNAS boot disk does, please try on a VM or real hardware to test it.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

armandh wrote:I know of no hardware that can read a ZFS file directly and boot an OS from it.
there for, I assume, an OS that can read ZFS must be booted from something else.

one of those "you can't get there from here" problems
PC hardware knows nothing about FS you use on your disks. (except for uefi and fat32 in modern mb's).

What about FreeBSD - there are a lot of different methods, to boot from ZFS. You can read about it here: https://wiki.freebsd.org/RootOnZFS

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Root on ZFS?

Post by armandh »

MrWhite wrote:PC hardware knows nothing about FS you use on your disks. (except for uefi and fat32 in modern mb's).
What about FreeBSD - there are a lot of different methods, to boot from ZFS. You can read about it here: https://wiki.freebsd.org/RootOnZFS
from the link

1.1.1. UFS /boot

This installation boots FreeBSD from UFS filesystem /boot filesystem, and then mounts FreeBSD-ZFS partition as the root filesystem (/).
Installing FreeBSD Root on ZFS using UFS /boot

you are not "cold" booting from ZFS files

PC hardware and bios must be compatible with the initial boot storage file system.
Last edited by armandh on 04 Sep 2015 20:26, edited 1 time in total.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

armandh wrote: from the link

1.1.1. UFS /boot

PC hardware and bios must be compatible with the initial boot storage file system.
"UFS filesystem /boot " - this is just one of the several available methods. Read more. Especially about FreeBSD-Boot partition. Which is not UFS.

Initial boot storage - in general, is the first sectors of the disk / fat32 partition in case of uefi boot.
PC Hardware or bios knows nothing about UFS, EXT2, EXT3, EXT4, NTFS, or other known FS. Except for fat32 in case of uefi boot.

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Root on ZFS?

Post by armandh »

I can see creating a MBR slice for a ZFS reader
it is still not booting directly from a zfs file format
but at this point it is splitting hairs.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

armandh wrote:I can see creating a MBR slice for a ZFS reader.
MBR slice on GPT. Ooookay.... :) By the way, mbr or gpt is not a filesystem. :)

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Root on ZFS?

Post by armandh »

The MBR holds the information on how the logical partitions, containing file systems, are organized on that medium. Besides that, the MBR also contains executable code to function as a loader for the installed operating system—usually by passing control over to the loader's second stage, or in conjunction with each partition's volume boot record (VBR). This MBR code is usually referred to as a boot loader.

OK it is not a file system but holds executable code
call it whatever you will it still smells like a file system to me
one the hardware can read directly.

but it gets even more confusing
back in the day when one specified the heads and sectors one tailored the compatibility then partitioned/formatted the drive
now all done by drive firmware, bios and boot loader. so I'll concede the point with a custom boot loader ZFS will boot.
so where is the check box for making the ZFS format bootable?
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Root on ZFS?

Post by raulfg3 »

congratulations, you can use HOWTO by JoseMR to do that: viewtopic.php?f=66&t=9522
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

There are only two commonly used partition formats - MBR and GPT. Almost all hardware supports it. And, there are hundreds filesystems, that hardware knows nothing about.
armandh wrote:now all done by drive firmware, bios and boot loader.
Only heads/sectors set automatically by bios. :) You still needs to partition drive and format that partitions (create filesystems on partitioned space).
armandh wrote:so I'll concede the point with a custom boot loader ZFS will boot.
There is no need of custom ones. Original boot loaders, that came with freebsd started from v7 (or v8) - 'gptzfsboot' or 'zfsboot' - able to boot from mbr or gpt partitioned disks with zfs.
armandh wrote:so where is the check box for making the ZFS format bootable?
That was my initial question. :) Why there are still root UFS in nas4free? :)

I've experimenting with nas4free, and was able to move it to zfs root. But, got tons of errors during boot, especially from /etc/rc.d/rcconf script (as far as i remember). Looks like startup scripts trying to mount fs by ufsid, and execute commands on this, but there are no ufsid anymore.
Despite this, it seems everything is working.

Anyways, i've decided to wait until guys implement zfs root on nas4free. Hope, some day it will be implemented.

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

raulfg3 wrote:congratulations, you can use HOWTO by JoseMR to do that: viewtopic.php?f=66&t=9522
Nope, this is not what i'm asking about. The question was about zfs on root. It means, no ufs at all, only zfs.
There are no any problems of making data partition with zfs.

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Root on ZFS?

Post by raulfg3 »

sorry you are right, I missread post and think that the described trick is suitable for partition 1 or 2 ( boot partition), I re-read and is clear that is not the case.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
b0ssman
Forum Moderator
Forum Moderator
Posts: 2438
Joined: 14 Feb 2013 08:34
Location: Munich, Germany
Status: Offline

Re: Root on ZFS?

Post by b0ssman »

if you want to boot a zfs parition you need grub2

see here for the parameter to boot freebsd using grub2 from zfs.
Nas4Free 11.1.0.4.4517. Supermicro X10SLL-F, 16gb ECC, i3 4130, IBM M1015 with IT firmware. 4x 3tb WD Red, 4x 2TB Samsung F4, both GEOM AES 256 encrypted.

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

b0ssman wrote:if you want to boot a zfs parition you need grub2

see here for the parameter to boot freebsd using grub2 from zfs.
Will grub2 let me avoid all errors i've got from rcconf nas4free script?
Because to boot freebsd from zfs i don't need grub2. I can move nas4free to zfs root, but get tons of errors during boot process, from rcconf script. It seems this scriot uses ufsid's (and there is no any ufs at all).

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: Root on ZFS?

Post by daoyama »

MrWhite wrote:That was my initial question. :) Why there are still root UFS in nas4free? :)
At least, single pool is not an option for N4F.
If you get an error/trouble on ZFS pool, you cannot read config required by WebGUI on it.
(it's high risk even if you have hotswap bay.)
Also UFS is stable under low free memory / heavy load.

Note:
Not all mother board support GPT boot.
We cannot ignore it since N4F concept is reuse PC/hardware.
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

MrWhite
NewUser
NewUser
Posts: 8
Joined: 03 Sep 2015 14:28
Status: Offline

Re: Root on ZFS?

Post by MrWhite »

daoyama wrote:
MrWhite wrote:That was my initial question. :) Why there are still root UFS in nas4free? :)
At least, single pool is not an option for N4F.
If you get an error/trouble on ZFS pool, you cannot read config required by WebGUI on it.
(it's high risk even if you have hotswap bay.)
Also UFS is stable under low free memory / heavy load.
If webgui cannot read config - then how it works? :)
If UFS is stable under low free memory/heavy load - why there are zfs for storage pools? Why not only ufs?
daoyama wrote: Note:
Not all mother board support GPT boot.
We cannot ignore it since N4F concept is reuse PC/hardware.
That's why freebsd perfectly boots from mbr with root on zfs.

By the way. I've got router, working on freebsd10.1, boots from gpt partitioned drive. Now, it works on gigabyte GA-8IPE1000, first bios for this motherboard was released on 15/05/2003 (12 years ago!). It knows nothing about gpt or uefi. And it boots without any problems, from gpt partitioned drive.

There is no need of supporting gpt by mother board. Grub2 does, and freebsd boot loader does. https://www.freebsd.org/cgi/man.cgi?que ... TSTRAPPING - there are quite detailed description of freebsd boot process:
...
Both types of bootstrap code are used to boot from the GUID Partition Ta-
ble. First, a protective MBR is embedded into the first disk sector from
the /boot/pmbr image. It searches through the GPT for a freebsd-boot
partition (see the PARTITION TYPES section) and runs the next bootstrap
stage from it. The freebsd-boot partition should be smaller than 545 KB.
It can be located either before or after other FreeBSD partitions on the
disk. There are two variants of bootstrap code to write to this parti-
tion: /boot/gptboot and /boot/gptzfsboot.
...
/boot/gptzfsboot is used to boot from ZFS. It searches through the GPT
for freebsd-zfs partitions, trying to detect ZFS pools. After all pools
are detected, /boot/zfsloader is started from the first one found.

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Root on ZFS?

Post by armandh »

and circuitously grub2 in that case wont be in ZFS
[if I understand this]
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
JoseMR
Hardware & Software Guru
Hardware & Software Guru
Posts: 1058
Joined: 16 Apr 2014 04:15
Location: PR
Contact:
Status: Offline

Re: Root on ZFS?

Post by JoseMR »

Sorry for the old thread :roll: , but interested/experienced users digging about this topic, can play/test on a VM with my RootOnZFS installer for NAS4Free 10.x, currently supports GPT single ZFS disk and ZFS mirror installs, for Full platforms only.

RootOnZFS: viewtopic.php?f=17&t=9959#p62256

Regards
System: FreeBSD 12 RootOnZFS Mirror, MB: Supermicro X8SI6-F, Xeon X3450, 16GB DDR3 ECC RDIMMs.
XigmaNAS RootOnZFS
Addons at GitHub
BastilleBSD
Boot Environments Intro
Resources Home Page

danmero
NewUser
NewUser
Posts: 8
Joined: 16 Feb 2016 04:23
Status: Offline

Re: Root on ZFS?

Post by danmero »

MrWhite wrote:That was my initial question. :) Why there are still root UFS in nas4free? :)
ZFS is not a partion nor a filesystem known by BIOS , please take a look at Booting From a ZFS Root File System,
Booting from a ZFS file system differs from booting from a UFS file system because with ZFS, the boot device specifier identifies a storage pool, not a single root file system."
The "the boot device specifier" is located in the filesystem >> located in the active partition(GPT or MBR) >> that is recognized by BIOS.


Hi Everybody , sorry for my ugly first post ;) long time no see!

Post Reply

Return to “Install XigmaNAS”