This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

Dataset or Volume?

Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Dataset or Volume?

Post by xthrillho »

Hi there,

I'm fairly new to ZFS and Unix/BSD in general. So far I've set up my ZFS pool in RAIDZ of 5x 2TB drives - giving me 9.06T - however I think only 7.5TB would be usable? It doesn't really say anywhere.

Now I'm a bit confused on the differences between volumes and datasets. I have looked on the wiki but there doesn't seem to be much information there.

What I'd ultimately like is the ZFS pool to have two usable volumes. One called "media" which would be around 5-6TB, and one called "files" which would use the remainder (1-2TB?) that are shared out.

I'm not sure if I should be created a single volume, and two datasets? Or two volumes and no datasets?

I tried mucking around but didn't get very far. I managed a single volume called data, but I'd really prefer two separate ones. So I've deleted everything (except for the zpool) so I can start from scratch.

Also I've now noticed this:
Name Size Used Free Capacity Dedup Health AltRoot
data 9.06T 5.00T 2.13T 0% 1.00x ONLINE -

I'm not sure why it's saying used 5T? There is nothing on the drives, they are blank.

Some help would be much appreciated.

armandh
Advanced User
Advanced User
Posts: 398
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Dataset or Volume?

Post by armandh »

drives combine to make virtual devices
Vdevs combine to make pools

I am not totally sure about the second part as
i am a single user and just use the whole pool

I think from what I have read here
pools are carved up in to volumes and data sets.
something akin to partitioning the pool
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: Dataset or Volume?

Post by daoyama »

Hi,
xthrillho wrote: What I'd ultimately like is the ZFS pool to have two usable volumes. One called "media" which would be around 5-6TB, and one called "files" which would use the remainder (1-2TB?) that are shared out.
If you have created the volume without sparse, the size is reserved for the volume.
5T is your creation, isn't it?

Note that sparce option of WebGUI is introduced in r308.

I recommend creation of dataset for each shares.
The root pool should not use for storing data.
xthrillho wrote: I managed a single volume called data, but I'd really prefer two separate ones. So I've deleted everything (except for the zpool) so I can start from scratch.
You can change volume size any time. But be careful, you must shrink a partition on the volume before decreasing the volume. Or just set to use sparse volume, it free reserved area of the volume.
Also, you can create sparse new volume like 10TB on the pool.
The combination of sparse and compression/dedupe is useful if you can compress/dedup the files on it.

if you use dataset, you don't worry about the size of it. The default reservation is none for dataset,
but you can set it any time of course.
However WebGUI is not supported this operation :( Yes, I should add it!
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Re: Dataset or Volume?

Post by xthrillho »

Will I need to create a volume at all if using Datasets?

Onichan
Advanced User
Advanced User
Posts: 238
Joined: 04 Jul 2012 21:41
Status: Offline

Re: Dataset or Volume?

Post by Onichan »

xthrillho wrote:Will I need to create a volume at all if using Datasets?
No, volumes currently are really only useful for iSCSI. If you aren't doing SCSI then it is better to just use a Dataset.

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: Dataset or Volume?

Post by daoyama »

daoyama wrote: if you use dataset, you don't worry about the size of it. The default reservation is none for dataset,
but you can set it any time of course.
However WebGUI is not supported this operation :( Yes, I should add it!
I have completed. Now r335 have reservation, and r338 have permission on dataset.
Please try next release.
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Re: Dataset or Volume?

Post by xthrillho »

I couldn't seem to get it working :(

What steps exactly should I take?

1) Format drives to ZFS
2) Create the vdev
3) Create the zpool
4) Create two datasets (media and data)
5) Share datasets using AFP

I do not have to worry about volumes at all?

User avatar
shakky4711
Advanced User
Advanced User
Posts: 273
Joined: 25 Jun 2012 08:27
Status: Offline

Re: Dataset or Volume?

Post by shakky4711 »

Hello,

As far as I understand the FreeNAS/NAS4Free team uses different descriptors compared to the SUN/Oracle origial ZFS documents.

I understand a Dataset should be similar to a ZFS-folder. It is a separate folder wherh you can set individual permissions, restrictions, limits, etc., so perfect for user home.

A volume is better for issues where you have/need a block device, I never needed it, but could be possible to use it for iSCSI targets... someone out there have it running?

Shakky

xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Re: Dataset or Volume?

Post by xthrillho »

Okay so I've got it all nicely setup and can connect via AFP to each individual dataset. However, I can not write!

I have tried everything I can think of. I have granted user permission to write and access.

Without the datasets I can write just fine. But with the two datasets, I can not write. My OS tells me I do not have permission. Have tried with the username setup in NAS4Free, and also local authentication.

Edit: Same thing under SMB/CIFS

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: Dataset or Volume?

Post by daoyama »

xthrillho wrote:I have tried everything I can think of. I have granted user permission to write and access.

Without the datasets I can write just fine. But with the two datasets, I can not write. My OS tells me I do not have permission. Have tried with the username setup in NAS4Free, and also local authentication.
Did you check "Access Restrictions" on ZFS dataset?
ZFSdataset1.png
You do not have the required permissions to view the files attached to this post.
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Re: Dataset or Volume?

Post by xthrillho »

Strange - I didn't seem to see that option?

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: Dataset or Volume?

Post by daoyama »

xthrillho wrote:Strange - I didn't seem to see that option?
Ok, your version is not latest.
I wrote the version in previous post.
Please use 9.1.0.1.344.
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

xthrillho
NewUser
NewUser
Posts: 6
Joined: 06 Oct 2012 04:59
Status: Offline

Re: Dataset or Volume?

Post by xthrillho »

daoyama wrote:
xthrillho wrote:Strange - I didn't seem to see that option?
Ok, your version is not latest.
I wrote the version in previous post.
Please use 9.1.0.1.344.
Have updated and will try tonight. Thank you!

danzi
Starter
Starter
Posts: 66
Joined: 11 Nov 2012 23:24
Location: Budapest
Status: Offline

Re: Dataset or Volume?

Post by danzi »

From the Oracel ZFS admin guide:

dataset
A generic name for the following ZFS components: clones, file systems, snapshots, and volumes.

Each dataset is identified by a unique name in the ZFS namespace. Datasets are identified using the following format:

pool/path[@snapshot]

pool
Identifies the name of the storage pool that contains the dataset

path
Is a slash-delimited path name for the dataset component

snapshot
Is an optional component that identifies a snapshot of a dataset
----------------------------------------------
Dell T130 - 32Gb ECC - ESXi 6.7
VM Full Instal - 11.2.0.4 - Omnius (revision 6005)
HP/LSI 9121-4i SAS2008 Pass Through mode
2 x 2Tb ZFS mirror
1 x 3Tb UFS
----------------------------------------------

Post Reply

Return to “ZFS (only!)”