This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

ZFS deduplication questions

Hard disks, HDD, RAID Hardware, disk controllers, SATA, PATA, SCSI, IDE, On Board, USB, Firewire, CF (Compact Flash)
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
User avatar
dnar
Starter
Starter
Posts: 65
Joined: 27 Apr 2013 10:38
Location: Perth Australia
Status: Offline

ZFS deduplication questions

Post by dnar »

Just wondering about how dedup works and have a few questions.

1. Will ZFS dedup existing files when it's enabled for the first time?

2. Once enabled, can you disable later?

3. Am I correct in assuming dedup only works within a dataset?

Many thanks in advance.
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS deduplication questions

Post by raulfg3 »

dnar wrote: Will ZFS dedup existing files when it's enabled for the first time?
no, dedup never files only , NOT existing ones.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
dnar
Starter
Starter
Posts: 65
Joined: 27 Apr 2013 10:38
Location: Perth Australia
Status: Offline

Re: ZFS deduplication questions

Post by dnar »

Cool, I suspected as much. Do you know the performance hit with dedup enabled?
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps

ku-gew
Advanced User
Advanced User
Posts: 172
Joined: 29 Nov 2012 09:02
Location: Den Haag, The Netherlands
Status: Offline

Re: ZFS deduplication questions

Post by ku-gew »

Extreme hit. Have you tried a search in Google before asking?
HP Microserver N40L, 8 GB ECC, 2x 3TB WD Red, 2x 4TB WD Red
XigmaNAS stable branch, always latest version
SMB, rsync

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS deduplication questions

Post by raulfg3 »

sorry, no, I remember from a old article I read time ago, perhaps I'm wrong?
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS deduplication questions

Post by raulfg3 »

I google a bit as you suggest and find this: https://groups.google.com/a/zfsonlinux. ... fBO7IPGL68
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
dnar
Starter
Starter
Posts: 65
Joined: 27 Apr 2013 10:38
Location: Perth Australia
Status: Offline

Re: ZFS deduplication questions

Post by dnar »

ku-gew wrote:Extreme hit. Have you tried a search in Google before asking?
Sorry for asking.
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps

ku-gew
Advanced User
Advanced User
Posts: 172
Joined: 29 Nov 2012 09:02
Location: Den Haag, The Netherlands
Status: Offline

Re: ZFS deduplication questions

Post by ku-gew »

Sorry raulgf3, I wasn't criticizing your answer, only the question about dedupe performances, since a simple "zfs dedupe performance hit" gives back a lot of useful results.
HP Microserver N40L, 8 GB ECC, 2x 3TB WD Red, 2x 4TB WD Red
XigmaNAS stable branch, always latest version
SMB, rsync

Post Reply

Return to “Hard disk & controller”