Just wondering about how dedup works and have a few questions.
1. Will ZFS dedup existing files when it's enabled for the first time?
2. Once enabled, can you disable later?
3. Am I correct in assuming dedup only works within a dataset?
Many thanks in advance.
This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
ZFS deduplication questions
- dnar
- Starter

- Posts: 65
- Joined: 27 Apr 2013 10:38
- Location: Perth Australia
- Status: Offline
ZFS deduplication questions
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: ZFS deduplication questions
no, dedup never files only , NOT existing ones.dnar wrote: Will ZFS dedup existing files when it's enabled for the first time?
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
- dnar
- Starter

- Posts: 65
- Joined: 27 Apr 2013 10:38
- Location: Perth Australia
- Status: Offline
Re: ZFS deduplication questions
Cool, I suspected as much. Do you know the performance hit with dedup enabled?
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
-
ku-gew
- Advanced User

- Posts: 172
- Joined: 29 Nov 2012 09:02
- Location: Den Haag, The Netherlands
- Status: Offline
Re: ZFS deduplication questions
Extreme hit. Have you tried a search in Google before asking?
HP Microserver N40L, 8 GB ECC, 2x 3TB WD Red, 2x 4TB WD Red
XigmaNAS stable branch, always latest version
SMB, rsync
XigmaNAS stable branch, always latest version
SMB, rsync
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: ZFS deduplication questions
sorry, no, I remember from a old article I read time ago, perhaps I'm wrong?
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
- raulfg3
- Site Admin

- Posts: 4865
- Joined: 22 Jun 2012 22:13
- Location: Madrid (ESPAÑA)
- Contact:
- Status: Offline
Re: ZFS deduplication questions
I google a bit as you suggest and find this: https://groups.google.com/a/zfsonlinux. ... fBO7IPGL68
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)
Wiki
Last changes
HP T510
Wiki
Last changes
HP T510
- dnar
- Starter

- Posts: 65
- Joined: 27 Apr 2013 10:38
- Location: Perth Australia
- Status: Offline
Re: ZFS deduplication questions
Sorry for asking.ku-gew wrote:Extreme hit. Have you tried a search in Google before asking?
NAS 1: NAS4Free 9.3.0.2 x64 embedded, Intel Core 2 E8400, 8GB, 6 x WD Green 1TB in RAIDZ2, Highpoint 2720 SAS x 8 card 6Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
NAS 2: NAS4Free 10.2.0.2 x64 embedded, Intel Core i3-3220, 8GB, 7 x WD Green 750GB in RAIDZ1, onboard SATA 3Gbps
-
ku-gew
- Advanced User

- Posts: 172
- Joined: 29 Nov 2012 09:02
- Location: Den Haag, The Netherlands
- Status: Offline
Re: ZFS deduplication questions
Sorry raulgf3, I wasn't criticizing your answer, only the question about dedupe performances, since a simple "zfs dedupe performance hit" gives back a lot of useful results.
HP Microserver N40L, 8 GB ECC, 2x 3TB WD Red, 2x 4TB WD Red
XigmaNAS stable branch, always latest version
SMB, rsync
XigmaNAS stable branch, always latest version
SMB, rsync