This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

Dedup for media files

Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
cancerman
Starter
Starter
Posts: 33
Joined: 23 Jun 2012 07:27
Status: Offline

Dedup for media files

Post by cancerman »

Most of my data is media, movies and music. Is there any real benefit to turning dedup on for this kind of data?
Nas4Free 9.1.0.1.775. EP43T-UD3L, 12GB, Q6600, Supermicro USAS-L8i with IT firmware, 4x 2TB WD Green, 4x 1.5TB WD Green, 3x 1TB Samsung F4, 3x 1TB Seagate Barracuda, 2x 1TB Hitachi Deskstar, OCZ SSD for L2ARC, Mirrored Corsair SSDs for ZIL.

User avatar
shakky4711
Advanced User
Advanced User
Posts: 273
Joined: 25 Jun 2012 08:27
Status: Offline

Re: Dedup for media files

Post by shakky4711 »

No, for this kind of data it makes no sense.

In business areas it makes sense when you store the data from many users... Users do not trust network drives, so the absolute identical sales catalogues and pricelists are stored on several client systems. Our IT department told me with deduplication activated on a filer they shrinked a backup volume of 6TB user data to only 800GB in the end :shock:

Shakky

cancerman
Starter
Starter
Posts: 33
Joined: 23 Jun 2012 07:27
Status: Offline

Re: Dedup for media files

Post by cancerman »

Thanks for the reply. Yeah, I think if I was using this at work, it would be great for all the office documents on the file servers.
Nas4Free 9.1.0.1.775. EP43T-UD3L, 12GB, Q6600, Supermicro USAS-L8i with IT firmware, 4x 2TB WD Green, 4x 1.5TB WD Green, 3x 1TB Samsung F4, 3x 1TB Seagate Barracuda, 2x 1TB Hitachi Deskstar, OCZ SSD for L2ARC, Mirrored Corsair SSDs for ZIL.

odedia
Starter
Starter
Posts: 21
Joined: 15 Jul 2012 21:05
Status: Offline

Re: Dedup for media files

Post by odedia »

Sorry to repost this link all over the forum but I think it's important. Don't use dedup unless you are 100% sure your hardware supports it. It's very risky and "too easy" to enable:

http://mail.opensolaris.org/pipermail/z ... 50428.html

For media - I copied about 1 terabytes and got 1% dedup space back. It's not worth it.

cancerman
Starter
Starter
Posts: 33
Joined: 23 Jun 2012 07:27
Status: Offline

Re: Dedup for media files

Post by cancerman »

Good to know. Thanks, odedia.
Nas4Free 9.1.0.1.775. EP43T-UD3L, 12GB, Q6600, Supermicro USAS-L8i with IT firmware, 4x 2TB WD Green, 4x 1.5TB WD Green, 3x 1TB Samsung F4, 3x 1TB Seagate Barracuda, 2x 1TB Hitachi Deskstar, OCZ SSD for L2ARC, Mirrored Corsair SSDs for ZIL.

Post Reply

Return to “ZFS (only!)”