*New 12.1 series Release:
2019-11-08: XigmaNAS 12.1.0.4.7091 - released!

*New 11.3 series Release:
2019-10-19: XigmaNAS 11.3.0.4.7014 - released


We really need "Your" help on XigmaNAS https://translations.launchpad.net/xigmanas translations. Please help today!

Producing and hosting XigmaNAS costs money. Please consider donating for our project so that we can continue to offer you the best.
We need your support! eg: PAYPAL

Story of my storage project

Show off that XigmaNAS system!
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Story of my storage project

#1

Post by crowi » 29 Apr 2014 16:49

So, finally here is my little vanity and fishing for compliments thread. :)

Anyway, all comments, even critical ones, are welcome :)


The story of my MILCHKUH
Milchkuh_label.png
It all started in the year 2009 with the sudden death of my old (>20 years) Philips TV and the urge to buy a modern 42" full HD flatscreen TV with HDMI and all that (at this time) fancy new stuff.

On this new screen my beloved Sony PS2 and VHS tapes looked just ugly, so I first bought the PS3 and wanted to start using a (Atom based) HTPC for TV recording via DVB-T.

This made me also need a central data storage for the movies and all that stuff that gathered on my PCs by the time. So I installed a 2x2TB Buffalo Linkstation Duo as NAS system (configured as RAID0). :-o
With the most important data backed up to a whole bunch of external drives, of course.

DVB-T recording was ugly too (bad resolution, no AC3 sound) and the Atom was too weak to really serve as HTPC (stuttering youtube playback), so I upgraded the HTPC with a Asus microITX FM1 board and an AMD A3850 processor and I added a quad-tuner DVB-C PCIe card. :-D

Ahhh, so nice, being able to stream HDTV via LAN and WLAN to all devices, recording up to 16 channels at once and having real timeshift was great --- but my little NAS was filling up like crazy.

So, in 2012 I started to consider buying a QNAP or Synology NAS with RAID5 and 4 HDD bays.

But I also had the Atom-board left over, hmmmm...

Googling around to find the optimum NAS for me, I stumbled over NAS4Free.

As I had to buy four HDDs anyway, I gave it a try, to see if N4F fits my need, so I built up a breadboard with the Atom and just the 4 drives (WD Red / 3TB) and I started to like the system.

In February 2013 I finally ordered a case (Bitfenix Prodigy) and a 80+ PSU (BeQuiet) and assembled the first version of my new "Milchkuh". :)

With some help from the forum (special thanks here to Apollo, Raulf, Bossman, Princo, Armandh, Rostreich, and many others who helped me getting it up and running smooth) I switched from RAID5 to ZFS and I soon recognized that the Atom with just 4GB RAM is a little too weak to be used as server (getting just about 40MB/s transfer speed).

I ordered the slightly more powerful E350 board (Asrock E350M1) with 8GB RAM and I read that RAIDZ1 is loosing performance when run at even disk numbers, so I ordered a 5th disk for the REAL final and last assembly. :)

(Additionally I needed another 4 port SATA PCIe adapter to connect the fith drive.) :-/

Now I still had 3 SATA ports and also two SSDs left over which I now used for
a) System, swap and data for the full inastallation (which I would not do again, now, one year of learning later)
b) log and cache for the ZFS pool (which I might remove again, someday)

This system was up for 18 months without any problem.

Now in spring 2014 the discussion came up to use ECC RAM on ZFS, thus I switched to the Asrock C2550D4I board and 16 GB of ECC RAM. Which is now the preliminary final configuration.

Again, I have 5 SATA ports unused on the C2550D4I, which might get connected with additional drives, some day. :-D

And I have a E350M1 board left over, waiting for new challenges.

The Atom Board was put in a hand-made acrylic case and serves as test station, running Xubuntu or HBCD/Parted Magic for testing disks.

The 42" TV died after 4 years (with no chance to repair, thank you Philips!) and was replaced by 50" one (not Philips again) ;)

Pictures will follow soon. :-D

Cheers,
Crowi
You do not have the required permissions to view the files attached to this post.
Last edited by crowi on 30 Apr 2014 16:36, edited 3 times in total.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

armandh
Advanced User
Advanced User
Posts: 403
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Story of my storage project

#2

Post by armandh » 29 Apr 2014 19:11

sounds quite advanced!
I was the miller's donkey when it came to HTPC,.....
but the 2 Atom boards [below] work fine for storage, one shown here
viewtopic.php?f=63&t=6459
I leave the trans coding or .MKV rendering to the later HTPCs
it does not take much to just stream the raw file out of storage
[shown here a 333 or 366 Mhz celeron, I forget which, with 384 Mb of PC100 ram]
https://www.youtube.com/watch?v=NT0VTwr ... e=youtu.be
obviously not ZFS, just UFS mirror
Last edited by armandh on 29 Apr 2014 19:13, edited 1 time in total.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
apollo567
Site Admin
Site Admin
Posts: 722
Joined: 23 Jun 2012 06:37
Location: Ludwigshafen, Germany
Status: Offline

Re: Story of my storage project

#3

Post by apollo567 » 29 Apr 2014 19:13

Nice Saga :-)

You mentioned :

"quad-tuner DVB-C PCIe card."

"Additionally I needed another 4 port SATA PCIe adapter to connect the fith drive."

Which ones please ?

Regardsd
apollo
my NAS and its development until today: viewtopic.php?f=63&t=39&sid=039fed830cf ... 4d0abe4a04

User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Re: Story of my storage project

#4

Post by crowi » 29 Apr 2014 20:15

@ Apollo,

thanks. :)

the DVB-C card is a digital devices Cine CT (dual tuner) with additional Duoflex module (additional 2 tuners),
I don't want to make advertisments here, but this card is plugged in and just works, together with DVBviewer & Recording Service to stream to the LAN:
http://www.digitaldevices.de/Cine_CT.html
Before I used a twin tuner USB DVB-T stick and had lots of dropouts.


The PCI SATA card was a consumer level thingie, a Dawicontrol DC-624e which also worked out of the box.

@Armandh

I don't do transcoding and re-rendering yet, I played with x264 but did not find a good compression vs outcome adjustment, any help here is appreciated :)
I follow your projects already ;)
The Atom board and Linux is a quite nice system, I love it when I don't want to start my BIG PC

Cheers,
Crowi
Last edited by crowi on 30 Apr 2014 16:37, edited 1 time in total.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

armandh
Advanced User
Advanced User
Posts: 403
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Story of my storage project

#5

Post by armandh » 30 Apr 2014 02:50

right now our cable company went all digital no QAM any more [actually DVB-C]
the new set top cable boxes have HDMI out or low def
I have 2 Panasonic DVD-r that would receive hi def [still do but now only over the air 8vsb ATSC] they only have 480i video inputs.
I found a solution HDMI to 8vsb ATSC TS encoder & RFmodulator
I have it on order, I already have a HDMI to DVB-B [north american cable clear qam] using the J.83b QAM and H.264 compression
I am using it with an ATI diamond 750 USB software defined radio for amateur digital TV
it has recording software but the set top DVRs produce regular dvds, not files on disk.
sadly they are not H.264 compatible [thus the ATSC unit on order] received and it works very well
Last edited by armandh on 02 Mar 2016 04:16, edited 3 times in total.
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Re: Story of my storage project

#6

Post by crowi » 30 Apr 2014 08:05

Hi Armandh,

that's why I am happy to use a HTPC with DVB-C tuners. The recordings are just raw .ts files and can be used to be viewed directly or can be converted to any other format easily. The only drawback is that in Germany only a few stations send HDTV for free and mainly only in 720i. But still better than SDTV. ;)
Last edited by crowi on 30 Apr 2014 16:38, edited 1 time in total.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

User avatar
lindsay
Forum Moderator
Forum Moderator
Posts: 311
Joined: 23 Jun 2012 09:59
Location: Steinkjer,Norway
Status: Offline

Re: Story of my storage project

#7

Post by lindsay » 30 Apr 2014 10:51

Havent tried to record from XBMC, but stream from dreambox to XBMC works though.
Need to have openelec to get subtitles and you save some bucks.

Subscribe for more extra cards plus a dedicated tuners
Protected by smoothiebox Red,Green,
Purple,Orange Zones/VLAN`s
Powered by AMD A10-6700T


XigmaNAS Box-1 11.2.0.4 - Omnius (revision 6625)
Platform : x64-embedded on 2X Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
Motherboard: ASUS Z10PA-D8, 2xSocket-2011-3
SATA Controllers : 1X Avago Technologies (LSI) SAS2008 and 1x Avago Technologies (LSI) SAS2308
Pool 1 (Media-Pool) 8X4TB in raidz2
Pool 2 (Media-Pool-2) 4X2TB in raidz2 and 2X2TB in mirror mirror and 2X3TB in mirror
Pool 3 (Media-Pool-3) 2X2TB in mirror and 2X4TB in mirror and 2X1TB in mirror

armandh
Advanced User
Advanced User
Posts: 403
Joined: 23 Jun 2012 04:15
Location: St Louis County Missouri USA
Status: Offline

Re: Story of my storage project

#8

Post by armandh » 30 Apr 2014 21:36

often the limit is the source material
there are 5 local over the air ATSC and they look good...live over the air feeding the DVD-r
not so good on older program material they use to fill the other slots in the transport stream
PS
the [Digicast brand] HDMI to ATSC-8vsb encoder/modulator works great.
I will be able to circumvent the low res. video input limitations/conflicts of the Panasonic DVD-r,
with the [component or HDMI] higher res. video output limitations of the cable box

also available in DVB-T
4 thread 3300 Mhz Intel i3, 1 TB ZFS mirror, available RAM 7.823 Gb, 64 bit NAS4Free 9.1.0.1 rev 573 [88 watts, 48 Mbps]
2 thread 1600 Mhz atom/ion, 1 TB ZFS mirror, available RAM 3.083 Gb, 64 bit NAS4Free-9.1.0.1 rev 573 [27 watts, 35 Mbps]
2 thread 3900 Mhz AMD A6-6400K, 2 TB ZFS Mirror, available RAM 7.557 Gb, 64 bit Nas4Free 9.3.0.2.1771 [89 watts, 68 Mbps]

User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Re: Story of my storage project

#9

Post by crowi » 23 May 2014 10:52

Finally some pics (a little dusty though) :)

The outside:
outside.jpg
Inside, left wing containing the SSDs:
SSDs.jpg
Inside main, motherboard, PSU and Pool:
inside.jpg
and a close up of the ZFS-pool:
pool.jpg
That's it. :oops:

Cheers,
Crowi
You do not have the required permissions to view the files attached to this post.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

kenZ71
Advanced User
Advanced User
Posts: 403
Joined: 27 Jun 2012 20:18
Location: Northeast, USA
Status: Offline

Re: Story of my storage project

#10

Post by kenZ71 » 25 May 2014 02:24

Nice setup!
11.2-RELEASE-p3 | ZFS Mirror - 2 x 8TB WD Red | 28GB ECC Ram
HP ML10v2 x64-embedded on Intel(R) Core(TM) i3-4150 CPU @ 3.50GHz

Extra memory so I can host a couple VMs
1) Unifi Controller on Ubuntu
2) Librenms on Ubuntu

Six_Shooter
Starter
Starter
Posts: 40
Joined: 31 Dec 2013 20:12
Status: Offline

Re: Story of my storage project

#11

Post by Six_Shooter » 23 Nov 2014 04:27

Nice to see the MoBo I am considering in the future build (though likely outdated by the time I get around to it) is being used with N4F.

I might just be blind or might have missed mention of it, but do you have any fans for HDD cooling, or do they stay cool enough without? I really like the idea of a silent NAS.
MyNAS
OS: NAS4Free 10.3.0.3 (847) Embedded
Motherboard: ASUS M5A97 LE R2.0
CPU: AMD ATHALON II X2 255
RAM: 4GB DDR3
Boot Drive: 2GB Kingston DataTraveler 2.0
Storage: (UFS) 14+ TB usable WD Red and Green drives
PSU: Corsair TX650
Case: Antec 300
Other: APC UPS (USB connected)

User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Re: Story of my storage project

#12

Post by crowi » 23 Nov 2014 12:57

do you have any fans for HDD cooling, or do they stay cool enough without?
there is a 12cm fan cooling the HDD stack.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

User avatar
lindsay
Forum Moderator
Forum Moderator
Posts: 311
Joined: 23 Jun 2012 09:59
Location: Steinkjer,Norway
Status: Offline

Re: Story of my storage project

#13

Post by lindsay » 23 Nov 2014 14:40

zfs is developed for enterprise systems, so you got a have some real iron to run it.
If i start to count the money i have spent to build nas boxes or racks.

I am only missing a new mainboard and some 6,8 or 10TB hdd`s to use zfs.
This sucker is gonna be online 24/7
Protected by smoothiebox Red,Green,
Purple,Orange Zones/VLAN`s
Powered by AMD A10-6700T


XigmaNAS Box-1 11.2.0.4 - Omnius (revision 6625)
Platform : x64-embedded on 2X Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
Motherboard: ASUS Z10PA-D8, 2xSocket-2011-3
SATA Controllers : 1X Avago Technologies (LSI) SAS2008 and 1x Avago Technologies (LSI) SAS2308
Pool 1 (Media-Pool) 8X4TB in raidz2
Pool 2 (Media-Pool-2) 4X2TB in raidz2 and 2X2TB in mirror mirror and 2X3TB in mirror
Pool 3 (Media-Pool-3) 2X2TB in mirror and 2X4TB in mirror and 2X1TB in mirror

Six_Shooter
Starter
Starter
Posts: 40
Joined: 31 Dec 2013 20:12
Status: Offline

Re: Story of my storage project

#14

Post by Six_Shooter » 23 Nov 2014 18:40

crowi wrote:
do you have any fans for HDD cooling, or do they stay cool enough without?
there is a 12cm fan cooling the HDD stack.

Yep, I see that now. D'oh :? :oops:
MyNAS
OS: NAS4Free 10.3.0.3 (847) Embedded
Motherboard: ASUS M5A97 LE R2.0
CPU: AMD ATHALON II X2 255
RAM: 4GB DDR3
Boot Drive: 2GB Kingston DataTraveler 2.0
Storage: (UFS) 14+ TB usable WD Red and Green drives
PSU: Corsair TX650
Case: Antec 300
Other: APC UPS (USB connected)

User avatar
crowi
Forum Moderator
Forum Moderator
Posts: 1189
Joined: 21 Feb 2013 16:18
Location: Munich, Germany
Status: Offline

Re: Story of my storage project

#15

Post by crowi » 27 Feb 2016 12:58

After some final tuning steps, the perfomrance reached my expectation. :roll:
2016-01-16 20_43_56-milchkuh.local - Status_Graph_System Load.png
You do not have the required permissions to view the files attached to this post.
NAS 1: Milchkuh: Asrock C2550D4I, Intel Avoton C2550 Quad-Core, 16GB DDR3 ECC, 5x3TB WD Red RaidZ1 +60 GB SSD for ZIL/L2ARC, APC-Back UPS 350 CS, NAS4Free 11.0.0.4.3460 embedded
NAS 2: Backup: HP N54L, 8 GB ECC RAM, 4x4 TB WD Red, RaidZ1, NAS4Free 11.0.0.4.3460 embedded
NAS 3: Office: HP N54L, 8 GB ECC RAM, 2x3 TB WD Red, ZFS Mirror, APC-Back UPS 350 CS NAS4Free 11.0.0.4.3460 embedded

Post Reply

Return to “Gallery”