This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

Best Practice - Rsync between 2 nas4free servers

Synchronize files & directories to/from XigmaNAS with minimal data transfer.
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
User avatar
Lee Sharp
Advanced User
Advanced User
Posts: 251
Joined: 13 May 2013 21:12
Contact:
Status: Offline

Best Practice - Rsync between 2 nas4free servers

Post by Lee Sharp »

This is nor rocket science... Or at least it should not be...

I have two nas4free servers, and I want to use rsync to keep them in sync. But when I try, things get ugly fast...

GUI - (Or "Why, why, why, dear God why?") - So, I have to set up the server as Guest only? Well that will make backing up a bunch of files hard. I guess I could 755 my whole server. I mean what good is file security anyway? Oh, and encryption is overrated.

Cron - Well, this is no surprise, as all rsync GUIs in nas implementations stink. And I like cron... And you have a nice persistent cron in the web GUI. But... Where do I put my authorized_keys when /root is rebuilt on each boot?

I am sure someone has done this and not all rsync implimentations are between nas4free and real servers... But damned if I can figure out how! :D

User avatar
ernie
Forum Moderator
Forum Moderator
Posts: 1458
Joined: 26 Aug 2012 19:09
Location: France - Val d'Oise
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by ernie »

Hello

I have another solution for you : zrep
Here the post
viewtopic.php?f=70&t=8166

You will have synchronization between 2 nas. It works very well for me.

But you need zfs, and I don t know if you using it ;)
NAS 1&2:
System: GA-6LXGH(BIOS: R01 04/30/2014) / 16 Go ECC
XigmaNAS 12.1.0.4 - Ingva (revision 7743) embedded
NAS1: Xeon E3 1241@3.5GHz, 2HDD@8To/mirror, 1SSD cache, Zlog on mirror, 1 UFS 300 Go
NAS2: G3220@3GHz, 2x3HDD@2To/strip+raidz1, 1SSD cache, Zlog on mirror
UPS: APC Back-UPS RS 900G
Case : Fractal Design XL R2

Extensions & services:
NAS1: OBI (Plex, BTSync, zrep, rclone, themes), nfs, smb, UPS,
NAS2: OBI (zrep (backup mode), themes)

User avatar
Lee Sharp
Advanced User
Advanced User
Posts: 251
Joined: 13 May 2013 21:12
Contact:
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by Lee Sharp »

I looked at zrep, and it is an interesting thing... But I do not want continuous replications and i specifically do not want snapshots touched. So it looks like zrep is the wrong tool for the job.

But back to the topic, it just seems wrong to me that there is no way to rsync as root between nas4free boxes in a reliable way... Is this really the case?

jollmon
NewUser
NewUser
Posts: 6
Joined: 01 Apr 2015 06:19
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by jollmon »

I am using an offsite storage solution for my rsync with an Ubuntu box, but not for all my files. Just my tier1 files.(high value, about 120GB) but it helps a lot that I have 200/20 internet. I didnt use the built-in tools, since I wanted to ensure I have ssh keys in place manually. For 10 bucks a month I use ramnode ATL node, on their 200GB cached SSD hosting which is very very very fast. http://goo.gl/P8dC5L I also setup a cron to run it. This way if the house burns, Im covered.

Rsync remote for the initial sync can be a big issue if you have like DSL. Deltas are fast and cheap however. :mrgreen:
3U AthenaPower RM-3U364R Case
Biostar TA970 v5.2
Sempron 145 @ 45watts
2x 1GB Nanya DDR3 ram modules
Zippy 2U sized slim 510w PSU (loud)
5x Seagate Barracuda 7000.11 1TB drives
PNY Attache 16GB mirco USB stick
9.3.0.2 nas4Free
APC Smart-UPS 1500 RM 2U
Current wattage ~ 95 watts

User avatar
Lee Sharp
Advanced User
Advanced User
Posts: 251
Joined: 13 May 2013 21:12
Contact:
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by Lee Sharp »

jollmon wrote:I am using an offsite storage solution for my rsync with an Ubuntu box, but not for all my files. Just my tier1 files.(high value, about 120GB) but it helps a lot that I have 200/20 internet. I didnt use the built-in tools, since I wanted to ensure I have ssh keys in place manually.
I have done this often, and it is easy. However, this is between two nas4free servers in the same data center. While I can dump the command in cron, I can not keep my shared keys and have them survive reboot. Perhaps I need to post this in general and ask for a persistent root folder?

jollmon
NewUser
NewUser
Posts: 6
Joined: 01 Apr 2015 06:19
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by jollmon »

Lee Sharp wrote:
jollmon wrote:I am using an offsite storage solution for my rsync with an Ubuntu box, but not for all my files. Just my tier1 files.(high value, about 120GB) but it helps a lot that I have 200/20 internet. I didnt use the built-in tools, since I wanted to ensure I have ssh keys in place manually.
I have done this often, and it is easy. However, this is between two nas4free servers in the same data center. While I can dump the command in cron, I can not keep my shared keys and have them survive reboot. Perhaps I need to post this in general and ask for a persistent root folder?
Are you using the full build?
3U AthenaPower RM-3U364R Case
Biostar TA970 v5.2
Sempron 145 @ 45watts
2x 1GB Nanya DDR3 ram modules
Zippy 2U sized slim 510w PSU (loud)
5x Seagate Barracuda 7000.11 1TB drives
PNY Attache 16GB mirco USB stick
9.3.0.2 nas4Free
APC Smart-UPS 1500 RM 2U
Current wattage ~ 95 watts

User avatar
Lee Sharp
Advanced User
Advanced User
Posts: 251
Joined: 13 May 2013 21:12
Contact:
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by Lee Sharp »

jollmon wrote:Are you using the full build?
No. Nor do I really want to. There are good reasons for keeping data and system separate. :)

jollmon
NewUser
NewUser
Posts: 6
Joined: 01 Apr 2015 06:19
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by jollmon »

Lee Sharp wrote:
jollmon wrote:Are you using the full build?
No. Nor do I really want to. There are good reasons for keeping data and system separate. :)
Id guess thats the restart issue then, and its not getting restored on reboots?
3U AthenaPower RM-3U364R Case
Biostar TA970 v5.2
Sempron 145 @ 45watts
2x 1GB Nanya DDR3 ram modules
Zippy 2U sized slim 510w PSU (loud)
5x Seagate Barracuda 7000.11 1TB drives
PNY Attache 16GB mirco USB stick
9.3.0.2 nas4Free
APC Smart-UPS 1500 RM 2U
Current wattage ~ 95 watts

User avatar
Lee Sharp
Advanced User
Advanced User
Posts: 251
Joined: 13 May 2013 21:12
Contact:
Status: Offline

Re: Best Practice - Rsync between 2 nas4free servers

Post by Lee Sharp »

The GUI only allows you to access as guest, so you can not back up anything that is not world readable. And you can not just rsync in cron since it relies on ssh keys, which are stored in your home folder, which for the root user is /root, which is not persistant on reboot.

Post Reply

Return to “RSYNC”