rsync from synology to nas4free

[wiltop]

i have a 2413 synology , and like to rsync some maps to the nas4free , i have tried several options , but so far nothing happend.

some advice should be nice.

thanks

[b0ssman]

list the commands you used and the response you get.

[wiltop]

first i descripe the enviroment

a synology nas 2413 with 12 disks ip 192.168.1 99 volume1/muziek and desktop amd nas4free with 12 disks 192.168.1.250 zfs raid/muziek and jbod/docus.

i like from the nas4free to access the synology and start rsync the volume1/muziek , so i have a backup on the nas4free.

so what to discripe into the server workstation and local , in the nas4free ?

as this is not oke , make no sense to report the response

thanks for your reply

[Parkcomm]

OK you have four choices (all are fine)

1/ Setup Nas4free as a server setup Synology as a client - run backups on the the Synolgy using Cron if you wish
2/ Setup Nas4free as a client setup Synology as a server - run backups on the NAS4free using Cron if you wish (via the GUI, very easy)
3/ Setup a file server on the Synology (NFS, CIFS/SMB, AFP) - mount the directory on the NAS4Free and do a local rsyn. The source desitination is the remote mount and the desitnation is the local filesystem
4/ Setup a file server on the the Nas4Free, mount on the Synology and do a local rsync on the synology.

Do you have a preference? If not use 2/

So setup Rsync Server on the Synology. Create Rsync modlue on the Synology - set the path to be shared as Volume1/muziek, and give it a name.

Go to RServices|Rsync|Client on the Nas4free and add an Rsync Job - the local share is on raid/muziek or jbod/docus the remote server is your Synology FQDN or IP address and the module is the name you used on the Synology. The rest is pretty self explanatory.

[wiltop]

this are the logs after starting a client rsync

system
Sep 25 09:27:38 nas4 root: rsync_client service executed
Sep 25 09:27:38 nas4 root: cron service restarted
Sep 25 09:27:47 nas4 root: rsync_client service executed
Sep 25 09:27:47 nas4 root: cron service restarted
Sep 25 09:27:47 nas4 root: Start of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:27:47 nas4 root: End of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:28:00 nas4 root: Start of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:28:00 nas4 root: End of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:29:00 nas4 root: Start of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:29:00 nas4 root: End of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:30:00 nas4 root: Start of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/
Sep 25 09:30:00 nas4 root: End of remote RSYNC synchronization from volume1/muziek on 192.168.1.99 to /mnt/raid/muziek/

client


Event
2015/09/25 09:27:47 [9478] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:27:47 [9478] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]
2015/09/25 09:28:00 [9487] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:28:00 [9487] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]
2015/09/25 09:29:00 [9496] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:29:00 [9496] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]
2015/09/25 09:30:00 [9505] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:30:00 [9505] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]
2015/09/25 09:31:00 [9520] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:31:00 [9520] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]
2015/09/25 09:32:00 [9529] rsync: failed to connect to 192.168.1.99 (192.168.1.99): Connection refused (61)
2015/09/25 09:32:00 [9529] rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.1]

[crowi]

looks like you don't have sh/ssh access to your synology, can you activate this?

[Parkcomm]

I don't believe rsync over ssh is the default - do you know this for sure crowl.

Anyways wiltop, try the following from the terminal on the Nas4Free

Code: Select all

rsync -ra  --progress --stats --recursive  -vv username@192.168.1.99::modulename /mnt/raid/muziek/

Note you'll need to use your own username and modulename. -v means verbose, -vv means very verbose and -vvv mans out of control verbose. Use whichever sheds light on the problem. Copy bak here if you need help.

[crowi]

yes, but if you can't ssh into the synology, you won`t get credentials for rsync either. imho.... :-/

[wiltop]

thanks for all your help !

but first i like to know , what to fill in by module name , because

i have tried several options , but so far not good


2015/09/26 10:24:00 [3453] @ERROR: Unknown module 'nassie'
2015/09/26 10:24:00 [3453] rsync error: error starting client-server protocol (code 5) at main.c(1635) [Receiver=3.1.1]
2015/09/26 10:25:00 [3462] @ERROR: Unknown module 'nassie'
2015/09/26 10:25:00 [3462] rsync error: error starting client-server protocol (code 5) at main.c(1635) [Receiver=3.1.1]

and where to put your instructions , by advanced and command ?

[Parkcomm]

I've just had a look at https://www.synology.com/en-global/know ... orials/613

(it does say ssh is optional)

So there does not seem to be a way to name modules other than using the folder name itself (at the bottom of the page your see:

Code: Select all

rsync -av home/ admin@192.168.55.66::NetBackup/backupdata/

In this case the module (on the Nas4free page) would be "NetBackup/backupdata" (I guess, I'm used to using two BSD based machines.)

and where to put your instructions , by advanced and command ?

use the console, an ssh terminal or Advanced|Command on nas4free, or you can run it from any rsync capable machine, your PC, OS X or linux desktop would do

[wiltop]

my intention is , that nas4free read the synology , and backup some files from synology , and not use the synology as the backup ,so the nas4free is backup.

[crowi]

yes, but you need shell access to your Synology first, if you want to use rsync:
By default, rsync uses the remote-shell program SSH for its communication. It can be configured to use a different remote-shell program, or to contact an rsync daemon directly via TCP, which per default then is via TCP port 873,
https://en.wikipedia.org/wiki/Rsync
If you can't ssh into your machine, you can't use rsync directly from/to the NAS, as you don't get the credentials

[Parkcomm]

Crowi - we are attempting

to contact an rsync daemon directly via TCP, which per default then is via TCP port 873

Wiltop -

my intention is , that nas4free read the synology , and backup some files from synology , and not use the synology as the backup ,so the nas4free is backup.

In that case the easiest way is to set the the Nas4Free up as the server.

Services|Rsync|Server|Settings - Put user as your default username , leave port as 8873 adn enable
Services|Rsync|Server|Module|Edit - point o appropriate directory, give it a module name etc. Put the use to root:wheel (we can fix the security once we have it working)

Once you've done that run the rsync command I gave you above, from either a terminal on the synology or your desktop.

On the synology set follow the Backup the Synology Server to a remote RSync Compatible Server directiont at http://forum.synology.com/MediaWiki/ind ... ork_Backup

[wiltop]

i dont know , what i have done , but from the synology , he makes a rsync backup to the nas4free

i initiated it from the synology , i like to do it from the nas4free , but i wait for the result

[Parkcomm]

So you want the Nas4Free to pull the data from the Synology and store it locally.

The client server model I have suggested can absolutely do this from the command line - however I think the GUIs of NAS4Free+Synology don't allow for this option.

As an alternative could set up a share on the Synology, mount it on the Nas4Free and then use Services|Rsync|Local|Add.

There are six different ways of using rsync. They are:

# for copying local files. This is invoked when neither source nor destination path contains a : separator

# for copying from the local machine to a remote machine using a remote shell program as the transport (such as rsh or ssh).
This is invoked when the destination path contains a single : separator.

# for copying from a remote machine to the local machine using a remote shell program. This is invoked when the source contains a : separator.

# for copying from a remote rsync server to the local machine. This is invoked when the source path contains a :: separator or a rsync:// URL.

# for copying from the local machine to a remote rsync server. This is invoked when the destination path contains a :: separator.

# for listing files on a remote machine. This is done the same way as rsync transfers except that you leave off the local destination.

[wiltop]

had done some tests with extra backups , and it seems all oke , first backup takes 10 hours , second and third only minutes.

now i have first to make a choice , for a secure nas4free

i have a amd 8150 8 core gigabyte ud5 with 12 disks , system on a 16gb usb.

7 times 2tb and 5 times 3tb , as i expect more 3tb , because updating my 2413 with 6tb , what is the best choice , so i can add 3tb later
now i have a 14 tb zfs raid stripe , and 12tb jbod.

later i will try the nas4free as a server , i think is better to use power of amd 8150 ????

[Parkcomm]

I've gone low (performance) power / high efficiency myself - a pure NAS doesn't have to have high power.

Of course you can do more if you have more power.

[wiltop]

i have one question

which model of nas4free raid is secure , and can i expend later with bigger disk ???????

[Parkcomm]

"Secure" is an interesting word -

• Integrity - ZFS is the best going period
  Fault tolerance - have a backup solution, perferably offsite
  Resilience - use Raidz1 for small pools, Raidz2 for large pools, but other technologies can do this just as well, or use mirroring
  User error - ZFS has excellent rollback capability
  Encryption ...
  Etc

Expandability - well there are better solutions for expandability than ZFS pools but ZFS is not too bad:
To add space you can just add more vdevs. For instance if you are using a mirror, just add a new mirror pair to the pool. One benefit is that reads become faster. You can add another raidz vdev just as easily)
You could also replace disks with larger disks, but and vdev will be behave as if all of the disks in the vdev are the same cpacity as the smallest disk in the pool. So increasing the capacity of five disk vdev requires you to replace five disks, increasing the size of a mirror requires you increase the size of two disks etc)


I can tell you what I went for - ZFS Mirroring (not raidz) because

• don’t be greedy. 50% storage efficiency is plenty.
  for a given number of disks, a pool of mirrors will significantly outperform a RAIDZ stripe.
  a degraded pool of mirrors will severely outperform a degraded RAIDZ stripe.
  a degraded pool of mirrors will rebuild tremendously faster than a degraded RAIDZ stripe.
  a pool of mirrors is easier to manage, maintain, live with, and upgrade than a RAIDZ stripe.
  BACK. UP. YOUR POOL. REGULARLY. TAKE THIS SERIOUSLY.

(I stole this list from here, http://jrs-s.net/2015/02/06/zfs-you-sho ... not-raidz/)