This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
Help with Rsync
-
Torgele
- Starter

- Posts: 15
- Joined: 08 Oct 2012 01:25
- Location: Greece, Alexandroupolis
- Status: Offline
Re: Help with Rsync
Can someone help with remote rsync? I am know what to do with local Rsync. What about Remote Rsync?
-
davidb
- Starter

- Posts: 55
- Joined: 05 Jul 2012 17:51
- Status: Offline
Re: Help with Rsync
a good place to get started if you want to use it with Windows is deltacopy
http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp
If copying to the windows box, you need to set up the NAS4Free box as the server and the win box as the client. Start Rsync server on N4F and create a "module" which points at the directory you want copied. in deltacopy client, point it at your NAS4Free box and select the module name you created. schedule as desired through deltacopy.
(Or you can set it up in reverse mode, but its really up to you. either way, deltacopy is necessary)
http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp
If copying to the windows box, you need to set up the NAS4Free box as the server and the win box as the client. Start Rsync server on N4F and create a "module" which points at the directory you want copied. in deltacopy client, point it at your NAS4Free box and select the module name you created. schedule as desired through deltacopy.
(Or you can set it up in reverse mode, but its really up to you. either way, deltacopy is necessary)
-
davidb
- Starter

- Posts: 55
- Joined: 05 Jul 2012 17:51
- Status: Offline
Re: Help with Rsync
Alright, a quick step by step for copying files from N4F to Windows using rsync and Deltacopy
On Windows, download and install deltacopy http://www.aboutmyip.com/AboutMyXApp/De ... taller.jsp (download link)
-Open deltacopy server, go to 'virtual directories' tab
-doubleclick <add new directory> and give it a name without spaces (backup or media etc)
-It will appear in the list, and you can specify the Path of the where you want to rsync to: i.e. d:\backups\ (we will be using reverse mode on N4F, normally this would be the directory you would be sharing from on windows)
-leave authentication blank unless you want to mess with local users in N4F
-Go back to "server status" tab and make sure it is running
On Nas4Free, go to the rsync service page
-Click on "client" and [+] to add a new task
-under "local share (destination)", select the path you want to have copied to your win7 machine: i.e. /mnt/SHARE/media/ <-note, this should not be the root of your pool/array/dataset, make it at least one folder deep (again, we are using reverse mode so this is actually the source of the files to be shared)
-for "remote rsync server" enter the win7 IP address (if you are using DHCP you can specify hostname, but static IP would be preferred)
-for "Remote module (source)" you will enter the name of the share EXACTLY as you created in deltacopy (in the <add new directory> step)
-Set your schedule for as often as you want to copy (daily is my preference, at weekly if you make a lot of changes it can really take a while) to your windows machine
-Options for "Recursive", "times", and "compress" will be checked by default. this is good and fine
-If you want the copy of data on the windows machine to always be the same as what is on the NAS, check the "Delete" option. If not, new data will continue to be added to the windows destination, but old data will never be deleted
IMPORTANT: If you check "Delete", and you fail to set the "reverse Direction" flag, everything in the "destination folder" path set above will be wiped out. PROCEED WITH CAUTION
-the "quiet" option will clean up your logs a little bit, but at first its probobly ok to have it off so you can see whats going on
-select the "Preserve Permissions" option so that N4F maps any world-readable attributes to NTFS, otherwise you may need to use the "fix file permissions" option in deltacopy (right-click on your "virtual directory" in deltacopy server) or take ownership of the files in windows. (permissions and attributes options are what you make of them, in a home network it isn't as critical for access control)
-"Reverse direction" NEEDS TO BE CHECKED so the data on the NAS flows to the windows box.
"Save" your new settings and "apply changes" on the client list screen.
At this point you can go back into the settings and confirm that everything is set correctly.
Now you can wait for cron to start the rsync or you can [Execute Now]
(Execute Now can take a really long time if its the first run, and the webgui of NAS4Free will appear to be frozen. you can open up a different browser and access the the webgui during this time - if running version after rev 323)
On Windows, download and install deltacopy http://www.aboutmyip.com/AboutMyXApp/De ... taller.jsp (download link)
-Open deltacopy server, go to 'virtual directories' tab
-doubleclick <add new directory> and give it a name without spaces (backup or media etc)
-It will appear in the list, and you can specify the Path of the where you want to rsync to: i.e. d:\backups\ (we will be using reverse mode on N4F, normally this would be the directory you would be sharing from on windows)
-leave authentication blank unless you want to mess with local users in N4F
-Go back to "server status" tab and make sure it is running
On Nas4Free, go to the rsync service page
-Click on "client" and [+] to add a new task
-under "local share (destination)", select the path you want to have copied to your win7 machine: i.e. /mnt/SHARE/media/ <-note, this should not be the root of your pool/array/dataset, make it at least one folder deep (again, we are using reverse mode so this is actually the source of the files to be shared)
-for "remote rsync server" enter the win7 IP address (if you are using DHCP you can specify hostname, but static IP would be preferred)
-for "Remote module (source)" you will enter the name of the share EXACTLY as you created in deltacopy (in the <add new directory> step)
-Set your schedule for as often as you want to copy (daily is my preference, at weekly if you make a lot of changes it can really take a while) to your windows machine
-Options for "Recursive", "times", and "compress" will be checked by default. this is good and fine
-If you want the copy of data on the windows machine to always be the same as what is on the NAS, check the "Delete" option. If not, new data will continue to be added to the windows destination, but old data will never be deleted
IMPORTANT: If you check "Delete", and you fail to set the "reverse Direction" flag, everything in the "destination folder" path set above will be wiped out. PROCEED WITH CAUTION
-the "quiet" option will clean up your logs a little bit, but at first its probobly ok to have it off so you can see whats going on
-select the "Preserve Permissions" option so that N4F maps any world-readable attributes to NTFS, otherwise you may need to use the "fix file permissions" option in deltacopy (right-click on your "virtual directory" in deltacopy server) or take ownership of the files in windows. (permissions and attributes options are what you make of them, in a home network it isn't as critical for access control)
-"Reverse direction" NEEDS TO BE CHECKED so the data on the NAS flows to the windows box.
"Save" your new settings and "apply changes" on the client list screen.
At this point you can go back into the settings and confirm that everything is set correctly.
Now you can wait for cron to start the rsync or you can [Execute Now]
(Execute Now can take a really long time if its the first run, and the webgui of NAS4Free will appear to be frozen. you can open up a different browser and access the the webgui during this time - if running version after rev 323)
Last edited by davidb on 19 Oct 2012 16:14, edited 1 time in total.
-
Torgele
- Starter

- Posts: 15
- Joined: 08 Oct 2012 01:25
- Location: Greece, Alexandroupolis
- Status: Offline
Re: Help with Rsync
It works!!! Its working!!!!!! Its beautiful
One last thins. The backup on windows is locked. i cant access it. I tried to change permissions and i take the ownership to access to them! Is it normal?
And it takes system files as well like .snap . How i can bypass this copy?
thanks!!!!
One last thins. The backup on windows is locked. i cant access it. I tried to change permissions and i take the ownership to access to them! Is it normal?
And it takes system files as well like .snap . How i can bypass this copy?
thanks!!!!
-
davidb
- Starter

- Posts: 55
- Joined: 05 Jul 2012 17:51
- Status: Offline
Re: Help with Rsync
Yeah, i noticed that too, about not having permission to get into the transfers without taking ownership. you can try in the deltacopy server, select your "virtual directory" and right click and select "fix file permissions".
Better option is to select the "Preserve Permissions" option (i will update post above to reflect this).
As far as taking system folders, are you using "/" as the local share?? you really should go to /mnt/arrayname/media or something, that stays away from the system itself.
Better option is to select the "Preserve Permissions" option (i will update post above to reflect this).
As far as taking system folders, are you using "/" as the local share?? you really should go to /mnt/arrayname/media or something, that stays away from the system itself.
- alexey123
- Moderator

- Posts: 1469
- Joined: 19 Aug 2012 08:22
- Location: Israel, Karmiel
- Contact:
- Status: Offline
Re: Help with Rsync
I not agreeBetter option is to select the "Preserve Permissions" option (i will update post above to reflect this).
I have running rsync vs delta-copy on my PCs from 2008 and never check this option. No need, I save only selfcreated documents and important logs.
But rsync many times help me restore files - this great utilite
Home12.1.0.4 - Ingva (revision 7091)/ x64-embedded on AMD A8-7600 Radeon R7 A88XM-PLUS/ 16G RAM / UPS Ippon Back Power Pro 600
Lab 12.1.0.4 - Ingva (revision 7091) /x64-embedded on Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz / H61M-DS2 / 4G RAM / UPS Ippon Back Power Pro 600
Lab 12.1.0.4 - Ingva (revision 7091) /x64-embedded on Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz / H61M-DS2 / 4G RAM / UPS Ippon Back Power Pro 600
-
davidb
- Starter

- Posts: 55
- Joined: 05 Jul 2012 17:51
- Status: Offline
Re: Help with Rsync
I was messing around with it yesterday, and the "preserve permissions" option was what managed to map the world readable state of the transferred files/folders to the ntfs permissions properly.
In this use case is sounds like Torgele wants to be able to get to the files on the windows box without having to mess with the permissions, which is the only reason i would use that option.
I agree with you that its not necessary, as i have never used that option before either.
In this use case is sounds like Torgele wants to be able to get to the files on the windows box without having to mess with the permissions, which is the only reason i would use that option.
I agree with you that its not necessary, as i have never used that option before either.
-
Torgele
- Starter

- Posts: 15
- Joined: 08 Oct 2012 01:25
- Location: Greece, Alexandroupolis
- Status: Offline
Re: Help with Rsync
Hello again!
My files are named with greek letters. So when i browser my files from filemanager i see each file with a corrupted filename (the file is ok if i guess which file it is and open it)
When i open my files thru windows, all greek names are ok. So when i use deltacopy, the corrupted filename moves to windows backup folder! As i said, file is ok, but filename is like @$#%$%#&%^^
-files with english names, work fine!
So i have to fix this small font problem so deltacopy will work fine!
My files are named with greek letters. So when i browser my files from filemanager i see each file with a corrupted filename (the file is ok if i guess which file it is and open it)
When i open my files thru windows, all greek names are ok. So when i use deltacopy, the corrupted filename moves to windows backup folder! As i said, file is ok, but filename is like @$#%$%#&%^^
-files with english names, work fine!
So i have to fix this small font problem so deltacopy will work fine!
-
Torgele
- Starter

- Posts: 15
- Joined: 08 Oct 2012 01:25
- Location: Greece, Alexandroupolis
- Status: Offline
Re: Help with Rsync
OR if davidb write again by details whats the opposite way, NAS4free to be server and deltacopy to be the client (again the target files is windows7 pc) maybe it will be fixed because files go from other way!
-
davidb
- Starter

- Posts: 55
- Joined: 05 Jul 2012 17:51
- Status: Offline
Re: Help with Rsync
Here is something you can try:
In DeltaCopy Client, click <Add New Profile>
-make a name,
-for Server IP put "localhost" and
-for Virtual Directory put the name you created in the DeltaCopy Server.
-Add Profile
Now you can "Add Folder" to the "files/folders to copy" box, from here you can select a samba share (example \\NAS4F\media) on your NAS. (Or map the share to a drive should work, i didn't try this)
This will work to transfer the files from your NAS to your PC, but its probably pretty inefficient. Also note you have to share via samba the lowest level you want to have synced.
This is really just a work around, unfortunately one of the limitations of deltacopy Client is that it only supports pushing files, not pulling, at least via gui configuration. (it may be possible via command line, but my script-fu is lacking).
Also, it is very possible that the greek letters still won't come across correctly. there are people out there that have installed cygwin with different charsets that could make this work, google could be your friend on that one.
In DeltaCopy Client, click <Add New Profile>
-make a name,
-for Server IP put "localhost" and
-for Virtual Directory put the name you created in the DeltaCopy Server.
-Add Profile
Now you can "Add Folder" to the "files/folders to copy" box, from here you can select a samba share (example \\NAS4F\media) on your NAS. (Or map the share to a drive should work, i didn't try this)
This will work to transfer the files from your NAS to your PC, but its probably pretty inefficient. Also note you have to share via samba the lowest level you want to have synced.
This is really just a work around, unfortunately one of the limitations of deltacopy Client is that it only supports pushing files, not pulling, at least via gui configuration. (it may be possible via command line, but my script-fu is lacking).
Also, it is very possible that the greek letters still won't come across correctly. there are people out there that have installed cygwin with different charsets that could make this work, google could be your friend on that one.