Not sure if this is a problem with how I'm using Synology's DSM or how I've configured N4F's rsync service/user...
I am trying to complete an initial sync of my existing Synology (DS209/DSM 4.2/mirrored drives) to my new NAS4Free server (current stable release, RAIDZ2). I tried pulling a drive and reading it directly over eSATA, but N4F doesn't seem to have access to /volume1. So I tried Network Backup. I have no idea if I'm using RSync correctly- I'm new to this. But this is what I did.
In Synology's Network Backup, almost all of the backups have failed. I get errors like: "Network Backup failed to backup task [downloads] to [192.168.x.x]. ([23] Some files could not be transferred. Possible reasons: 1) backup user has no permission to access the files, 2) files are deleted, 3) illegal file name.)" When I check the drives, roughly 80-90% of the data appears to have been copied.
My DS209 has 8 shared folders in /volume1. My NAS4Free server has 8 ZFS Datasets named almost identically. So I configured a rsync module on N4F called "download" to map to /mnt/zpool6z2/Downloads/ on N4F. On the Synology, I created a backup task -> network backup (rsync compatible server). I filled in the IP address/username/password and selected the "download" module. DSM fills in the "Directory" field with "DiskStation_1". I cannot leave this field blank. Then I see my list of shared folders and I select the "Downloads" folder. When I run the backup and see the failed message, I do a quick check of the Synology and N4F shares. Synology has copied volume1/downloads to N4F's: /mnt/zpool6z2/Downloads/DiskStation_1/Downloads.
1) I wanted volume1/Downloads to go straight to /mnt/zpool6z2/Downloads. Is this possible?
2) Do I have to do a manual check to see which files are causing problems? If so, any recommendations to make my life easier? I have SSH access to both machines and am running OS X.
3) If I can get the sync to work right, can I schedule these jobs so that my Synology will sync itself to the N4F and my N4F will sync to my Synology so that both machines have identical data? (I have both machines right now, but they will be in different states next week.) I don't think I'd ever edit the same file at both locations in the same day. But I'd have laptop A using Time Machine to back itself up to the Synology, and laptop B using Time Machine to back itself up to the N4F directly. It would be nice to be able to restore from Time Machine from either the Synology or the N4F.
This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
it will taken offline by the end of march 2021!
I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!
Rsync from Synology
-
pandamonium54
- NewUser
- Posts: 2
- Joined: 07 Jun 2013 17:54
- Status: Offline
Re: Rsync from Synology
Update: So I connected to N4F's AFP file service. It looks like permissions are all off. I have several folders that give "everyone" "no access". In N4F's file manager, only "owner" has rwx.
In N4F, both my personal user and rsync are in the admin group- shouldn't that give them access to update permissions properly? The only thing I can think of is that my Synology user, which owned most of the files/folders, had a space in the username... Is that enough to mess with N4F?
In N4F, both my personal user and rsync are in the admin group- shouldn't that give them access to update permissions properly? The only thing I can think of is that my Synology user, which owned most of the files/folders, had a space in the username... Is that enough to mess with N4F?
-
aol
- NewUser
- Posts: 3
- Joined: 30 Jan 2014 15:51
- Status: Offline
Re: Rsync from Synology
Hi, I just posted about my success with getting a Syno DS410 to rsync to N4F here: viewtopic.php?f=28&t=5985
To try to answer your specific questions:
1. Syno backup requires a folder to sync to. If you want the Syno NAS to backup to /mnt/zpool/Downloads, then your rsync module PATH must be /mnt/zpool, and the syno NAS backup task's directory would be Downloads. Note that this opens the entire /mnt/zpool to rsync's tender embrace.
2. My solution to your exact problem was to set the user id in the N4F module to "root". Without the user id of "root", I would get literally random errors just like you report.
3. Not sure about this. I think you can do this, that's what rsync does.. but then you'd have to set up modules as the root of your zpool on each machine (/volume1 on the syno, /mnt/zpool on the N4F). If any file gets corrupted, it would quickly be replicated back onto both machines and you'd be hosed. I prefer to backup my Macs via TM to the Syno, then periodically backup the Syno over rsync to N4F, and that seems sufficient. YMMV.
As far as AFP, you know, I just don't know how well AFP deals with file permissions. It's not posix-compliant, so to my understanding, when you AFP to a NAS, and create a file, the NAS interprets it to the user on the NAS with that user's permissions. I use AFP, I'm not saying don't use it, but maybe don't rely on it for bullet-proof permissions troubleshooting. What you can do is ssh into the NAS (you'll need to enable SSH on port 22), then ssh admin@<nas> with the admin password (or ssh root@<nas> with the admin password) and look around that way. Spaces and special characters can definitely cause issues; for a while I had an "@" in my password, and that caused no end of issues.
Good luck.
To try to answer your specific questions:
1. Syno backup requires a folder to sync to. If you want the Syno NAS to backup to /mnt/zpool/Downloads, then your rsync module PATH must be /mnt/zpool, and the syno NAS backup task's directory would be Downloads. Note that this opens the entire /mnt/zpool to rsync's tender embrace.
2. My solution to your exact problem was to set the user id in the N4F module to "root". Without the user id of "root", I would get literally random errors just like you report.
3. Not sure about this. I think you can do this, that's what rsync does.. but then you'd have to set up modules as the root of your zpool on each machine (/volume1 on the syno, /mnt/zpool on the N4F). If any file gets corrupted, it would quickly be replicated back onto both machines and you'd be hosed. I prefer to backup my Macs via TM to the Syno, then periodically backup the Syno over rsync to N4F, and that seems sufficient. YMMV.
As far as AFP, you know, I just don't know how well AFP deals with file permissions. It's not posix-compliant, so to my understanding, when you AFP to a NAS, and create a file, the NAS interprets it to the user on the NAS with that user's permissions. I use AFP, I'm not saying don't use it, but maybe don't rely on it for bullet-proof permissions troubleshooting. What you can do is ssh into the NAS (you'll need to enable SSH on port 22), then ssh admin@<nas> with the admin password (or ssh root@<nas> with the admin password) and look around that way. Spaces and special characters can definitely cause issues; for a while I had an "@" in my password, and that caused no end of issues.
Good luck.