rsync from qnap to N4F automatically restarted

[nixIT]

Hello all,

I started transferring ~5TB of data from my QNAP to my new N4F server via Rsync. Everything seemed to be going ok, although slow (Qnap was reporting the job would take 113 hours). The job was set to finish up late last night, and this morning when I looked at the Qnap interface, I noticed that the job had started over, and was now 10% complete with 109 hours remaining.

Has anyone had this happen to them?

Also, since it was taking 4ish days to rsync the data, there were some changes on the Qnap box, which shouldn't restart the Rsyn job. Since there have been changes on the Qnap, what is the best way to get these changes over to the N4F box?

let me know what additional troubleshooting info I can provide.

Thanx.

--nixIT

[crowi]

The time it takes depends on the network speed of your network and on the size of the files you want to transfer, i.e. small files (music/images/etc) take much longer as big files (e.g. movies)
Accessing the boxes while transferring data, may also slow down the process.

Also, since it was taking 4ish days to rsync the data, there were some changes on the Qnap box, which shouldn't restart the Rsyn job. Since there have been changes on the Qnap, what is the best way to get these changes over to the N4F box?

Just run another rsync to get the latest changes.
But better don't change the data while you transfer them.

[nixIT]

@crowi,

Thanx, but the current rsync job restarted sometime after it completed. I stopped that job and then started a new one, thinking the rsync would grab only what's changed, however, rsync started transferring all 5TB again, as the ETA went to 113 hours.

Not sure why it's trying to send all files again.

When I restart the job, I check the N4F log and see entries like this:

rsyncd[3877]: rsync: failed to set times on "/." (in movies): Operation not permitted (1)

could this be what's causing the complete restart of the rsync?

thanx

--nixIT

[crowi]

yes, how and from which machine did you start the rsync job?

[nixIT]

@crowi.

I am rsyncing from QNAP to N4F set up as the server. I set the job up in the Qnap to connect to N4F. I had 3 jobs set up, each run manually at different times, and 2 of the 3 completed without restarting, but this third job restarted.

Thanx for your help

[nixIT]

Any thoughts on why I would get the

rsyncd[3877]: rsync: failed to set times on "/." (in movies): Operation not permitted (1)

Is this a permissions issue on the nas4free?

thanx in advance for help

--nixIT

[crowi]

yes, it seems like a permission problem. Start the rsync command manually from a N4F shell as root

[nixIT]

@crowi,

I'll give that a shot, I've always used rsync to "push" files to the destination, never did a "pull" from source, if that makes source, so I'll have to look up the syntax

--nixIT