File copy program - queueing large file copies

[whitedragon101]

I have had many instances where I need to set a large copy operation going of say 1-2TB and I keep getting an error after 20 or 30 GB. So I have to keep going back and copying it in chunks instead of being able to walk away and leave it.

Does anyone know of a good program for OSX for file copying that you can:

- queue up large amounts of files for copy (sometimes on multiple drives)
- allows for retrying or skipping over errors (and logging so you know what didn't copy)

 

[pszilard]

Same - need robust backup copy program

I am still unable to find a robust backup program to copy large number of files (e.g. 100,000+). I have tried a number including the freeware FileSync and the paid Intego backup, but all seem to "Quit Unexteptantly".

I am trying to backup from a NAS to a USB using a large iMac in one instance, and elsewhere I am trying to copy a USB mounted Mac HDD to a NAS.

I was forced to connect the USB drive to Windows to back it up! This is just so disappointing, as I am trying to move from Windows to Mac and justs waiting for my new 27" iMac to be delivered today!

(I have emailed FolderSync's authors).

Can anyone can recommend a Mac program that can reliably copy 100,00+ files and not crash???

 

[simsaladimbamba]

I have had good experiences with CarbonCopyCloner doing that, but it will probably not be able to handle the OP's requirements.

 

[pszilard]

Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...

 

[simsaladimbamba]

Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...

Yes, as you can select what folders to copy and deselect the folders/files not to copy. It can even be scheduled.

 

[powerless]

ChronoSync can do what the OP wants. Although I've not tried with 100K, 600GB and 10K is my data.

You'll have to setup a 'Container' for each drive, but you can add them to a 'Synchronizer' to run all together. It does log failures and asks if you want to retry, skip...

Example of a previous failure log...

[2012-06-23 03:33:30 +0100] *** Error: File not found.
[2012-06-23 03:33:30 +0100] Occurred while copying to file:
[2012-06-23 03:33:30 +0100] /Volumes/Backup/VM/.07 x64.vmwarevm
[2012-06-24 01:17:32 +0100] *** Aborted ***
[2012-06-24 01:17:32 +0100] Scanned: 13 Processed: 0 Data copied: 0 bytes Skipped: 6 Errors: 1

 

[pszilard]

Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...

Bombich was most helpful and quick. They told me that they regularly run their program with over 1 million files.

I have also now tried their program for folder copy and went perfectly. +1 CCC.