File copy program - queueing large file copies

whitedragon101

macrumors 65816
Original poster
Sep 11, 2008
1,260
285
I have had many instances where I need to set a large copy operation going of say 1-2TB and I keep getting an error after 20 or 30 GB. So I have to keep going back and copying it in chunks instead of being able to walk away and leave it.

Does anyone know of a good program for OSX for file copying that you can:

- queue up large amounts of files for copy (sometimes on multiple drives)
- allows for retrying or skipping over errors (and logging so you know what didn't copy)
 

pszilard

macrumors member
May 29, 2011
42
0
Sydney, Australia
Same - need robust backup copy program

I am still unable to find a robust backup program to copy large number of files (e.g. 100,000+). I have tried a number including the freeware FileSync and the paid Intego backup, but all seem to "Quit Unexteptantly".

I am trying to backup from a NAS to a USB using a large iMac in one instance, and elsewhere I am trying to copy a USB mounted Mac HDD to a NAS.

I was forced to connect the USB drive to Windows to back it up! This is just so disappointing, as I am trying to move from Windows to Mac and justs waiting for my new 27" iMac to be delivered today!

(I have emailed FolderSync's authors).

Can anyone can recommend a Mac program that can reliably copy 100,00+ files and not crash???
 
Comment

pszilard

macrumors member
May 29, 2011
42
0
Sydney, Australia
Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...
 
Comment
Nov 28, 2010
22,684
28
located
Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...
Yes, as you can select what folders to copy and deselect the folders/files not to copy. It can even be scheduled.
 
Comment

powerless

macrumors member
Dec 8, 2009
58
100
ChronoSync can do what the OP wants. Although I've not tried with 100K, 600GB and 10K is my data.

You'll have to setup a 'Container' for each drive, but you can add them to a 'Synchronizer' to run all together. It does log failures and asks if you want to retry, skip...

Example of a previous failure log...

[2012-06-23 03:33:30 +0100] *** Error: File not found.
[2012-06-23 03:33:30 +0100] Occurred while copying to file:
[2012-06-23 03:33:30 +0100] /Volumes/Backup/VM/.07 x64.vmwarevm
[2012-06-24 01:17:32 +0100] *** Aborted ***
[2012-06-24 01:17:32 +0100] Scanned: 13 Processed: 0 Data copied: 0 bytes Skipped: 6 Errors: 1
 
Comment

pszilard

macrumors member
May 29, 2011
42
0
Sydney, Australia
Would CCC be suitable for a file/folder based copy task instead of a disk clone task? I shall email bombich for advice.

Thanks for the suggestion...
Bombich was most helpful and quick. They told me that they regularly run their program with over 1 million files.

I have also now tried their program for folder copy and went perfectly. +1 CCC.
 
Comment
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.