Software to find/delete duplicate files?

[kat.hayes]

I have tons of folders on external drives with what are likely copies of the same files backed up over and over again. Can someone recommend a program that can go through thousands of files, find duplicates, and delete them?

I just discovered Gemini, though I know nothing about it and am looking to see what others think of it or other programs I should look into.

Thanks

 

[eRondeau]

Check out "Shorui" on the App Store. Completely free, lightweight, and seems to handle duplicate files quite efficiently.

 

[mmkerc]

Tidy Up is one I used to help clean up 16TB of data across 9 different hard drives.

 

[Artiste212]

Check out "Shorui" on the App Store. Completely free, lightweight, and seems to handle duplicate files quite efficiently.

Thanks for this!

 

[kat.hayes]

Tidy Up is one I used to help clean up 16TB of data across 9 different hard drives.

Can you please tell me how much you trusted the workflow of the program to cleanup that much data? That is one of my biggest concerns with using any of these programs, trusting it before removing any of the files that it finds and presents as duplicates.
Thanks

 

[allan.nyholm]

Try the Cocoa version of Dupeguru - the Qt version looks like crap on macOS

 

[mmkerc]

error posting

 

[mmkerc]

Can you please tell me how much you trusted the workflow of the program to cleanup that much data? That is one of my biggest concerns with using any of these programs, trusting it before removing any of the files that it finds and presents as duplicates.
Thanks

I am a trust but verify type so I double checked vigorously about the 1st 1 TB, after that I still scanned the duplicate list it produces before deleting. I do not recall finding any errors. The duplicate list view shows you much of the information of the duplicate files. You can select which one it deletes. Also you can select what volumes and folders that you want compared. The screenshots in the App Store shows the views I am referring to. They (Hyperbolic) offer a free trial version if you want to check it out.

 

[HDFan]

I use Araxis merge ($) which is a professional program with various options for comparing, merging and folder synchronization. They have a free trial.

Araxis: Software for Productive People

Home of Araxis Merge, the award-winning advanced 2 and 3-way file comparison (diff), merging and folder synchronization application.

www.araxis.com

 

[Unk1ne]

Clicked Post to quick

 

[Unk1ne]

Try the Cocoa version of Dupeguru - the Qt version looks like crap on macOS

Does this work on the iphone? some how i got tons of duplicate photos on my phone an no way to remove them all... thanks in advance

 

[allan.nyholm]

Does this work on the iphone? some how i got tons of duplicate photos on my phone an no way to remove them all... thanks in advance

You'll have to extract your photos from your iPhone via the Photos app or copy them over to your Mac via other means, such as using the Files app or whichever method you have been using, if any.

dupeGuru doesn't take on your iPhone's photos, but you can search for duplicates after copying them to your Mac - duplicate the folder of photos and images you just copied(as a precaution)
And then scan for duplicates. Be sure to check out the Preferences(CMD+,) for the Standard/Filename duplicate search as there's options to disregard the minimum filesize and adjusting the scope of the search for duplicates.

When your search is done and the Result window is opened then click the Dupes Only button in the toolbar and click the Match header twice to see all your 100% matches lined up top to bottom. Look in the Edit menu for marking options and then the Action menu for actually doing away with your duplicate files.

The changes I've made to the search preferences is seen in the second image below and the arrow pointing towards the Filter hardness slider is something I only use once in a while.
For this duplicate search I have not changed the Filter hardness. Perhaps choose a more "soft" duplicate search.

Oh, as a final tip.. Go for choosing the 100% matched duplicate files to begin with.

 

[DB10101]

There's an app called "Clone Fighter" which I've found to be reliable. It's slow and pretty basic, and a little confusing. It could use a lot more customizable features. But I've used it a lot and as far as I can tell the results are perfectly reliable.

 

[Barry_Rock]

I had to search for a long time, tried multiple softwares and found DuplicateFilesDeleter. It's a good choice in my opinion.

 

[Gregg2]

Here's a link about dupeGuru and some other options.

17 Alternatives to dupeGuru (Free and Paid Options)

dupeGuru is a free, cross-platform application designed to find duplicate files. While it’s not perfect, the issues we had with the app are fairly minor.

www.softwarehow.com

 

[allan.nyholm]

TrashMe 3 includes a de-Duplicate feature as well. Costs very little in comparison to most and doesn't have a subscription.. However, I will say that I think it needs plenty more work in its de-duplicate files department.

Jibapps, is just one developer(to my knowledge), and I'm certain that he will listen to feedback from you all.

 

[Dockland]

Check out "Shorui" on the App Store. Completely free, lightweight, and seems to handle duplicate files quite efficiently.

Life saver. Thank you!