Find duplicate images without metadata

English support forum

Moderators: white, Hacker, petermad, Stefan2

Post Reply
ericthibeault
Junior Member
Junior Member
Posts: 9
Joined: 2015-08-16, 15:20 UTC

Find duplicate images without metadata

Post by *ericthibeault »

Hi,

I know Total commander is THE swiss knife software for all purpose, but I think I found one thing that it doesn't do, and I would really want to know if someone ever though of this or show me if there is a plugin to do this:

I have a lot of photos that are duplicate, I found all the 100% same files and deleted the duplicates for those, but know, the metadata for a lot of those images has been changed (ligthroom face recognition) and Total commander cannot find duplicates since the metadata part has been changed (and file size). But the "image" remain the same.

Is there any way I could use Total Commander to find duplicate "images" but with different metadata?

Thanks
User avatar
Hacker
Moderator
Moderator
Posts: 13064
Joined: 2003-02-06, 14:56 UTC
Location: Bratislava, Slovakia

Post by *Hacker »

Hell ericthibeault,
Hmm, good question. Certainly not out of the box. A quick Google search brought up these:
Duplicate Image Finder
VisiPics

Another approach would be to copy the images somewhere, strip all metadata, calculate hashes and compare those.

HTH in any way
Roman
Mal angenommen, du drückst Strg+F, wählst die FTP-Verbindung (mit gespeichertem Passwort), klickst aber nicht auf Verbinden, sondern fällst tot um.
PhiloVance
Junior Member
Junior Member
Posts: 25
Joined: 2012-07-28, 16:43 UTC

Post by *PhiloVance »

I've used a freeware program called AntiTwin for this. It has a "Compare Images" mode (under "File Filter...") that works well for the kind of fuzzy comparison necessary to identify similar photos.

http://www.joerg-rosenthal.com/en/antitwin/

The owner hasn't updated it in a few years, but I can vouch for it's stability at least up to Windows 8.1. And did I mention that it's FREE?
ericthibeault
Junior Member
Junior Member
Posts: 9
Joined: 2015-08-16, 15:20 UTC

Post by *ericthibeault »

Thank you Hacker and PhiloVance,

I tested Antitwin and it works like a charm. Search with compare image and 95% threshold on dummy test folders and it found all the duplicates that has different metadata!

And it seems light and quick to run bigger batch...

I'll certainly contact the owner to thank him and donate.

Thanks a lot
User avatar
Lefteous
Power Member
Power Member
Posts: 9535
Joined: 2003-02-09, 01:18 UTC
Location: Germany
Contact:

Post by *Lefteous »

Some time ago I wrote a content plugin called 'Image'. It has been developed for the described use case. Unfortunately it has never been developed to a productive level :-) Maybe I find the time to do that some day.

https://totalcmd.net/plugring/image.html
User avatar
brian
Junior Member
Junior Member
Posts: 61
Joined: 2003-09-25, 01:14 UTC
Contact:

Post by *brian »

VirusTotal says:
Detection ratio: 0/59
This file was last analysed by VirusTotal on 2017-06-06 21:09:43 UTC (1 day, 12 hours ago) it was first analysed by VirusTotal on 2011-05-14 02:24:18 UTC.

https://www.virustotal.com/en/file/8e0eb573a8a7db8fe8e3f3cf21e749ac01d0ad21a12de0e59f15dec827c34308/analysis/

I guess that's called the power of not updating. :) ;)
We call it WindowsCommander because it commands Windows, not "Total".
even though it'd be cool to command a 7 trillion dollar oil company
It won Best Alternative File Manager
http://polldaddy.com/poll/810222/
First comment = my girl! ;)
IceLancer
Junior Member
Junior Member
Posts: 15
Joined: 2019-01-30, 18:35 UTC

Re:

Post by *IceLancer »

Lefteous wrote: 2017-02-06, 09:07 UTC Some time ago I wrote a content plugin called 'Image'. It has been developed for the described use case. Unfortunately it has never been developed to a productive level :-) Maybe I find the time to do that some day.

https://totalcmd.net/plugring/image.html
AH this tool man , saved me massive headache !
I tried doublekiller but it has major flaw , it cannot read files with non (English) characters and breaks down, tried a lot other tools all are just too much of..nothing
Total commander find duplicate-> same content is amazing IF you are dealing with only few files. But i had couple thousand files to deal with... i cannot possibly go and manually select file by file..

Your APP does same thing as TC but it has easy and clever "selection properties" which was a life savior. Thanks man!

Image: https://i.imgur.com/wmx7Xzv.png
Post Reply