How to remove dublicates? Topic #infinity

English support forum

Moderators: sheep, Hacker, Stefan2, white

Post Reply
tasuketekudasai
Junior Member
Junior Member
Posts: 4
Joined: 2018-06-16, 06:34 UTC

How to remove dublicates? Topic #infinity

Post by *tasuketekudasai » 2019-11-16, 17:22 UTC

I know on this forum lots of these questions since 2004. And i know, Ghisler said he doesn't know what method choose to select duplicates that's why we still have no(?) opportunity to remove duplicates automatically.

Anyway. Look at my pic. Do you really think i'm care what of these duplicates will be deleted? Just give me solution how to delete all duplicates. I don't care which will be deleted. I just want to keep only original files without repeats.

User avatar
milo1012
Power Member
Power Member
Posts: 1109
Joined: 2012-02-02, 19:23 UTC

Re: How to remove dublicates? Topic #infinity

Post by *milo1012 » 2019-11-16, 17:52 UTC

Numpad+
...
F8
TC plugins: PCREsearch and RegXtract

User avatar
ts4242
Power Member
Power Member
Posts: 2081
Joined: 2004-02-02, 20:08 UTC
Contact:

Re: How to remove dublicates? Topic #infinity

Post by *ts4242 » 2019-11-16, 18:49 UTC

2tasuketekudasai
1. Open Find dialog (Alt+F7)
2. Search for *.mp4 or whatever, in advanced tab check Find duplicate files
3. After searching complete press Feed to listbox button
4. Press Num +
5. In Select duplicate files dialog make your favorite choices
6. Press F8 to delete

User avatar
Usher
Power Member
Power Member
Posts: 630
Joined: 2011-03-11, 10:11 UTC

Re: How to remove dublicates? Topic #infinity

Post by *Usher » 2019-11-16, 19:38 UTC

2milo1012 2ts4242
It's a joke, isn't it? There is no possibility to make wildcard selection for files listed on the picture. In this case the only way to remove duplicates I know is to repeat pressing Insert and Down for all pairs found. Read explanations below, please.

2tasuketekudasai
I'm afraid you should really delete all listed videoplayback files. It looks like you have watched the same video two times in your browser and now you can see pairs of MPEG DASH segments in the browser cache. They aren't numbered in a proper order so you can't watch them one after one as a single movie. What is more, some of them may contain only video or audio stream.
You should use some youtube/video downloader which can download audio and video MPEG DASH segments listed in *.m3u playlist, then merge and mux them into a single mp4 file.

There is no general solution for removing duplicates: some people want to keep files with lower numbers or with older timestamps, some other prefer to keep files with specific names or from specific directory. If you can't decide which approach is better or if you just don't bother, you can use DFHL (Duplicate File Hard Linker) which replaces duplicates with links. I'm pretty sure there are more similar tools mentioned in the old topics you have found and browsed so far in this forum, but only you know which one is better for your needs.
Regards from Poland
Andrzej P. Wozniak

User avatar
milo1012
Power Member
Power Member
Posts: 1109
Joined: 2012-02-02, 19:23 UTC

Re: How to remove dublicates? Topic #infinity

Post by *milo1012 » 2019-11-16, 19:51 UTC

2Usher
It seems that you're not aware of that special selection dialog when in the "found files" window after searching for duplicates:
https://i.imgur.com/d1a9ZIx.png
I would appreciate it if you try these things for yourself before posting.
TC plugins: PCREsearch and RegXtract

tasuketekudasai
Junior Member
Junior Member
Posts: 4
Joined: 2018-06-16, 06:34 UTC

Re: How to remove dublicates? Topic #infinity

Post by *tasuketekudasai » 2019-11-18, 04:01 UTC

ts4242 wrote:
2019-11-16, 18:49 UTC
2tasuketekudasai
1. Open Find dialog (Alt+F7)
2. Search for *.mp4 or whatever, in advanced tab check Find duplicate files
3. After searching complete press Feed to listbox button
4. Press Num +
5. In Select duplicate files dialog make your favorite choices
6. Press F8 to delete
milo1012 wrote:
2019-11-16, 17:52 UTC
Numpad+
...
F8
Hi guys. I use laptop and have no numpad. What does this button mean? Tell me i will change for another one and will try your method.



Usher wrote:
2019-11-16, 19:38 UTC
2tasuketekudasai
I'm afraid you should really delete all listed videoplayback files. It looks like you have watched the same video two times in your browser
I dunno why you wrote this coz my question was about removing duplicates. This is not playlist or somethings. Just duplicates of files and i want to remove duplicates. And i don't care which: i need to keep only one file in each pairs coz they are the same. Why should i think about numbers? I don't care. Ghisler said 15 years ago he didn't know solution coz different people want different files to keep. Okay. But why we have (or have?) no option to delete random (or every first or every second or any whatever) file in these groups of duplicates? I mean we have nothing now except our hands. I prefer to have matches instead of sit in the dark and wait for electricity.

Shosho
Junior Member
Junior Member
Posts: 4
Joined: 2017-10-10, 12:59 UTC

Re: How to remove dublicates? Topic #infinity

Post by *Shosho » 2019-11-18, 06:06 UTC

Hi guys. I use laptop and have no numpad. What does this button mean? Tell me i will change for another one and will try your method.
Make a button with the following command cm_SpreadSelection. It will be exactly the same as Numpad+ from the keyboard.

tasuketekudasai
Junior Member
Junior Member
Posts: 4
Joined: 2018-06-16, 06:34 UTC

Re: How to remove dublicates? Topic #infinity

Post by *tasuketekudasai » 2019-11-18, 12:56 UTC

Thanks. It helped.

User avatar
Usher
Power Member
Power Member
Posts: 630
Joined: 2011-03-11, 10:11 UTC

Re: How to remove dublicates? Topic #infinity

Post by *Usher » 2019-11-18, 13:15 UTC

tasuketekudasai wrote:
2019-11-18, 04:01 UTC
Hi guys. I use laptop and have no numpad. What does this button mean? Tell me i will change for another one and will try your method.
Look at "Mark" menu: "Num +" is "Select group", the very first item there. Or create and use buttons as suggested in another message, though it won't be much faster than pressing Alt+M, Enter, I think.
tasuketekudasai wrote:
2019-11-18, 04:01 UTC
Usher wrote:
2019-11-16, 19:38 UTC
2tasuketekudasai
I'm afraid you should really delete all listed videoplayback files. It looks like you have watched the same video two times in your browser
I dunno why you wrote this coz my question was about removing duplicates.
It is just a reminder that deduplicating of this very special kind of files (small videoplayback*.mp4) is a waste of time in most cases. They contain unuseful trash and may be all deleted.
Of course your question may be valid in many other cases.
Regards from Poland
Andrzej P. Wozniak

User avatar
Usher
Power Member
Power Member
Posts: 630
Joined: 2011-03-11, 10:11 UTC

Re: How to remove dublicates? Topic #infinity

Post by *Usher » 2019-11-18, 13:30 UTC

milo1012 wrote:
2019-11-16, 19:51 UTC
I would appreciate it if you try these things for yourself before posting.
You are right, it works as I'd like to, but it's hidden in TC Help. Explanations are linked only from "Selecting files" page - it contains one line remark which is easy to overlook. They should be linked also on "Find files: Advanced" page in "Find duplicate files" section.

I misunderstood your suggestion. I was thinking you want to delete all files with no exclusion. I did stop using IE long time ago and never tested this TC feature so I forgot it - in my case links are preferred. What is more, in this topic I was focused on videoplayback files - for those files my explanations about MPEG DASH may be more useful then removing duplicates.
Regards from Poland
Andrzej P. Wozniak

User avatar
petermad
Power Member
Power Member
Posts: 8974
Joined: 2003-02-05, 20:24 UTC
Location: Valsted, Denmark
Contact:

Re: How to remove dublicates? Topic #infinity

Post by *petermad » 2019-11-18, 17:07 UTC

They should be linked also on "Find files: Advanced" page in "Find duplicate files" section
I totally agree - the "Select duplicate files" function is the most hidden feature in TC.
License #524 (1994)
Danish Total Commander Translator
TC 9.5b8 32+64bit on Win XP 32bit, Win 7, 8.1 & 10 (1909) 64bit, 'Everything' 1.4.1.935 (x64)
TC 3.0b12 on Android 6.0
Get: Extended Total Commander Menus | PHSM-Calendar

Post Reply