8.51a: Synchronize Dirs: very bad memory problem

The behaviour described in the bug report is either by design, or would be far too complex/time-consuming to be changed

Moderators: Hacker, petermad, Stefan2, white

Post Reply
schittli
Member
Member
Posts: 101
Joined: 2004-01-06, 16:13 UTC
Location: Switzerland, Biel Bienne

8.51a: Synchronize Dirs: very bad memory problem

Post by *schittli »

Hello

There is a very bad Problem with 8.51a in the Synchronize Dirs command:

I have the Synchronize Dirs Window open and the following statistics:

Files found: 5765/6320
Identical: 5765
Different: 0/205
Unique left: 0/19
Unique right: 0/331

Visible are only all identical files
Now I start to delete all identical files from the right panel - and now one can watch how TC allocates endless Memory for each file it deletes: after about 1000 deleted files TC uses 1GB Ram and if I try to cancel the process it looks like it hangs.

It's even worse: if I don't stop TC and let it delete all Files, then the Memory will not be released after the Sync Dirs Window is closed.

The Problem is identical for the x32 and x64 Editions.

Kind regards,
Tom
User avatar
Dalai
Power Member
Power Member
Posts: 9968
Joined: 2005-01-28, 22:17 UTC
Location: Meiningen (Südthüringen)

Post by *Dalai »

Can you reproduce it with a clean wincmd.ini? Which OS are you using?

Regards
Dalai
#101164 Personal licence
Ryzen 5 2600, 16 GiB RAM, ASUS Prime X370-A, Win7 x64

Plugins: Services2, Startups, CertificateInfo, SignatureInfo, LineBreakInfo - Download-Mirror
schittli
Member
Member
Posts: 101
Joined: 2004-01-06, 16:13 UTC
Location: Switzerland, Biel Bienne

Post by *schittli »

Hi Dalai
Dalai wrote:Can you reproduce it with a clean wincmd.ini? Which OS are you using?
I'll try it, I tried other releases and I have the same Problems, therefore I think it's a Config-Problem... which is strange, because TC "just" deletes Files and with every deleted File it eats my Memory ;-(

I use Windows Server 2008 R2.

I'll write again if I got some News about my config.

Kind regards, Tom
Last edited by schittli on 2014-08-08, 20:48 UTC, edited 2 times in total.
schittli
Member
Member
Posts: 101
Joined: 2004-01-06, 16:13 UTC
Location: Switzerland, Biel Bienne

Post by *schittli »

Hi Dalai
Dalai wrote:Can you reproduce it with a clean wincmd.ini?
OK..., it's reproduceable, but any of my Addons amplifies the effect: without any Addon, we have a Memory leak, with the Addons it is probably worse.

I followed those steps to reproduce it:
1) Prepare: Copy a Directory with 6000 Files / 1500 Folders (65BMytes) to use both directories later in the TC "Synchronize directories" window
2) Clean Installation of TC 8.51a to d:\tcmd_test, ini-files in application folder
3) Start TC x64
4) Open "Synchronize directories" with the original Directory and ist Copy (created in Step 1))
5) Compare both Directories with this setting:
o Empty Directories
x Asymmetric
x Subdirs
x by Content
x ignore date
6) After the comparison is finished, just Display all equal (=) files
7) Delete all files on the right Panel

TC Memory consumption:
1) Before I open "Synchronize directories": 15MB
2) After I deleted 1000 Files: 612MB
3) After I closed "Synchronize directories": 923MB (The Dialog does not release ist Memory!!)
4) After 1 more Minute: 1.5GB (I did not have started any TC Action!)
5) After 10 more Minutes: 10GB (I did not have started any TC Action!)

There must be a really bad Memory leak in TC.

Kind regards,
Tom
User avatar
Hacker
Moderator
Moderator
Posts: 13142
Joined: 2003-02-06, 14:56 UTC
Location: Bratislava, Slovakia

Post by *Hacker »

schittli,
OS? VistaDelete= setting in wincmd.ini?

Roman
Mal angenommen, du drückst Strg+F, wählst die FTP-Verbindung (mit gespeichertem Passwort), klickst aber nicht auf Verbinden, sondern fällst tot um.
schittli
Member
Member
Posts: 101
Joined: 2004-01-06, 16:13 UTC
Location: Switzerland, Biel Bienne

Post by *schittli »

Hacker wrote:schittli,
OS? VistaDelete= setting in wincmd.ini?

Roman
Hi Hacker,

thanks for your question!, as I already wrote, I use Windows 2008 Server.
And because I created a fresh Installation, there is noch VistaDelete Setting:

Code: Select all

[Configuration]
firstmnu=3002
SyncFlags=15
SyncButtons=50
SeparateTree=0
PanelsVertical=0
InstallDir=d:\tcmd_test
UseNewDefFont=0
FirstTime=0
test=37
[FileSystemPlugins64]
$checksum$=3014672
[MkDirHistory]
0=130824 1654_
[left]
path=d:\src\
ShowAllDetails=0
SpecialView=0
show=1
sortorder=0
negative Sortorder=0
[right]
path=a:\src\
ShowAllDetails=1
SpecialView=0
show=1
sortorder=0
negative Sortorder=0
Kind regards,
Tom
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 50550
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

This is actually a bug in Windows itself, when deleting to recycle bin: TC has to delete each directory separately, because otherwise the recycle bin would start deleting the wrong files. Windows starts a new thread for each delete call, so it can take a lot of memory when deleting a lot of directories. The only solution is to bypass recycle bin and delete the files directly.
Author of Total Commander
https://www.ghisler.com
schittli
Member
Member
Posts: 101
Joined: 2004-01-06, 16:13 UTC
Location: Switzerland, Biel Bienne

Post by *schittli »

Thank you very much for this information!, I'll test it and will post my result - just to complete this subject :-)

Kind regards,
Tom
Post Reply