Slow rename over Samba

Bug reports will be moved here when the described bug has been fixed

Moderators: white, Hacker, petermad, Stefan2

Post Reply
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Slow rename over Samba

Post by *hlloyge »

I've noticed a problem since I've upgraded to last beta and now RC1 (haven't used previous ones). I have KodiBuntu media player which serves as NAS, through Samba and FTP. When trying to batch rename files, it renames them at a rate of 2 or 3 per second, then giving error that it could not rename files in bold, although it renames them pretty well. The HDD in KodiBuntu is ext4 formatted, and I had no speed problems with rename when using old stable version of totalcmd, although it will show error message for failed rename. My guess is that it tries to write some metadata supported on NTFS, but not in Samba share on ext4 drive - but the difference in renaming speed I can't explain. Network is gigabit, FTP upload goes up to 100 Mb/sec, considering I have those Green WD drives in NAS, it's quite respectable speed. And renaming through FTP goes as it should, very fast.
Local rename on windows NTFS drives are fast.

Can I do something to help out troubleshooting?
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 48231
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

That's strange - could you try renaming while running "process monitor" from www.sysinternals.com? It should show the error code.
Author of Total Commander
https://www.ghisler.com
Gappa
Junior Member
Junior Member
Posts: 2
Joined: 2016-10-25, 04:21 UTC

Post by *Gappa »

Hi, I have nearly the same problem - it happens on my system SSD (NTFS) and the file (well, now I tried it on just one) is not renamed.

Some stuff from Process Monitor:

Code: Select all

High Resolution Date & Time:	25.10.2016 6:26:20,7194650
Event Class:	File System
Operation:	CreateFile
Result:	SUCCESS
Path:	C:\fakepath\filename.docx
TID:	7308
Duration:	0.0000335
Desired Access:	Read Attributes
Disposition:	Open
Options:	Open Reparse Point
Attributes:	n/a
ShareMode:	Read, Write, Delete
AllocationSize:	n/a
OpenResult:	Opened

High Resolution Date & Time:	25.10.2016 6:26:20,7195180
Event Class:	File System
Operation:	QueryBasicInformationFile
Result:	SUCCESS
Path:	C:\fakepath\filename.docx
TID:	7308
Duration:	0.0000122
CreationTime:	24.10.2016 10:34:09
LastAccessTime:	24.10.2016 10:34:08
LastWriteTime:	24.10.2016 10:34:10
ChangeTime:	24.10.2016 13:44:26
FileAttributes:	A

High Resolution Date & Time:	25.10.2016 6:26:20,7195483
Event Class:	File System
Operation:	CloseFile
Result:	SUCCESS
Path:	C:\fakepath\filename.docx
TID:	7308
Duration:	0.0000127

High Resolution Date & Time:	25.10.2016 6:26:20,7197530
Event Class:	File System
Operation:	CreateFile
Result:	SHARING VIOLATION
Path:	C:\fakepath\filename.docx
TID:	7308
Duration:	0.0000526
Desired Access:	Read Attributes, Delete, Synchronize
Disposition:	Open
Options:	Synchronous IO Non-Alert, Open Reparse Point
Attributes:	n/a
ShareMode:	Read, Write, Delete
AllocationSize:	n/a
This goes in a loop many hundreds/thousands of times until manually aborted.
The filename is edited out to "C:\fakepath\filename.docx" - it is always the same for all those steps, it doesn't change.

Does this information help? :)
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

ghisler(Author) wrote:That's strange - could you try renaming while running "process monitor" from www.sysinternals.com? It should show the error code.
I can't do nothing when procmon is started, it freezes with that NAME NOT FOUND. When I stop Capture, it works.

Code: Select all

17:58:30,0000184	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	Desired Access: Read Attributes, Disposition: Open, Options: Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a, OpenResult: Opened
17:58:30,0013225	TOTALCMD64.EXE	11780	QueryBasicInformationFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	CreationTime: 5.10.2016. 13:22:20, LastAccessTime: 23.10.2016. 10:18:31, LastWriteTime: 5.10.2016. 13:22:20, ChangeTime: 5.10.2016. 13:22:20, FileAttributes: N
17:58:30,0013478	TOTALCMD64.EXE	11780	CloseFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	
17:58:30,0040956	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	Desired Access: Read Attributes, Delete, Synchronize, Disposition: Open, Options: Synchronous IO Non-Alert, Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a, OpenResult: Opened
17:58:30,0064483	TOTALCMD64.EXE	11780	QueryAttributeTagFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	Attributes: N, ReparseTag: 0x0
17:58:30,0065012	TOTALCMD64.EXE	11780	QueryBasicInformationFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	CreationTime: 5.10.2016. 13:22:20, LastAccessTime: 23.10.2016. 10:18:31, LastWriteTime: 5.10.2016. 13:22:20, ChangeTime: 5.10.2016. 13:22:20, FileAttributes: N
17:58:30,0089583	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi	SUCCESS	Desired Access: Write Data/Add File, Synchronize, Disposition: Open, Options: , Attributes: n/a, ShareMode: Read, Write, AllocationSize: n/a, OpenResult: Superseded
17:58:30,0101739	TOTALCMD64.EXE	11780	SetRenameInformationFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	ReplaceIfExists: False, FileName: \\Borg-kodi\Downloads\Filmovi\tbbt1-1tbbt1-1.mkv
17:58:30,0129589	TOTALCMD64.EXE	11780	CloseFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1tbbt1-1.mkv	SUCCESS	
17:58:30,0156098	TOTALCMD64.EXE	11780	CloseFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	SUCCESS	
17:58:30,0189568	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1tbbt1-1.mkv	SUCCESS	Desired Access: Write Attributes, Synchronize, Disposition: Open, Options: Synchronous IO Non-Alert, Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a, OpenResult: Opened
17:58:30,0190495	TOTALCMD64.EXE	11780	SetBasicInformationFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1tbbt1-1.mkv	ACCESS DENIED	CreationTime: 1.1.1601. 2:00:00, LastAccessTime: 1.1.1601. 2:00:00, LastWriteTime: 1.1.1601. 2:00:00, ChangeTime: 1.1.1601. 2:00:00, FileAttributes: AN
17:58:30,0199822	TOTALCMD64.EXE	11780	CloseFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1tbbt1-1.mkv	SUCCESS	
17:58:30,0256807	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	NAME NOT FOUND	Desired Access: Read Attributes, Disposition: Open, Options: Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a
17:58:30,0281379	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	NAME NOT FOUND	Desired Access: Read Attributes, Delete, Synchronize, Disposition: Open, Options: Synchronous IO Non-Alert, Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a
17:58:30,0331270	TOTALCMD64.EXE	11780	CreateFile	\\Borg-kodi\Downloads\Filmovi\tbbt1-1.mkv	NAME NOT FOUND	Desired Access: Read Attributes, Disposition: Open, Options: Open Reparse Point, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 48231
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

2Gappa
That all looks fast - do you see any difference in the log between TC 9 and TC 8.52a final?
Author of Total Commander
https://www.ghisler.com
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

With latest RC3 renaming on SMB shares in linux works like they should.
Thank you.
Gappa
Junior Member
Junior Member
Posts: 2
Joined: 2016-10-25, 04:21 UTC

Post by *Gappa »

Sorry for the late reply - RC3 also fixed the Multi-Rename for me (it broke for me during some of the beta versions; I skipped RC2).

It's now very fast (as one can expect with small files & SSD), ProcMon shows this (for each file, I tried it with 3, only pasting info for the first one):

Code: Select all

High Resolution Date & Time:	31.10.2016 13:23:56,4083192
Event Class:	File System
Operation:	CreateFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000516
Desired Access:	Read Attributes
Disposition:	Open
Options:	Open Reparse Point
Attributes:	n/a
ShareMode:	Read, Write, Delete
AllocationSize:	n/a
OpenResult:	Opened

High Resolution Date & Time:	31.10.2016 13:23:56,4084030
Event Class:	File System
Operation:	QueryBasicInformationFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000194
CreationTime:	31.10.2016 12:36:52
LastAccessTime:	31.10.2016 12:36:51
LastWriteTime:	31.10.2016 12:36:52
ChangeTime:	31.10.2016 13:23:43
FileAttributes:	A

High Resolution Date & Time:	31.10.2016 13:23:56,4084523
Event Class:	File System
Operation:	CloseFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000222

High Resolution Date & Time:	31.10.2016 13:23:56,4086760
Event Class:	File System
Operation:	CreateFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000798
Desired Access:	Read Attributes, Delete, Synchronize
Disposition:	Open
Options:	Synchronous IO Non-Alert, Open Reparse Point
Attributes:	n/a
ShareMode:	Read, Write, Delete
AllocationSize:	n/a
OpenResult:	Opened

High Resolution Date & Time:	31.10.2016 13:23:56,4087938
Event Class:	File System
Operation:	QueryAttributeTagFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000195
Attributes:	A
ReparseTag:	0x0

High Resolution Date & Time:	31.10.2016 13:23:56,4088513
Event Class:	File System
Operation:	QueryBasicInformationFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0000159
CreationTime:	31.10.2016 12:36:52
LastAccessTime:	31.10.2016 12:36:51
LastWriteTime:	31.10.2016 12:36:52
ChangeTime:	31.10.2016 13:23:43
FileAttributes:	A

High Resolution Date & Time:	31.10.2016 13:23:56,4090216
Event Class:	File System
Operation:	CreateFile
Result:	SUCCESS
Path:	C:\temp
TID:	2860
Duration:	0.0000521
Desired Access:	Write Data/Add File, Synchronize
Disposition:	Open
Options:	
Attributes:	n/a
ShareMode:	Read, Write
AllocationSize:	n/a
OpenResult:	Opened

High Resolution Date & Time:	31.10.2016 13:23:56,4091724
Event Class:	File System
Operation:	SetRenameInformationFile
Result:	SUCCESS
Path:	C:\temp\test_1.txt
TID:	2860
Duration:	0.0002822
ReplaceIfExists:	False
FileName:	C:\temp\test_1_new.txt

High Resolution Date & Time:	31.10.2016 13:23:56,4094813
Event Class:	File System
Operation:	CloseFile
Result:	SUCCESS
Path:	C:\temp
TID:	2860
Duration:	0.0000380

High Resolution Date & Time:	31.10.2016 13:23:56,4095950
Event Class:	File System
Operation:	CloseFile
Result:	SUCCESS
Path:	C:\temp\test_1_new.txt
TID:	2860
Duration:	0.0000534

High Resolution Date & Time:	31.10.2016 13:23:56,4098518
Event Class:	File System
Operation:	CreateFile
Result:	SUCCESS
Path:	C:\temp\test_1_new.txt
TID:	2860
Duration:	0.0000815
Desired Access:	Write Attributes, Synchronize
Disposition:	Open
Options:	Synchronous IO Non-Alert, Open Reparse Point
Attributes:	n/a
ShareMode:	Read, Write, Delete
AllocationSize:	n/a
OpenResult:	Opened

High Resolution Date & Time:	31.10.2016 13:23:56,4099750
Event Class:	File System
Operation:	SetBasicInformationFile
Result:	SUCCESS
Path:	C:\temp\test_1_new.txt
TID:	2860
Duration:	0.0000221
CreationTime:	01.01.1601 1:00:00
LastAccessTime:	01.01.1601 1:00:00
LastWriteTime:	01.01.1601 1:00:00
ChangeTime:	01.01.1601 1:00:00
FileAttributes:	AN

High Resolution Date & Time:	31.10.2016 13:23:56,4100212
Event Class:	File System
Operation:	CloseFile
Result:	SUCCESS
Path:	C:\temp\test_1_new.txt
TID:	2860
Duration:	0.0000190
So I think it's fixed - thanks! :)
Post Reply