crc32tag content plugin (support, feedback, ect...)

Discuss and announce Total Commander plugins, addons and other useful tools here, both their usage and their development.

Moderators: white, Hacker, petermad, Stefan2

User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Post by *byblo »

@tbeu: I'm sorry but I have a lot of problems with your Unicode release.

- If I create a file named: c:\temp\Ю.bin and calculate his CRC32,
after closing the total commander, and look into the crc32tag.cache.txt, it only saves the path c:\temp\ without anything else.

- If I create a file c:\temp\test.bin and create his sfv using TC (c:\temp\test.sfv), then using the content column CheckCrcFrom->Auto_OnDemand_IfBiggerThanSize3 (or any other based on SFV), it returns '1/1 missing!'
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

2byblo
OK, too few tests from my side. :oops: Can you please download and check again. Should be fixed now.
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Post by *byblo »

Thank you :)

But still problem with the sfv files in ANSI code.
Here are some sample files to help debugging:
http://www9.zippyshare.com/v/3573052/file.html

Containing:
mystères.bin
mystères.ANSI.sfv
mystères.UTF-8.sfv

The file mystères.ANSI.sfv still reporting a missing file, when it should not.
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

I see. I thought that TC would always generate sfv files encoded in UTF-8.

Please download and check again. Should be fixed now, at least if sfv file encoded in UTF-8 has proper BOM.
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Post by *byblo »

Great. It seems working well now :)
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

Thanks for testing!
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

2ghisler
Is there any reason why sfv files are not always encoded in UTF-8?
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

2byblo
Can you please update plugin on totalcmd.net? You should increase version info, too. Thanks.
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Post by *byblo »

Sorry. Still testing it. I lost my old test files, but ill do it asap.
User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Post by *byblo »

Updated to 0.23b at http://www.totalcmd.net/plugring/crc32tag.html

@tbeu: thank you again for you contribution :)
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

Thanks for the update.
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
Alextp
Power Member
Power Member
Posts: 2321
Joined: 2004-08-16, 22:35 UTC
Location: Russian Federation
Contact:

Post by *Alextp »

TC.net text

a)add link to forum (Admin panel-> enter URL)
b)fixed text, yours is bad:
This content plugin is intended to calculate CRC32 and to read CRC32 values previously saved in filenames (for example: FileName_[0AA03FF4].bin).

This may be useful when having lot of little files which are constantly separated (like video samples), and it's not possible to support common SFV or individual SFV's due to incessant file moving.
User avatar
ask-rus
Junior Member
Junior Member
Posts: 44
Joined: 2010-06-17, 10:29 UTC
Location: Russian Federation

Post by *ask-rus »

byblo, tbeu
Can you move the settings from contplug.ini to the directory plugin (crc32tag.ini)? Thanks.
User avatar
tbeu
Power Member
Power Member
Posts: 1336
Joined: 2003-07-04, 07:52 UTC
Location: Germany
Contact:

Post by *tbeu »

ask-rus wrote:Can you move the settings from contplug.ini to the directory plugin (crc32tag.ini)? Thanks.
You can try updated version. Create empty file crc32tag.ini in plugin directory and it will be used as settings file instead. If it is not found contplug.ini is used as before.
Download: wdx_crc32tag024b.zip (x86/x86-64) (C++ sources included)[
TC plugins: Autodesk 3ds Max / Inventor / Revit Preview, FileInDir, ImageMetaData (JPG Comment/EXIF/IPTC/XMP), MATLAB MAT-file Viewer, Mover, SetFolderDate, Solid Edge Preview, Zip2Zero and more
User avatar
byblo
Senior Member
Senior Member
Posts: 270
Joined: 2005-02-20, 21:13 UTC
Contact:

Re: crc32tag content plugin (support, feedback, ect...)

Post by *byblo »

Updated to 0.25b.

History:
----------
* 0.25b, (MAJOR RELEASE)
- NOTE: Do not forget to enable both ini entries: Int_CacheSaveToFile=1 and Int_CacheLoadFromFile=1 to benefit all of the cache list updated functions.
- Speed optimisation: Added ini entry: Int_MaxBufferSize, which should greatly increases the reading speed in some cases (the previous versions were fixed 4096B buffer)
- Speed optimisation: Now GetCrc32From.* functions will return empty field for SFV filetype when ini entry Int_TreatSfvAsSpecial is equal to 1. This is to avoid searching for SFV files for another SFV.
- Speed compromise: Now GetCrc32From.Auto_Result will only return "tag" instead of "tag/sfv" (skip SFV searching if file is already covered by tag in name).
- Added GetCrc32From.Auto_Result_LegacySlower which has the same functions as the previous version of GetCrc32From.Auto_Result (more precise).
- Added GetCrc32From.Auto_Result_LegacySlower string entry to crc32tag.lng.
- Str_Delayed default ini entry is now "- - -" against "- - - - -" before.
- Speed optimisation: Greatly optimized cache list reading speed in memory by using 256 sorted lists of 256 lines each.
- Speed optimisation: Now accessing cache list in memory should feel almost instant: 8001\256 = 31.25x faster than before!
- Longevity Optimisation: Now the life of cache list entries before being overwrited should be way much longer, thanks to both the 256 lists sorting and the increased total size: 65536 entries vs 8001 for older versions.
- Longevity Optimisation: Because of the new bigger cache list entries count (16+65536 vs 8001), the memory usage increased from +3MB to +65MB (tested on x86 version).
- Safety: basic check at loading the cache file to automatically ignore and replace in case of older/corrupted/incompatible content.
- PrivateInt_CacheListIndex ini entry is now obsolete and will not anymore be loaded nor saved to ini file.
- Default now ini entry Int_Size3 is equal to 52428800(50MB) (250MB on previous version)
- Changed returning string "corrupted META?" to "BAD META?"
- Speed optimisation: More accurate searching for the matching SFV file. Searching order until SFV is found is now: E.G. c:\folder\file.txt --> file.sfv, file.txt.sfv, folder.sfv, *.sfv or f*.sfv, sfv not found.
- Speed compromise: Added ini entry Int_FolderSearchOnlyMatchingFirstChar_FASTER. If set to 1, search only for files matching the first letter. E.G.: c:\test.txt --> c:\t*.sfv. Otherwise: c:\*.sfv
- Speed compromise: Added ini entry Int_FolderSearchMaxFilesCount. -1=search for all (can be very slow if LOT of sfv in current folder) 0 or more=Maximum searching before returning CRC not found in SFV.
- Now compiled with VS2012EX


Some notes about it:
-----------------------------
* Since 0.25b, the cache list is greatly speed optimized and size increased by using 256 sorted lists of 256 lines each:
The number of 256 lines per list was determined as the best compromise between speed access, total storage, memory usage, average before overwriting, ect...
You will find the other values for compairing in detail into the crc32tag.cpp source file.
You will find the differents compilated versions for 32, 64, 128, 256, 512, 1024 and 2048 at my patreon page if needed.

Here is only the one that is used in the compilated plugin, which is 256 (MAX_CACHE_LIST_SIZE):
--------------------------------------------------------------------------------------------
- Accessing cache list speeds theorical compare showing the advantage on the new 256 lists x 256 lines versus the old version using a single list of 8001 lines:
(8001/256)/2 = average of 15.62x faster, for a 65536/8001 = 8.19x bigger cache list size.

- Accessing cache list speeds theorical compare showing the advantage on the new 256 lists x 256 lines versus the old single list if it had to keep matching the total sizes:
64008 / ( 65536 / 256) = 1 to 250x or 100% to 25000%. Average: 125x faster.

- Refreshing before starting overwriting theorical:
New cache lists of 256x256(65536) total lines per 3150 files refreshing\adding : 256/(3150/256) = 20.8x refreshes in average before overwriting.

- Space taken in memory and disk for 256 cache lists (non-theorical except some of the cache file size):
256 = 65536 cache lines, +65MB to the file manager (x86) in memory, should give a cache file size of +-24MB once filled at 100% with datas.


You can find them at the usual http://totalcmd.net/plugring/crc32tag.html or at my patreon https://www.patreon.com/posts/wdx-crc32tag0-74812114

Enjoy :)
Post Reply