[ANN] mbox packer plugin version 1.10 released

Discuss and announce Total Commander plugins, addons and other useful tools here, both their usage and their development.

Moderators: Hacker, petermad, Stefan2, white

Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hello Wilhelm!
(Warum nicht gleich so.... :D )
I probably just couldn't see the wood for the trees. :)
I understand that the naming of files is an internal necessity of the mbox format
Yes, that's the underlying problem. In contrast to "real" archives such as ZIP, mbox files do not contain file names, so the plugin must create them itself.
which are 33 mbs files, I find in every second file some mails with numbers (1) and (2)
Are those mails with numbers (1) and (2) sometimes identical, or are they always different?

I think there are 2 things to consider:
a) How to give almost all mails a unique filename, with as few exceptions as possible.
b) What to do in case of an exception (naming conflict).

ad a)
As you know, the plugin currently creates the filename from the subject of the mail, and then appends '_' and a hexadecimal number with 9 digits – representing date, time and time zone of the mail – to it. To be correct, not the complete information is used. mbox only uses one hexadecimal digit for representing the time zone, although there are AFAIK 24 different time zones. However, e.g. dbxplug.wcx - which allows TC to treat Outlook Express mail storage files as archives, and therefore has to solve the same general problem - only appends 6 digits to the subject in order to build the name. I actually was expecting that users would tell me that 9 digits are too much and too "ugly". But nobody has complained so far. :)

In the past, someone had suggested to append the Message-Id of the mail to the name. If it was created correctly, this Id is unique in the whole world. I decided not to use the Message-Id, because sometimes it can be rather long, often enough mails don't have a Message-Id at all, and also I want, when TC lists the mails inside an mbox sorted ascending by name, that it is guaranteed that older mails show up in the list before newer mails with the same name. So I have to use a number that has something got to do with the date and time of the mail.
Maybe I could additionally use a checksum. Probably not the MD5 checksum, which is very good, but rather long ( e.g. 4e73a5e2becd12f1154049d6d21c1ff8 :) ). A CRC32 checksum looks like this: 161A28EC. With such a checksum added, there would be 17 "cryptic" digits in the name ... Also, firstly I would have to test how long it takes to calculate the checksum. Enough about this point for the moment. :)

ad b)
I have an idea how to avoid the problem that your test above had shown. It would be easy to change the naming system, so that in case of duplicate names the name of the first mail is not changed, i.e. (1) will is not be appended. Then in your test, after deleting 1 mail in one mbox, TC would correctly only mark 1 mail as different. The disadvantage is, that this would cause inconsistent sorting of the mails (regardless whether in 'wincmd.ini' SortUpper is 0 or 1). The list of files from your test, sorted ascending by name, would look like this:

Code: Select all

aon.962051920_2A3770DA1(2) eml
aon.962051920_2A3770DA1    eml
aon.962051920_2A377CB71(2) eml
aon.962051920_2A377CB71    eml
aon.962051920_2A3A90591(2) eml
aon.962051920_2A3A90591    eml
What do you, and others, think?

Regards,
Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hello again Wilhelm!

Thanks for your info concerning EML View. I'll check it again on my system.

Regards,
Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hello Wilhelm!

Now I found out, that TC sorts the names consistently, when I use [square brackets] instead of (round brackets):

Code: Select all

aon.962051920_2A3770DA1     eml
aon.962051920_2A3770DA1[2]  eml
aon.962051920_2A377CB71     eml
aon.962051920_2A377CB71[2]  eml
aon.962051920_2A3A90591     eml
aon.962051920_2A3A90591[2]  eml
So I think in order to avoid the problem that you've shown in your test, I'll probably implement the little change in the naming system mentioned above, and include the numbers in square brackets.

Regards, Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
User avatar
Wilhelm M.
Power Member
Power Member
Posts: 1049
Joined: 2003-06-05, 10:45 UTC

Post by *Wilhelm M. »

Good news indeed! When will it be ready?

Thanks again Jürgen!
Grüße/Regards,
Wilhelm
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hi Wilhelm,

thanks for your kind words!

a) EML View
I had previously set the variable 'enc_def' to "ISO-8859-1" instead of the the variable 'enc_win'. Doing it like in your example seems to work for special German characters in the body, thanks. It does not seem to work for special characters in the subject -- even when this is also encoded in ISO-8859-1. Also, for showing the Euro sign, I think ISO-8859-15 must be supported. There are some more issues, e.g. I see no reason for changing the name of the header field "To:" to "Recipient:". Of this mail, which I picked randomly from my messages, only the last 4 lines of the body are shown ... I hope I'll have some time soon to write the author of EML View.

b) Release of mbox 1.10 final
The code for this release is "frozen" now, and will not be changed anymore (except when someone will report a bug). There is still some work to do. I'll again release the source code (now as separate package, because most users are probably not interested in it). I'll look through the whole code again, since there are probably some German comments that must be translated to English. I'll also write a new documnetation for the source code.
On Monday Okt 17, I asked here people to send me language files for the final 1.10 version within 2 weeks. So I think I should wait until the next weekend anyway.

c) PM
I wanted to send you a private mail, but couldn't find your e-mail address. Maybe you can send a short note to <prog.lue AT arcor.de> ?

Regards, Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
User avatar
Wilhelm M.
Power Member
Power Member
Posts: 1049
Joined: 2003-06-05, 10:45 UTC

Post by *Wilhelm M. »

Hm, I see the problem with the encoding now.
Juergen wrote: I wanted to send you a private mail, but couldn't find your e-mail address. Maybe you can send a short note to <prog.lue AT arcor.de> ?
Regards, Juergen
When I look into my profile I see an email adress. But I will send you an email anyway...
Grüße/Regards,
Wilhelm
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hello Wilhelm!

In your profile I see an empty field named "E-Mail-Adresse". There is also a "pn" button, but when I cklick at it, I get the message "Private Nachrichten wurden in diesem Board deaktiviert." (Private messaging has been disabled on this board.).

Regards, Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
User avatar
Sheepdog
Power Member
Power Member
Posts: 5150
Joined: 2003-12-18, 21:44 UTC
Location: Berlin, Germany
Contact:

Post by *Sheepdog »

Juergen wrote: There is also a "pn" button, but when I cklick at it, I get the message "Private Nachrichten wurden in diesem Board deaktiviert." (Private messaging has been disabled on this board.).
The private message system is indeed disabled here. Thus it is recommended to set in the profile to show the email button. Noone will get actually your email address by this but you will receive the mail enveloped by a mail of the TC Board.

sheepdog
"A common mistake that people make when trying to design something
completely foolproof is to underestimate the ingenuity of complete fools."
Douglas Adams
User avatar
Wilhelm M.
Power Member
Power Member
Posts: 1049
Joined: 2003-06-05, 10:45 UTC

Post by *Wilhelm M. »

Okay, guys! I have misunderstood the profile setting, which (literally translated) says "Always show email adress". Now I have activated this and it should no longer be a problem to send me an email .
Grüße/Regards,
Wilhelm
User avatar
Balderstrom
Power Member
Power Member
Posts: 2148
Joined: 2005-10-11, 10:10 UTC

Post by *Balderstrom »

@ Wilhelm, yeah that would be an easy one to misunderstand, the wording could perhaps be changed to something else...
"Allow PM via email" perhaps ;)
since the Email address is never displayed...
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

Hi all,

I've just released the final version of mbox 1.10.

changed
----------
* When there are duplicate mail names, no serial number is added to the first name anymore. The serial numbers of the other mails are now enclosed in square brackets instead of round brackets, so that Total Commander sorts the names consistently.
* Some internal changes.
* Language files are checked more strictly.
* German language file renamed to "German.lng". If you had installed the beta 2 version, please manually delete the file "Deutsch.lng".
* Improved documentation.

new
-----
* Automatic support for Dutch and Polish.
* Source code released as separate package.


Thanks to everyone who sent me feedback, and special thanks to the translators.
Enjoy!

Regards, Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
jj42
Junior Member
Junior Member
Posts: 50
Joined: 2007-08-18, 23:17 UTC

Post by *jj42 »

Hi Jürgen,

this plugin does not seem to work anymore with the current TC.
Could you try and update it, maybe even for 64bit also?

Also, I can't remember if this worked on Opera .mbs files as well. If you ever get around to update, please try and include this.

Thank you!
Juergen
Power Member
Power Member
Posts: 517
Joined: 2003-05-02, 18:19 UTC
Location: Berlin (Germany)
Contact:

Post by *Juergen »

jj42 wrote:this plugin does not seem to work anymore with the current TC.
Could you try and update it, maybe even for 64bit also?

Also, I can't remember if this worked on Opera .mbs files as well. If you ever get around to update, please try and include this.
The mbox plugin is running fine for more than 7 years now with all subsequent (32 bit) TC versions since it was released. I use it myself on a regular basis, now with the current TC version 8.01 32 bit (on Windows XP and Windows 7), and I did never encounter any problem.

So far there is only one known issue: If you have Data Execution Prevention (DEP) enabled on your system, then you'll get an exception error (already during installation of the plugin, BTW). This is because the plugin makes use of some machine code for speed reasons -- and because the programming language that I used to build the plugin only offered to do so by executing code from a non-executable memory region. After switching off DEP for TC on your system, that problem should be solved.

If you have a different problem, please tell me exactly what you mean with "does not seem to work anymore":
What are the extensions of the files that you used for testing? Are you sure that they are valid mbox files? Is the mbox plugin in TC associated with the respective file extension? Are other packer plugins associated with the respective file extension? What did you exactly do (double click or press [Enter] or press [Ctrl]+[Pg down] on an mbox file or ...)? Or did you try to create a new mbox? What exactly happened then? Was there an error message?

As written in the documentation, the plugin worked well with Opera's .MBS files back then. This is because these files were valid mbox files. The extensions are just conventions, and have no technical meaning regarding the file format (e.g. the names of Thunderbird's mbox files don't have an extension at all). Why do you think the plugin does not work with Opera's .MBS files? Did Opera change the format of those files in the meantime?

Regards, Juergen
My add-ons and plugins for TC: NiftyLink, mbox, Sequences
jj42
Junior Member
Junior Member
Posts: 50
Joined: 2007-08-18, 23:17 UTC

Post by *jj42 »

Juergen wrote:If you have Data Execution Prevention (DEP) enabled on your system, then you'll get an exception error (already during installation of the plugin, BTW).
(...)
After switching off DEP for TC on your system, that problem should be solved.
That is exactly my problem, I get the exception error while installing (registering the extensions), and then TC tells me "This is not a valid plugin".
Is it a good idea to turn off DEP for TC regarding security? I'll have to read up on DEP and what it's supposed to do...
Juergen wrote: the plugin worked well with Opera's .MBS files back then.
Thanks, I wasn't sure about that anymore. I guess Opera's file format is still the same.
bkant
Junior Member
Junior Member
Posts: 9
Joined: 2012-06-12, 03:03 UTC

Post by *bkant »

jj42 wrote:
Juergen wrote: the plugin worked well with Opera's .MBS files back then.
Thanks, I wasn't sure about that anymore. I guess Opera's file format is still the same.
I can confirm that the mbox plugin actually does work with current Opera mbs files. At the turn of the year I did a major work of archiving mails of some 15 years with about 300.000 single mails in total to a separate Opera archive instance, shuffling mails back and forth via several mbs ex- and import tasks. The mbox plugin provided very helpful assistance with that job - and thanks to Juergen for that plugin.
Post Reply