Invalid language code page detection.

The behaviour described in the bug report is either by design, or would be far too complex/time-consuming to be changed

Moderators: white, Hacker, petermad, Stefan2

Post Reply
rstaganrog
Junior Member
Junior Member
Posts: 7
Joined: 2009-06-17, 08:05 UTC

Invalid language code page detection.

Post by *rstaganrog »

Internal Lister's viewer (by F3) of Total Commander 7.04 (and early too) wrong autodetect some cyrilic-coded (Win866 or OEM DOS) texts. Below I put simple example of this file - you need save this text (between <begin file> and <end file>) as ASCII - DOS encoded:

<begin file>
C:\WINDOWS\system32>xcopy /z \\srv1\repl\Export \\srv2\repl\Import /E /S /Y /D
Скопировано файлов: 0.
07.02.2008
06:11
<end file>

To viewing this file as cyrillic text I need after opening file by pressing <F3>-key - press <S>-key to switch to ASCII DOS encoding.

Many other editors (AkelPad, as example) autodect this DOS-coded files without any problems.
Last edited by rstaganrog on 2009-06-17, 10:51 UTC, edited 1 time in total.
rstaganrog
Junior Member
Junior Member
Posts: 7
Joined: 2009-06-17, 08:05 UTC

Re: Invalid language code page detection.

Post by *rstaganrog »

<post modified>
7.50 countinued autodetection problem
Last edited by rstaganrog on 2009-06-17, 12:20 UTC, edited 1 time in total.
User avatar
Boofo
Power Member
Power Member
Posts: 1431
Joined: 2003-02-11, 00:29 UTC
Location: Des Moines, IA (USA)
Contact:

Post by *Boofo »

When I try to save it an ASCII text file, it doesn't save it right as it needs to be saved as Unicode. Otherwise I get ????? in place of the second line.
chmod a+x /bin/laden -- Allows anyone the permission to execute /bin/laden

How do I un-overwrite all my data?

User of Total Commander
#60471 Single user license
rstaganrog
Junior Member
Junior Member
Posts: 7
Joined: 2009-06-17, 08:05 UTC

Post by *rstaganrog »

Boofo wrote:When I try to save it an ASCII text file, it doesn't save it right as it needs to be saved as UTF. Otherwise I get ????? in place of the second line.
My example has a russian text, which you see as ?????.

I want to place link to my example file, but forum engine block it...:(
Last edited by rstaganrog on 2009-06-17, 12:39 UTC, edited 1 time in total.
User avatar
Boofo
Power Member
Power Member
Posts: 1431
Joined: 2003-02-11, 00:29 UTC
Location: Des Moines, IA (USA)
Contact:

Post by *Boofo »

It shows Russian text in your post fine. I just can't save it as an ASCII text file. Editplus tells me I will lose some formatting if I choose ASCII. It has to be saved as Unicode on my system to be able to see the Russian text.
chmod a+x /bin/laden -- Allows anyone the permission to execute /bin/laden

How do I un-overwrite all my data?

User of Total Commander
#60471 Single user license
rstaganrog
Junior Member
Junior Member
Posts: 7
Joined: 2009-06-17, 08:05 UTC

Post by *rstaganrog »

link to my file:
content5.files.mail.ru/X37BO6/445efc317508491fbbf192260948ad8a
Last edited by rstaganrog on 2009-06-17, 14:01 UTC, edited 1 time in total.
rstaganrog
Junior Member
Junior Member
Posts: 7
Joined: 2009-06-17, 08:05 UTC

Post by *rstaganrog »

Boofo wrote:
Can you download test file on my link?
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 48088
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

Sorry, I will not work on this problem for now because there are simply too many languages to consider.
Author of Total Commander
https://www.ghisler.com
Postkutscher
Power Member
Power Member
Posts: 556
Joined: 2006-04-01, 00:11 UTC

Post by *Postkutscher »

2rstaganrog
I can recommend you to use SynPlus plugin (or some of its analog), which haves it`s own detection system.
User avatar
MVV
Power Member
Power Member
Posts: 8702
Joined: 2008-08-03, 12:51 UTC
Location: Russian Federation

Post by *MVV »

rstaganrog wrote:Internal Lister's viewer (by F3) of Total Commander 7.04 (and early too) wrong autodetect some cyrilic-coded (Win866 or OEM DOS) texts.
That's an old problem... If you frequently work with files in DOS-866 codepage, you should use external viewer or editor instead of Lister (maybe written especially for 866 codepage).
Boofo wrote:It shows Russian text in your post fine. I just can't save it as an ASCII text file. Editplus tells me I will lose some formatting if I choose ASCII.
You can save texts with symbols not from your current codepage only as Unicode. For example, user with RU codepage can't save some German symbols as ASCII text - which is absent in RU ASCII table.


I think it will be great in such cases to have possibility to setup codepage delection rules for each codepage manually.
Post Reply