This forum uses cookies. Click X button to hide this message. What is stored? / Privacy
Total Commander Forum Index Total Commander
Forum - Public Discussion and Support
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Problems showing UTF-8 in Lister

 
Post new topic   Reply to topic    Total Commander Forum Index -> Bug reports from previous betas (unresolved) Printable version
View previous topic :: View next topic  
Author Message
bb
Junior Member
Junior Member


Joined: 09 Jan 2004
Posts: 18
Location: Leipzig / Germany

PostPosted: Sun Dec 02, 2007 10:25 am    Post subject: Problems showing UTF-8 in Lister Reply with quote

I found some problems viewing UTF-8 text files in the Lister.

One thing I could isolate to a small example is the following:
Two Files, both with BOM, both with (the same) Cyrillic letters, one with a back-stepping accent, one without. One is shown as Cyrillic, the other one as black boxes.

These is the content in hex with accent (correct letters but accent without backspace, it should be over the а, shown correctly e.g. in notepad):
EF BB BF D0 90 D0 BB D0 B5 D0 BA D1 81 D0 B0 CC 81 D0 BD D0 B4 D1 80

The content should read "Алекс́андр"

And this without (shown as boxes in Lister, shown correctly e.g. in notepad:
EF BB BF D0 90 D0 BB D0 B5 D0 BA D1 81 D0 B0 D0 BD D0 B4 D1 80

The content should read "Александр"

To be sure to have the same files, this is the hex sequence:
EF BB BF D0 90 D0 BB D0 B5 D0 BA D1 81 D0 B0 D0 BD D0 B4 D1 80

EF BB BF D0 90 D0 BB D0 B5 D0 BA D1 81 D0 B0 CC 81 D0 BD D0 B4 D1 80

Interestingly, when pasting from notepad to Firefox, the accent moved from а to н, so obviously, notepad want's the modifier accent to be postfixed, while firefox interprets it as prefix. I think if the hex CC 81 is behind a letter the accent should be over this one.

I was testing this using TC 7.02a on German WinXP.
_________________
mfg, bb
Back to top
View user's profile Send private message Visit poster's website
bb
Junior Member
Junior Member


Joined: 09 Jan 2004
Posts: 18
Location: Leipzig / Germany

PostPosted: Sun Dec 02, 2007 10:44 am    Post subject: Reply with quote

An addition:
Saved as Unicode (both Big Endian and Little Endian) both files show up correctly. (With the restriction of the Accent being behind and not over the а).
_________________
mfg, bb
Back to top
View user's profile Send private message Visit poster's website
ghisler(Author)
Site Admin
Site Admin


Joined: 04 Feb 2003
Posts: 35944
Location: Switzerland

PostPosted: Mon Dec 03, 2007 2:00 pm    Post subject: Reply with quote

2bb
Could you please send me a zip or rar archive containing a text file with these names? TC converts all UTF-8 text to UTF-16 before displaying it, so maybe there is a problem with the conversion function...
_________________
Author of Total Commander
http://www.ghisler.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
bb
Junior Member
Junior Member


Joined: 09 Jan 2004
Posts: 18
Location: Leipzig / Germany

PostPosted: Thu Dec 13, 2007 5:56 am    Post subject: Reply with quote

I sent a mail with a .rar file attached on 2007-12-03, 21:48 with subject "UTF8 to Unicode conversion in Lister" to support at ghisler dot com.

Did you receive it?
If yes, any news?
_________________
mfg, bb
Back to top
View user's profile Send private message Visit poster's website
ghisler(Author)
Site Admin
Site Admin


Joined: 04 Feb 2003
Posts: 35944
Location: Switzerland

PostPosted: Thu Dec 13, 2007 11:40 am    Post subject: Reply with quote

Unfortunately I haven't received anything so far. Can you please try to re-send it? Please make sure to limit the size to 500kBytes max.
_________________
Author of Total Commander
http://www.ghisler.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
bb
Junior Member
Junior Member


Joined: 09 Jan 2004
Posts: 18
Location: Leipzig / Germany

PostPosted: Thu Dec 13, 2007 11:55 am    Post subject: Reply with quote

Ok, I just resent it. Size is about 2KB.
_________________
mfg, bb
Back to top
View user's profile Send private message Visit poster's website
ghisler(Author)
Site Admin
Site Admin


Joined: 04 Feb 2003
Posts: 35944
Location: Switzerland

PostPosted: Thu Dec 13, 2007 1:24 pm    Post subject: Reply with quote

Thanks, got it now! Your e-mail was shown as "filtered" in mailwasher, but I saw it and could avoid its deletion. Smile
_________________
Author of Total Commander
http://www.ghisler.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    Total Commander Forum Index -> Bug reports from previous betas (unresolved) All times are GMT - 6 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Imprint/Impressum: This site is maintained by Ghisler Software GmbH
Privacy Policy | Datenschutzerklärung | Politique de Confidentialité

Using phpBB © phpBB Group