winrar 5 is out

Discuss and announce Total Commander plugins, addons and other useful tools here, both their usage and their development.

Moderators: Hacker, petermad, Stefan2, white

horus
Junior Member
Junior Member
Posts: 13
Joined: 2010-07-02, 11:25 UTC

winrar 5 is out

Post by *horus »

Version 5.00 beta 1

1. New RAR 5.0 archiving format. You can use "RAR 5.0" option
in archiving dialog or -ma command line switch to create
RAR 5.0 archives.

Older software including older WinRAR versions is not able to
decompress RAR 5.0 archives, so if you plan to send an archive
to other people, it is necessary to take the compatibility issue
into consideration. You can select "RAR" instead of "RAR5" option
in archiving dialog to create RAR 4.x archives compatible with
previous WinRAR versions.

2. Changes in RAR 5.0 compression algorithm:

a) maximum compression dictionary size is increased up to 1 GB
in 64 bit WinRAR. 32 bit WinRAR version can use up to 256 MB
dictionary when creating an archive. Both 32 bit and 64 bit
versions can unpack archives with any dictionary size,
including 1 GB;

b) default dictionary size for RAR 5.0 is 32 MB, typically resulting
in higher compression ratio and lower speed than RAR 4.x 4 MB.
You can use "Dictionary size" archiving dialog option or -md
switch to change this value;

c) -md switch syntax is modified to support larger dictionary
sizes. Append 'k', 'm' and 'g' modifiers to specify the size
in kilo-, mega- and gigabytes, like -md64m for 64 MB dictionary.
If modifiers are not present, megabytes are assumed,
so -md64m is equal to -md64;

d) RAR 5.0 format includes Intel IA-32 executable and delta
compression algorithms, but RAR 4.x text, audio, true color
and Itanium algorithms are not supported. These excluded algorithms
are not efficient for modern data types and hardware configurations;

e) RAR 5.0 decompression can utilize several CPU cores.
Though not to same extent as in compression algorithm,
it improves the decompression speed on large files
with poorly compressible data or when using BLAKE2 checksums.

3. Changes in RAR 5.0 archive format:

a) file times are stored as Coordinated Universal Time (UTC)
instead of former local time, making file exchange among
several time zones more straightforward;

b) file names and archive comments use UTF-8 encoding.

4. RAR 5.0 recovery record is based on Reed-Solomon error correction
codes. If recovery record size is large enough, 5% and more,
the new error correction scheme provides much higher resistance to
multiple damages comparing to RAR 4.x recovery record.
Smaller record, such as 1 - 2%, or less random damage type would
result in less difference between 4.x and 5.0. For single continuous
damage 4.x and 5.0 efficiency is about the same.

Additionally to usual data erasures, the new recovery record
is able to detect deletions and insertions of much larger size
than in previous RAR versions. Maximum insertion size is several
megabytes. Maximum deletion size depends on the damage type
and in some cases can be as large as the recovery record size.

Still, the best recovery performance and efficiency is achieved
if no deletions and insertions are present, so all data including
damaged sectors preserve their original positions. Thus, if you use
some special software to copy an archive from damaged media,
it is better to choose the mode, when damaged sectors are filled by
zeroes or any other data instead of cutting them out completely
from resulting file.

RAR 5.0 recovery record is more resistant to damage of recovery record
itself and can utilize a partially corrupt recovery record data.
Note, though, that "Repair" command does not fix broken blocks
in recovery record. Only file data are corrected. After successful
archive repair, you may need to create a new recovery record
for saved files.

New recovery record is not based on 512 byte sectors anymore
and incorporates more complicated data structures. So it is impossible
to specify its size in sectors. For RAR 5.0 archives the parameter of
-rr[N] switch and rr[N] command is always treated as a percent of
archive size regardless of presence of % character. Typically N%
recovery record can repair up to N% of continuously damaged data
and increases the archive size by only slightly more than N%.
Ability to fix multiple damages is proportional to N.

We used "Screaming Fast Galois Field Arithmetic Using Intel
SIMD Instructions" paper by James S. Plank, Kevin M. Greenan
and Ethan L. Miller to improve Reed-Solomon coding performance.
Also we are grateful to Artem Drobanov and Bulat Ziganshin
for samples and ideas allowed to make Reed-Solomon coding
more efficient.

5. "Test" command verifies validity of RAR 5.0 recovery record.
Recovery record is tested after processing all archived files.

If corrupt archive contains the recovery record, it might be possible
to repair it even if recovery record validity test is failed.
"Repair" command attempts to utilize even a partially damaged
recovery record. So treat the negative recovery record test result
as a reason to re-create the archive if original files are still
available, but not as a reason to avoid "Repair" command.

6. Changes in RAR 5.0 encryption algorithm:

a) encryption algorithm is changed from AES-128 to AES-256 in CBC mode.
Key derivation function is based on PBKDF2 using HMAC-SHA256;

b) special password verification value allows to detect most of
wrong passwords without necessity to unpack the entire file;

c) if archive headers are not encrypted ("Encrypt file names" option
is off), file checksums for encrypted RAR 5.0 files are modified
using a special password dependent algorithm, to make impossible
guessing file contents based on checksums. Do not expect such
encrypted file checksums to match usual CRC32 and BLAKE2 values.

7. RAR 5.0 archives allow to utilize 256 bit length BLAKE2sp hash
( https://blake2.net ) instead of 32 bit CRC32 as a file checksum.
Enable "Use BLAKE2 file checksum" option in "Options" page of
archiving dialog or specify -htb command line switch to use BLAKE2
checksums.

While producing slightly larger archives, BLAKE2 can be used
for file contents identification. If two files have the same
BLAKE2 value, it practically guarantees that file contents
is the same. BLAKE2 error detection property is also stronger
than in much shorter CRC32.

8. Features removed:

a) authenticity verification feature did not provide the required
level of reliability and was removed;

b) switch -en (do not add "end of archive" block) is not supported
by RAR 5.0 archives, which always have the end of archive block.
This block helps WinRAR to safely skip external data like
digital signatures appended to archive;

c) old style extension based arcname.rNN volume names are not
supported by RAR 5.0 archives, which use only arcname.partN.rar
volume names;

d) file comments are not supported anymore both in RAR 4.x
and RAR 5.0 archives. Console RAR 'cf' command is removed.
It does not affect the archive comment support, which is present
in both versions of archive format and is not planned for removal.

9. "Set password" command and "Dictionary size" option are moved to
"General" page of archiving dialog.

10. You can use "Save symbolic links as links" option on "Advanced" page
of archiving dialog to save and restore NTFS symbolic links
and reparse points as links, so their contents is not archived.
Command line equivalent of this option is -ol switch.

Similar option for NTFS hard links is "Save hard links as links".
Its command line equivalent is -oh switch.

Both options are available only for RAR 5.0 archive format.

11. Added extraction only support for XZ archive format.

12. Changes in recovery volume processing in RAR 5.0 archive format:

a) maximum number of RAR+REV volumes in RAR 5.0 format is 65535
instead of 255;

b) recovery volume operations are faster than in RAR 4.x;

c) additionally to recovery data, RAR 5.0 REV files also store
service information such as checksums of protected RAR files.
So they are slightly larger than RAR volumes which they protect.
If you plan to copy individual RAR and REV files to some removable
media, you need to take it into account and specify RAR volume
size by a few kilobytes smaller than media size.

13. Maximum path length for files in RAR and ZIP archives is increased
up to 2048 characters.

14. Command line RAR returns the exit code 11 if it can detect that
user entered a wrong password. This code can be returned only
for RAR 5.0 archives. It is impossible to distinguish a wrong
password and data damage for RAR 4.x archives.

15. 'v' and 'l' commands display archived file names in the end of line,
not in that beginning as before. Also some fields previously
available in 'l' and 'v' output are now shown only by 'lt' and 'vt'.

'vt' and 'lt' commands provide the detailed multiline information
for every archived file.

'vta' and 'lta' also include service headers into list.

16. Now the default charset for filelists in commands like
'rar a arcname @filelist' is ANSI for both WinRAR and console RAR.
In previous versions it was ANSI for WinRAR and OEM for console RAR.
You can use -scl switch to override this default.

17. Internal WinRAR viewer can detect and display files in UTF-8
and UTF-16 little endian encodings.

18. UTF-16 little endian encoding is used in RAR and WinRAR log file
rar.log, so Unicode file names are stored in the log correctly.
WinRAR automatically truncates the old rar.log file in non-Unicode
format to avoid mixing different encoding in the same log file.
In case of console RAR you need to delete the old rar.log manually,
otherwide RAR will append UTF-16 messages to existing rar.log.

19. Command line 'r' (repair) command can include an optional destpath\
parameter defining the destination folder for repaired archive:

rar r archive.rar destpath\


:shock:
User avatar
ZeLen1y
Junior Member
Junior Member
Posts: 35
Joined: 2009-06-27, 09:05 UTC

Post by *ZeLen1y »

Replacing unrar.dll with new http://www.rarlab.com/rar/UnRARDLL.exe doesn't gives support new RAR 5.0 format in TC
Hurdet
Power Member
Power Member
Posts: 704
Joined: 2003-05-10, 18:02 UTC

Post by *Hurdet »

ZeLen1y wrote:Replacing unrar.dll with new http://www.rarlab.com/rar/UnRARDLL.exe doesn't gives support new RAR 5.0 format in TC

I get this error with new dll in a crypted file, no problem with 7zip:
---------------------------
Total Commander 8.01
---------------------------
Fatal error in unzip thread, aborting!
Access violation at address 02561D44. Read of address 00000000

Please report this error to the Author, with a description
of what you were doing when this error occurred!

Windows exception: C0000005
Stack trace:
02561D44
4978FF 5A9B26 5A535E >417CB8 40362C
Raw:
4978FF 5A9B26 6D5128 6747D5 487B42 69A540
669321 5A535E 417CB8 40362C
---------------------------
With other rar file i get the unpack window not disappear.
herman5
Junior Member
Junior Member
Posts: 43
Joined: 2012-08-20, 16:39 UTC

Post by *herman5 »

Thats because its BETA - if you update to new bugged dll its your own fault when you get crashes...
tosbsas
Senior Member
Senior Member
Posts: 428
Joined: 2003-12-19, 13:12 UTC
Location: Lima, Perú
Contact:

Post by *tosbsas »

herman5 wrote:Thats because its BETA - if you update to new bugged dll its your own fault when you get crashes...
what a st***d comment on such a great forum - he is saying the dll crashes when using it with tc, it works awesome in winrar beta
A New Generation transformed by the Power of God
User avatar
LonerD
Senior Member
Senior Member
Posts: 381
Joined: 2010-06-19, 20:18 UTC
Location: Makeyevka/Makiivka
Contact:

Post by *LonerD »

New RAR5 format is unsupported in Total, only Ghisler can add it in TC code.

About crashes new unrar.dll on old rar-files, Roshal say:
"Should be work. Then one has to see what's up with TC."
"I used to feel guilty in Cambridge that I spent all day playing games, while I was supposed to be doing mathematics. Then, when I discovered surreal numbers, I realized that playing games IS math." John Horton Conway
iana
Senior Member
Senior Member
Posts: 345
Joined: 2010-07-27, 22:00 UTC

Post by *iana »

Is this the death of the RAR format?
The new RAR5 is a completely new format and incompatible with the old RAR 2.9,
Does the new dll support the now old RAR 2.9 or the even older RAR 1.0 (those files are still around)?
The new rar looks a lot like 7z (they removed all the filters including the text ones and increased the dictionary size)
This might be a bad move on their side it will cause a lot of confusion (Think WinZip and their new algorithms).
I think most users should switch to 7zip.
User avatar
Hacker
Moderator
Moderator
Posts: 13142
Joined: 2003-02-06, 14:56 UTC
Location: Bratislava, Slovakia

Post by *Hacker »

iana wrote:Is this the death of the RAR format?
No.
iana wrote:Does the new dll support the now old RAR 2.9 or the even older RAR 1.0 (those files are still around)?
One would strongly assume it does.
iana wrote:This might be a bad move on their side it will cause a lot of confusion (Think WinZip and their new algorithms).
No.
iana wrote:I think most users should switch to 7zip.
No.

;)
Roman
Mal angenommen, du drückst Strg+F, wählst die FTP-Verbindung (mit gespeichertem Passwort), klickst aber nicht auf Verbinden, sondern fällst tot um.
Hurdet
Power Member
Power Member
Posts: 704
Joined: 2003-05-10, 18:02 UTC

Post by *Hurdet »

updated UnRARDLL seems to fix problems but not support beta 4.
iana
Senior Member
Senior Member
Posts: 345
Joined: 2010-07-27, 22:00 UTC

Post by *iana »

@Hacker
Do you remember WinAce does anyone still use it?
don't get me wrong I like WinRAR and the rar format, but that's the problem with propitiatory formats, WinRAR is to 7-Zip what MS doc is to odt, it has a bigger user base better support but it's closed and developed by only 1 person.
The new winrar doesn't work on 2k systems but there are tons of them around, as far as I can tell the new WinRAR is much slower then the old 4.x WinRAR when compressing zip's and old (current) rar 2.9 (or 3.0) archives.
I think the Rochal's should release the RAR format (not the application) with a dual license GPL(2.0)/propitiatory, the GPL would be used in free/open source projects and the only commercial use would remain with their own application, that would secure users that in the future they will be able to open their files.
ps. I couldn't get the beta2 to open rar 5.0 files from within TC (I disabled use internal unrar and selected the winrar.exe from tc's dialog) it only opens rar 3.0 (or is 2.9?) archives.
User avatar
fenix_productions
Power Member
Power Member
Posts: 1979
Joined: 2005-08-07, 13:23 UTC
Location: Poland
Contact:

Post by *fenix_productions »

OFFTOPIC
Eh, it always annoys me hearing that someone should make his work free "just because".
iana wrote:that would secure users that in the future they will be able to open their files.
AFAIR unpacking was always free and I think there are even source codes provided for doing it. What closed is full specification and packing.

There is no need to GPL whole RAR. I also think it would mean the end of WinRAR as we know it and - probably - end of rarlabs.

I may be wrong here but this is small company (one person?) project. Make it fully free and you basically create a hobby - not full fledged job. Same would be for TC: open source == count Christian out. It has been his bread for at least 20 years, so I don't think he would have another job and time to maintain TC code base as much as it is currently.

Open source is not solution for everything. Well… not without big sponsoring.

/OFFTOPIC
"When we created the poke, we thought it would be cool to have a feature without any specific purpose." Facebook...

#128099
iana
Senior Member
Senior Member
Posts: 345
Joined: 2010-07-27, 22:00 UTC

Post by *iana »

I hope you didn't get me wrong I'm not saying make the application free but the file format.
For example the zip format is open/free (think InfoZip even Cristian uses part of InfoZip's source, if it wasn't free TC would not have internal zip, WinRAR uses the free InfoZip code?) and WinZiP/PKWare/(and a few others) are still making money, making a file format open and standard can be a good thing.
There are some problems with the unrar license and it's inclusion with some gpl projects, that's why most linuxes don't carry the unrar binary, I wish all the best to Eugene and his brother Alexandr with WinRAR and RAR in general, it's just the new format is going to cause a lot of headaches.

I hope I didn't offend anyone it was just my thoughts, what the Roshal's do with their creation is their business.
btw the new beta2 damaged a few test archives I'd wait for the stable.
Moon
Member
Member
Posts: 195
Joined: 2003-09-12, 07:41 UTC

Post by *Moon »

iana wrote:Is this the death of the RAR format?
No, but 7zip is.
User avatar
Hacker
Moderator
Moderator
Posts: 13142
Joined: 2003-02-06, 14:56 UTC
Location: Bratislava, Slovakia

Post by *Hacker »

iana,
Do you remember WinAce does anyone still use it?
Well, WinAce has never been popular.

Roman
Mal angenommen, du drückst Strg+F, wählst die FTP-Verbindung (mit gespeichertem Passwort), klickst aber nicht auf Verbinden, sondern fällst tot um.
Eugene_Roshal
Junior Member
Junior Member
Posts: 14
Joined: 2013-05-02, 09:58 UTC
Contact:

Post by *Eugene_Roshal »

iana wrote: btw the new beta2 damaged a few test archives I'd wait for the stable.
Can you please provide me more information about these archives: which options did you use, how concretely they are broken (checksum error or something else). If you can send me original files used to create these archives, it can help me to reproduce and fix this bug.
Post Reply