The Unarchiver 2.0 testing thread (92)

1 Name: !WAHa.06x36 : 2009-05-18 16:59 ID:4EM7yHCe [Del]

Well, after a far too long development cycle, The Unarchiver 2.0 is starting to come together. The reason for the massive delay is that huge parts of the internals have been rewritten to make it easier to program and extend. The old libxad is mostly gone except for old formats, and new Objective-C based code handles most normal formats.

Of course, that kind of huge rewrite will have introduced a lot of new bugs, and I really need some help testing it to shake those bugs out. So if you want to help out, you should grab it and try to use it on any files you can find, and report to me if it doesn't work as expected, preferably with the files that cause problems included.

The latest version can be found here:

http://code.google.com/p/theunarchiver/downloads/list

Obviously you should be aware that this may cause all kinds of problems, so be prepared to downgrade in that case.

Further information in later posts. Try to read the thread before reporting bugs!

43 Name: !WAHa.06x36 : 2009-07-09 19:10 ID:Heaven [Del]

>>38

All right, fixed it so that thing extracts. It takes forever, though, not sure if that's expected or not.

PS RAR is a horrible, horrible format.

44 Name: !WAHa.06x36 : 2009-07-09 20:09 ID:4EM7yHCe [Del]

Well, I think it's time to upgrade this to a beta release:

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0beta1.zip

  • Most of the outstanding UI bugfixes and small improvement requests on the issue tracker should be done.
  • There's been some general cleanup and re-arranging of the UI code, which may have introduced some new bugs.
  • No translations. The updated UI needs to be re-translated, which will happen when I am sure there will be no more changes to it.
  • Some fixes to the uncompression engine, like the RAR bug mentioned above.

What's needed now is for people to try out the UI and the new options, as well as the old ones, to see that everything works as it should, or to report any fixes I forgot about.

45 Name: gq : 2009-07-10 03:40 ID:vA02ASRp [Del]

>> 41

Thanks for the Tips, I have tried the Archiver 2.0 beta1 to extract my 12G tar file. After a long time preparing, it crashed.
I think the tar file is too large for my memory of my laptop.

If necessary, I can send you the error report. Thanks.

46 Name: Anonymous : 2009-07-10 05:47 ID:CsjwOkaa [Del]

Finally PS RAR files can be extracted! Thank U!!!!

Just one thing: could u add an option to never create a new folder for the extracted files?

Thanks again!!!

47 Name: !WAHa.06x36 : 2009-07-10 07:44 ID:4EM7yHCe [Del]

>>46

Probably not, it would require figuring out how to deal with colliding filenames which I rather wouldn't do.

48 Name: Anonymous : 2009-07-14 22:03 ID:v8VD/YFR [Del]

I am just wondering if xar support is simply implemented using libxar and whether bsd flags, resource forks and extended attributes can be preserved when extracted using The Unarchiver, since the main design goal of xar is to preserve all metadata.

49 Name: !WAHa.06x36 : 2009-07-15 06:47 ID:Heaven [Del]

>>48

It is implemented from scratch. Resource forks are handled, but no other extended attributes. Implementing this correctly is a bit of a pain since the xar format is essentially undocumented.

50 Name: !WAHa.06x36 : 2009-07-15 06:48 ID:Heaven [Del]

>>48

Also, if you want support for more xar features, supply some files that use them so I can try to figure out how they work.

51 Name: !WAHa.06x36 : 2009-07-16 18:04 ID:4EM7yHCe [Del]

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0beta2.zip

  • More bugfixes.
  • Slightly more clever handling of the dock icon (it appears only when starting the program directly).
  • Some other stuff I forgot about already.

The GUI is now feature-frozen for v2.0, so that I can start trying to collect translations. Only going to be fixing bugs and doing internal improvements until after 2.0.

52 Name: !WAHa.06x36 : 2009-07-19 12:39 ID:4EM7yHCe [Del]

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0beta3.zip

  • New ARJ parser that actually works.
  • Support for the Blend algorithm in sitx files.
  • Support for unpacking Nintendo DS .nds files.
  • Japanese, German and Portugese translations.
  • Bugfixes, of course.

53 Name: !WAHa.06x36 : 2009-07-19 13:14 ID:Heaven [Del]

Oh, and for the old Amiga fans, I made the .adf parser work again so you can extract the files on a fastfilesystem .adf file, and also made the libxad DMS code unpack .dms files to .adf (although it seems a bit buggy).

54 Name: Anonymous : 2009-07-26 23:35 ID:241KFNmD [Del]

>>50

I am wondering if it would be possible for libxad to link to libxar for handling xar, because libxar has been verified to handle EA, resource forks and more obscure metadata such as BSD flags correctly. I don't think there is any licensing issues with libxar. Reverse engineering is also much more likely to introduce bugs compared to the native implementation.

55 Post deleted by user.

56 Name: Anonymous : 2009-07-26 23:47 ID:241KFNmD [Del]

>>50
The author of this HFS metadata test suite (http://www.n8gray.org/blog/2007/04/27/introducing-backup-bouncer/) tested against xar svn (fix later released in xar 1.5.1) and found it to handle all known HFS metadata correctly. You can simply use this suite to generate sample archives and verify how much metadata is preserved. It would be interesting to see if the Unarchiver's zip, tar, cpio and pax implementations are capable of restoring whatever metadata that's actually preserved by the archiving program.

57 Name: !WAHa.06x36 : 2009-07-27 13:54 ID:4EM7yHCe [Del]

>>54

If I recall correctly, it libxar is not compatible with how the current XADMaster.framework works.

>>56

I don't have any files with any other metadata than resource forks, and I'm not even sure how to create any. I'd really prefer to have some real-world examples.

58 Name: Anonymous : 2009-07-30 12:50 ID:9858wSqG [Del]

TheUnarchiver2.0beta3

When used to extract a .7z made with 7za v9.04 on MacOS 10.4.11
Ownership & Permissions
No Access

When extracted with 7za v9.04 everything is ok

Is this a known issue?

59 Name: !WAHa.06x36 : 2009-07-30 14:07 ID:Heaven [Del]

>>58

No, probably not. I'll want an example file for that.

60 Name: !WAHa.06x36 : 2009-07-30 14:09 ID:4EM7yHCe [Del]

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0beta4.zip

  • Support for unpacking NSIS installers (extremely tricky to do across multiple versions, but it seems to handle every installer for NSIS itself back to version 1.1o)
  • Better support for LZH
  • Swedish and Russian translations
  • UI bugfixes and other bugfixes

61 Name: Anonymous : 2009-07-30 14:21 ID:241KFNmD [Del]

>>57

The backup-bouncer suite I mentioned earlier will generate a source disk image contains files with all types (and combinations) of HFS metadata (EA, resource forks, BSD flags, Finder comments etc.). You can use whatever archive utility you want to archive the generated files and then extract the archive using the unarchiver to a destination disk image, also generated by the test suite. You can then run the bbouncer program to verify the files.

For real world (and non-trivial) usage of extended attributes, you can download Skim.app, which uses EA to store its annotations. The chflags utility (included in OS X) can be used to change the BSD flags of a file.

62 Name: Anonymous : 2009-07-30 15:29 ID:9858wSqG [Del]

I will try to send three files:
1) the 7za compressed file
2) screenshot of the .7z file and the extracted folder icon with a "-"
3) screenshot of "Get Info..." of the extracted folder
4) the 7za compression log

63 Name: Anonymous : 2009-07-30 15:33 ID:9858wSqG (Image: 0x0 7z, 76 kb) [Del]

Safari failed to send a file
Now try Firefox

64 Name: Anonymous : 2009-07-30 15:34 ID:9858wSqG (Image: 139x133 png, 9 kb) [Del]

src/1248993242613.png: 139x133, 9 kb

2) screenshot of the .7z file and the extracted folder icon with a "-"

65 Name: Anonymous : 2009-07-30 15:34 ID:9858wSqG (Image: 261x387 png, 36 kb) [Del]

src/1248993281826.png: 261x387, 36 kb

3) screenshot of "Get Info..." of the extracted folder

66 Name: Anonymous : 2009-07-30 15:35 ID:9858wSqG [Del]

7-Zip (A) 9.04 beta Copyright (c) 1999-2009 Igor Pavlov 2009-05-30
p7zip Version 9.04 (locale=utf8,Utf16=on,HugeFiles=on,1 CPU)
Scanning

Creating archive /Users/Bee/Documents/vim-20090730.152209.7z

Compressing vim/example-rc/gvimrc
Compressing vim/README
Compressing vim/_vim/doc/tags
Compressing vim/_gvimrc
Compressing vim/_notes
Compressing vim/_profile
Compressing vim/_vimrc
Compressing vim/cp-bee.sh
Compressing vim/rc-restore.sh
Compressing vim/test.sh
Compressing vim/_rc-cp.sh
Compressing vim/vim-notes/20080401 dot-vimrc.txt
Compressing vim/_vim/doc/DrawIt.txt
Compressing vim/Emacs key bindings.txt
Compressing vim/_vim/doc/manpageview.txt
Compressing vim/vim-notes/opt.txt
Compressing vim/sed1liners.txt
Compressing vim/vim-notes/vim-notes.txt
Compressing vim/vim-notes/vimcmd.txt
Compressing vim/_vimrc-removed.txt
Compressing vim/_vim/spell/en.utf-8.add
Compressing vim/_vim/autoload/.DS_Store
Compressing vim/_vim/plugin/.DS_Store
Compressing vim/_vim/after/.DS_Store
Compressing vim/_vim/.DS_Store
Compressing vim/_vim/spell/.DS_Store
Compressing vim/_vim/plugin~/.DS_Store
Compressing vim/vim-notes/.DS_Store
Compressing vim/.DS_Store
Compressing vim/_vim/.netrwhist
Compressing vim/_vim/spell/en.utf-8.add.spl
Compressing vim/_vim/autoload~/DrawIt.vim
Compressing vim/_vim/plugin~/DrawItPlugin.vim
Compressing vim/_vim/filetype.vim
Compressing vim/_vim/after/syntax/forth.vim
Compressing vim/_vim/syntax/info.vim
Compressing vim/_vim/syntax/man.vim
Compressing vim/_vim/syntax/mankey.vim
Compressing vim/_vim/autoload/manpageview.vim
Compressing vim/_vim/plugin/manpageviewPlugin.vim
Compressing vim/_vim/syntax/manphp.vim
Compressing vim/_vim/plugin/plutil.vim
Compressing vim/_vim/plugin/textutil.vim
Compressing vim/_vim/.VimballRecord

Everything is Ok

67 Name: Anonymous : 2009-07-30 15:39 ID:9858wSqG [Del]

ok, Firefox would send files.
Can you fix it so Safari 4.0.2 will send a file?
Safari can send the textbox.

68 Name: broomdodger : 2009-07-30 15:54 ID:9858wSqG [Del]

TheUnarchiver2.0beta4

Same result with beta4:
Ownership & Permissions
No Access

69 Name: broomdodger : 2009-07-30 16:33 ID:9858wSqG [Del]

this is what permissions look like in terminal:
d----w---- 18 Bee Bee - 612 Jul 29 22:13 vim/

70 Name: !WAHa.06x36 : 2009-07-30 17:24 ID:4EM7yHCe [Del]

>>63-69

Found the bug, thanks. It was just a typo in the 7zip permissions code. Should work in the next version.

71 Name: broomdodger : 2009-07-30 18:17 ID:9858wSqG [Del]

Thank you! for TheUnarchiver.

I see in your post >>63-69, I searched this site and did not find how to do that. How do you do that and is it useful?

72 Name: broomdodger : 2009-07-30 18:19 ID:9858wSqG [Del]

I answered my own question!

Just by typing those in it becomes an active link!

73 Name: katjum : 2009-08-06 20:05 ID:dwFplCzW [Del]

There's also a problem with un-7z-ing folders.

Process starts, but no folder is created.

74 Name: !WAHa.06x36 : 2009-08-07 20:13 ID:4EM7yHCe [Del]

>>73

You're going to have to be more specific, and also supply some example files.

75 Name: katjum : 2009-08-08 08:46 ID:dwFplCzW [Del]

The problem occurs with 7-zip files made with 7zX 1.7.1 (Compression Level Ultra, no password, no other settings) for MacOSX.

If files are compressed in a folder (folder is compressed), the Unarchiver (2.0 beta 4) cannot uncompress the folder, but 7zX can.

With the Unarchiver, the process starts, but no folder is created.

Free files uncompress properly but have the above mentioned permissions error (User has no read or write privileges).

I'm not sure if this is a problem with 7zX or the Unarchiver.

Test file: http://www.mediafire.com/?ydjgz2k2zgn

76 Name: !WAHa.06x36 : 2009-08-08 14:21 ID:Heaven [Del]

>>75

This is just the same problem with permissions, which is fixed in the development version.

77 Name: art : 2009-08-09 12:00 ID:K03mRnKe [Del]

Would be nice if 2.0 also could support the XZ-format (.xz, .tar.xz, .txz), successor of the LZMA-utils <http://tukaani.org/xz/>. While still marked as beta it's already supportet by gnu tar 1.22 and AFAIK XZ-utils are backwards compatible with LZMA-utils and could replace the lzma part.

78 Name: !WAHa.06x36 : 2009-08-09 12:20 ID:4EM7yHCe [Del]

>>77

It'll probably be supported, but more likely in 2.1 than 2.0. The XZ format is apparently kind of an overengineered mess and would take some work to support.

(Also, what happened to the other formats that adopted the format while it was still called LZMA-utils, like RPM 5 and XAR? Is the finished XZ format still compatible with those files? Or is there some intermediate version that I'd need to support too?)

79 Name: art : 2009-08-09 13:57 ID:/ufx+lqr [Del]

>>78

xar 1.6 supports lzma as well as xz. Didn't ever use RPM5. As I read the docs, the xz-format itself is officially stable. Don't know how to implement support for new formats in TUnA, just thougt it could be as easy as replacing liblzma from LZMA-utils with the version from XZ-utils and add the xz extensions to info.plist...
If it's a heavier task to implement, don't hurry. Can easily be solved using Terminal.

80 Name: !WAHa.06x36 : 2009-08-09 17:21 ID:Heaven [Del]

>>79

I use as few external libraries as possible, most things are implemented from scratch. Most libraries don't fit the programming model the XADMaster framework uses anyway.

Anyway, the problem is that there are two formats called ".lzma" - the one implemented by the old LZMA-utils, and the new one implemented only by beta LZMA-utils, which was then turned into XZ. However, several formats seem to have adopted the beta LZMA-utils format, and now I don't know if that is the same as what XZ ended up being or not.

To make it more confusing, it seems XAR supported BOTH the old and new LZMA formats under the same name, so does it now have a THIRD lzma format with a new name?

81 Name: Anonymous : 2009-08-10 01:23 ID:GJQpsey8 [Del]

>>80

From xar --help output:

--compression    Specifies the compression type to use.
Valid values: none, gzip, bzip2, lzma, xz
Default: gzip

Don't know internals about the differences in formats/encoders but you could ask directly in the lzma/xz-utils forum:
http://sourceforge.net/forum/forum.php?forum_id=708858

I can only say, I use the xz-utils here and never had an issue with unpacking any lzma-file.

82 Name: !WAHa.06x36 : 2009-08-15 04:40 ID:4EM7yHCe [Del]

All right, this seems to be good enough for a real release now, so it's time for a release candidate. If nobody reports any more bugs for this version, or submits any more translations, it will be relabeled and officially released as 2.0 in a couple of days.

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0RC.zip

  • Fixes the 7-zip bug mentioned above.
  • Adds a French translation.

83 Name: Anonymous : 2009-08-15 21:36 ID:Sm8g2dVg [Del]

TheUnarchiver rocks, great work! Can you add (or is it already there) a way to choose the destination for one archive? Like by default extract to the same folder but if it is open with option held down then ask for the destination?

Can one day TheUnarchiver became The(Un)Archiver, by adding the possibility to compress files, maybe just really supporting a open format like 7z or xar?

84 Post deleted by user.

85 Name: broomdodger : 2009-08-15 22:38 ID:9858wSqG [Del]

>>82

>>72 is fixed.

I downloaded the compiled binary for 7za and also downloaded the source.
The source folder has some tests, some of which The Unarchiver 2.0 RC fails.
7za will extract all, including the password protected files.
password="qwerty"
Are these known issues?

p7zip 9.04.dmg
kMDItemWhereFroms = (

"http://web.me.com/krmathis/applications/p7zip%209.04.dmg",
"http://web.me.com/krmathis/"

p7zip_9.04_src_all.tar.bz2
kMDItemWhereFroms = (

"http://softlayer.dl.sourceforge.net/project/p7zip/p7zip/9.04/p7zip_9.04_src_all.tar.bz2",
"http://sourceforge.net/projects/p7zip/files/p7zip/9.04/p7zip_9.04_src_all.tar.bz2/download"

Tests done with The Unarchiver 2.0 RC:

The Unarchiver 2.0 RC does NOT expand:
7za.exe.lzma86
7za.exe.xz
7za433_7zip_lzma_crypto.7z
7za433_7zip_lzma2_bcj2.7z
7za433_7zip_lzma2_crypto.7z
7za433_7zip_lzma2.7z

The Unarchiver 2.0 RC expands ok:
7za.exe.lzma
7za.exe.lzma_eos
7za433_7zip_bzip2.7z
7za433_7zip_lzma_bcj2.7z
7za433_7zip_lzma.7z
7za433_7zip_ppmd_bcj2.7z
7za433_7zip_ppmd.7z
7za433_tar.tar

86 Name: broomdodger : 2009-08-15 22:41 ID:9858wSqG [Del]

>>85

I meant >>58 fixed.

87 Name: broomdodger : 2009-08-15 22:57 ID:9858wSqG [Del]

I could find only two .sitx files on my Mac and both extracted with The Unarchiver 2.0 RC. I re-compressed them as .zip Now no more .sitx files!

88 Name: Anonymous : 2009-08-16 07:05 ID:Heaven [Del]

> Can one day TheUnarchiver became The(Un)Archiver

I hope not.

89 Name: !WAHa.06x36 : 2009-08-16 10:43 ID:4EM7yHCe [Del]

>>83

Unarchiving and archiving are two mostly unrelated tasks, and I don't think it's a good idea to combine both in one app.

I do have some ideas for an archiver, but it would involve some pretty crazy ideas which would take a lot of work to turn into reality, so it may never happen.

(Also, neither 7-zip nor XAR are particularly open formats. Neither is has a proper spec published, and are only defined through source code - mostly uncommented and hard to read in the case of 7-zip. Zip is far more open than either of those.)

90 Name: !WAHa.06x36 : 2009-08-16 10:43 ID:4EM7yHCe [Del]

>>85

7-zip encryption is not implemented.

91 Name: !WAHa.06x36 : 2009-08-19 18:31 ID:4EM7yHCe [Del]

Well, the first attempt at a release candidate failed. Let's try again!

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0RC2.zip

  • Fixes a bug with ditto archives (.zip and .tar.* created for OS X). If you have some zips or tars with lots of resource forks and other Mac specific stuff, please try running this on them and see if there are any problems.
  • Fixes a sitx bug. There are however some more missing features that need to be implemented in sitx, but those will have to wait until after 2.0, because they will take a bit of work.
  • Added a Spanish translation.

92 Name: !WAHa.06x36 : 2009-08-22 06:59 ID:4EM7yHCe [Del]

All right, 2.0 is now released.

http://theunarchiver.googlecode.com/files/TheUnarchiver2.0.zip

  • Better parsing of strange RAR files with garbage at the end.

This thread is now over, and any further discussion can return to the main thread at http://wakaba.c3.cx/sup/kareha.pl/1151796773/.

This thread has been closed. You cannot post in this thread any longer.