From: Wolfgang M. <wol...@ex...> - 2011-10-06 06:41:21
|
In 1.4.1 and trunk I extended all backup facilities to write the backup to a file system directory by default and not a zip. This was he safest solution. We also plan to add zip64 or tar support, but the used libraries need to be tested before we rely on them. Wolfgang Am 05.10.2011 23:41 schrieb "Anthony Mohrenweiser" < hi...@sp...>: > I am resurrecting this old thread because I need to know if issues raised > originally have been dealt with. If you re-read the original post, one of > the problems was that back-ups created for "large" databases. Dannes > identified the issue in about the 4th or 5th reply as Java using the ZIP > format vice the ZIP64. Then there was some talk about replacing the zip > library to enable ZIP64 support after some testing. But since then I > haven't seen any further discussion on the zip library. > > I've been waiting to update the exist instances that I manage until this > issue is resolved, I apologize if this is the incorrect way to determine > this, but does any one know if the latest release supports the ZIP64 format > when making backups? And if I should be finding out differently, can > someone steer me in the right direction? > > Thanks, > > Anthony > > > > > On Sat, Sep 3, 2011 at 10:36 AM, Loren Cahlander > <lor...@gm...>wrote: > >> I am looking into it. >> >> I found the following: >> >> http://www.thoughtspark.org/node/53 >> http://commons.apache.org/compress/ >> >> Loren >> >> On Aug 12, 2011, at 8:24 AM, Adam Retter wrote: >> >> >> Can we have the backup create a .tar.gz file? >> > >> > We could offer .tar.gz, I would personally rather go for .tar.bz2 >> > >> > Are you volunteering? >> > >> > I also considered, an option for having the bakcup encrypted with the >> > admin users password so that your backups are safe. >> > >> >> On Jul 21, 2011, at 9:07 AM, Adam Retter wrote: >> >> >> >>> The workaround at the moment, is obviously not to use the .zip backup >> >>> if your database is over 4GB. Just use the full exploded folder >> >>> backup. >> >>> >> >>> Personally I have never used the Zip backup anyway, typically I run >> >>> tar and bzip2 against the folder backup as this gives me better >> >>> compression. bzip2 does not have the 4GB limit and if you think its >> >>> slow, then try pbzip2 which should be faster if you have >> >>> multi-threaded/core processors. >> >>> >> >>> >> >>> On 21 July 2011 14:06, Dannes Wessels <da...@ex...> wrote: >> >>>> On Thu, Jul 21, 2011 at 12:57 PM, Wolfgang Meier < >> wol...@ex...> wrote: >> >>>>> I couldn't get a definite answer yet, but it seems the 1.6.0 JVM does >> >>>>> still have a 4GB limit for zip files. >> >>>> >> >>>> from wikipedia: >> >>>> >> >>>> ZIP64 >> >>>> The original ZIP format had a 4 GiB limit on various things >> >>>> (uncompressed size of a file, compressed size of a file and total size >> >>>> of the archive), as well as a limit of 65535 entries in a ZIP archive. >> >>>> In version 4.5 of the specification (which is not the same as v4.5 of >> >>>> any particular tool), PKWARE introduced the "ZIP64" format extensions >> >>>> to get around these limitations increasing the limitation to 16 EiB >> >>>> (264 bytes). ZIP64 support is emerging. For example, the File Explorer >> >>>> in Windows XP does not support ZIP64, but the Explorer in Windows >> >>>> Vista does. Likewise, some libraries, such as DotNetZip and >> >>>> IO::Compress::Zip in Perl, support ZIP64. Java's built-in >> >>>> java.util.zip does not support it as of September 2010, but it has >> >>>> been added to OpenJDK and is planned for inclusion in Java 7.[9] >> >>>> >> >>>> this problem is more basic... the ZIP specification does not support >> >>>> it :-/ openJDK will support it, http://truezip.java.net/ might be an >> >>>> option. >> >>>> >> >>>> the short term solution is: unzip the file and restore from the >> >>>> extracted zip file... >> >>>> >> >>>> cheers >> >>>> >> >>>> Dannes >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> eXist-db Native XML Database - http://exist-db.org >> >>>> Join us on linked-in: http://www.linkedin.com/groups?gid=35624 >> >>>> >> >>>> >> ------------------------------------------------------------------------------ >> >>>> 5 Ways to Improve & Secure Unified Communications >> >>>> Unified Communications promises greater efficiencies for business. UC >> can >> >>>> improve internal communications as well as offer faster, more >> efficient ways >> >>>> to interact with customers and streamline customer service. Learn >> more! >> >>>> http://www.accelacomm.com/jaw/sfnl/114/51426253/ >> >>>> _______________________________________________ >> >>>> Exist-open mailing list >> >>>> Exi...@li... >> >>>> https://lists.sourceforge.net/lists/listinfo/exist-open >> >>>> >> >>> >> >>> >> >>> >> >>> -- >> >>> Adam Retter >> >>> >> >>> eXist Developer >> >>> { United Kingdom } >> >>> ad...@ex... >> >>> irc://irc.freenode.net/existdb >> >>> >> >>> >> ------------------------------------------------------------------------------ >> >>> 5 Ways to Improve & Secure Unified Communications >> >>> Unified Communications promises greater efficiencies for business. UC >> can >> >>> improve internal communications as well as offer faster, more efficient >> ways >> >>> to interact with customers and streamline customer service. Learn more! >> >>> http://www.accelacomm.com/jaw/sfnl/114/51426253/ >> >>> _______________________________________________ >> >>> Exist-open mailing list >> >>> Exi...@li... >> >>> https://lists.sourceforge.net/lists/listinfo/exist-open >> >> >> >> >> > >> > >> > >> > -- >> > Adam Retter >> > >> > eXist Developer >> > { United Kingdom } >> > ad...@ex... >> > irc://irc.freenode.net/existdb >> >> >> >> ------------------------------------------------------------------------------ >> Special Offer -- Download ArcSight Logger for FREE! >> Finally, a world-class log management solution at an even better >> price-free! And you'll get a free "Love Thy Logs" t-shirt when you >> download Logger. Secure your free ArcSight Logger TODAY! >> http://p.sf.net/sfu/arcsisghtdev2dev >> _______________________________________________ >> Exist-open mailing list >> Exi...@li... >> https://lists.sourceforge.net/lists/listinfo/exist-open >> |