From: Ming Z. <mi...@el...> - 2006-03-25 02:58:19
|
thanks. i found and proposed another way for handling large file in mksquashfs. this email was put into spam for unknown reason. :P ming On Wed, 2006-03-22 at 15:52 +0100, Christian Leber wrote: > On Tue, Mar 21, 2006 at 01:30:00PM -0500, Ming Zhang wrote: > > i could not find out how mksquashfs allocate memory, but looks like it > > (or glibc) does not handle large size file efficiently. > > It allocs it with malloc. > > > i try to use mksquashfs to handle a single large size file like 40GB. > > then it will do a huge mmap and then later the swap is under heavy use. > > The glibc is using mmap to get memory. > > > Actually it's a design decision, the easiest way would be to just use > mmap for reading, so the kernel will (most likely) just handle it, > no loops no nothing. > > BUT obvisouly you would fail to use this for big files on 32 bit > architectures. > > > Christian Leber > |