avf-user — General mailing list for AVFS related discussion

[AVFS] new avfs release 1.1.5

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new release 1.1.5 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.5

This update brings support for extended tar headers for longer file 
names, and special files for changing the memory limit of the xz decoder.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] new avfs release 1.1.4

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new release 1.1.4 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.4

This update brings support for uncompressing lzip
(https://www.nongnu.org/lzip/) files. The handler is ulzip and it is
used automatically for .lz files.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

Re: [AVFS] Lzip support

[Ralf H. <ra...@bo...>]

Hi Dmytro,

On 14/03/2021 10.00, Dmytro Kolomoiets wrote:
> how time-consuming would it be for you to add "Lzip" (lzma-based) support
> to AVFS (primarily for FUSE usacase), or at least to provide a branch with
> half-skeleton of its integration as starting point?
> 
> Lzip - LZMA lossless data compressor
>   https://www.nongnu.org/lzip/
> Lzlib - A compression library for the lzip format
>   https://www.nongnu.org/lzip/lzlib.html

Since it is a just a stream-based compressor like gzip, it is relatively
easy to add support. I will take a look this. There might be some
performance issues when accessing a lot o files with lzip packed
archives since it seems as the library does not support internal state
save/restore for seeking but for usual use cases it should be fast enough.

> ## P.S.
> How much AVFS is abandoned? Or is it simply "good enough" that there is
> nothing to improve anymore (like most of Lisp packages :D) ?

It is not abandoned, but I don't have the need for much improvement
either. It works fine for me. From time to time there is native support
for some new compressor, but usually for more complex formats I rely on
extfs integration which is often slow, but good enough on the other hand.

Best regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] new avfs release 1.1.3

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new release 1.1.3 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.3

This minor update just fixes a compilation issue on macOS and fixes a
file name encoding issue in the ulha extfs module.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Missing #include <limits.h> in release 1.1.2

[Ali <al...@cr...>]

Hey,

I am taking care of updating the Homebrew formula for macOS (see
https://github.com/Homebrew/homebrew-core/pull/56841)

Right now when compiling 1.1.2 you get this error.

urar.c:827:24: error: use of undeclared identifier 'PATH_MAX'
    if (name_length <= PATH_MAX) {
                       ^1 error generated.


modules/urar.c needs a #include <limits.h> added.

Can you add it or do you accept patches and can do another patch level
release?
Best regards
Alex

[AVFS] new avfs release 1.1.2

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new release 1.1.2 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.2

This minor update fixes a memory leak in the zstd code and adds basic
support for rar 5.0 (listing support).

Here's the complete change log:

  - add support for rar 5.0 files
  - fix memleak in zstd support
  - small fix for extfs udar module

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Option to show the avfs #-dirs

[Alexey S. <ale...@sh...>]

Hi,

First of all, thanks for the great tool!

Second, have you thought about adding an option to show the magic avfs
directories ending with `#` symbol next to each file with supported
extension?

It will make it possible to use avfs with graphical file managers and
other systems which expect all available directories to be visible with
readdir/ls call (like overlayfs).

I made such patch for myself and it seems to work fine for the case of
overlayfs mounted on top of avfs - all changes made inside readonly
archives are stored in overlayfs "upper" dir, so for other apps it looks
like all archives are mounted read-write!

However, my code is rather dirty (list of supported extensions is
hardcoded and there is no option to switch this off), that's why I'd like
to know maintainers' opinion before creating a pull request (or how is it
done on sourceforge): are you interested in adding such functionality to
the mainline avfs?

Thanks,

Aleksei.

[AVFS] new avfs release 1.1.1

[Ralf H. <ra...@bo...>]

Hi,

I have prepared a new release 1.1.1 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.1

This release updates the internal bzip library to fix a security issue.

Here's the complete change log:

   - updated internal bzlib to 1.0.8 to fix security bug
   - added pkgconfig file

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

Re: [AVFS] Filenames in a mounted avfs FS

[Ralf H. <ra...@bo...>]

Hi,

On 25/07/2019 09.04, Francesco Colista wrote:
> Hello.
> I've started to use AVFS with Alpine Linux, which is built with these options:
> 
>  ./configure 
>  --build=$CBUILD 
>  --host=$CHOST 
>  --enable-fuse 
>  --enable-library 
>  --with-system-zlib 
>  --with-system-bzlib 
>  --with-xz 
>  --with-zstd 
>  --prefix=/usr 
> 
> When I try to cd into a tar.gz file, it works if the file has tar.gz as extension, but not with another one (like, of example, apk).

If you use the single '#' sign AVFS basically select the archive handler
purely based on the file extension. Each handler registers the support
extensions and only those are used to automatically select the handler.
apk are basically zip files so the 'uzip' module also registered .apk as
well .zip. When you rename a file and give it an different file ending,
this mechanism will select the wrong handler and you see those errors.

You can always select the handler manually. In your example, you can do
'cd std-static-1.4.0-r0.apk#ugz#utar' and it will work. You can see all
extension and the corresponding handler in this virtual file:

'cat /#avfsstat/modules'

Best regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Filenames in a mounted avfs FS

[Francesco C. <fra...@gm...>]

Hello.
I've started to use AVFS with Alpine Linux, which is built with these options:

 ./configure 
 --build=$CBUILD 
 --host=$CHOST 
 --enable-fuse 
 --enable-library 
 --with-system-zlib 
 --with-system-bzlib 
 --with-xz 
 --with-zstd 
 --prefix=/usr 

When I try to cd into a tar.gz file, it works if the file has tar.gz as extension, but not with another one (like, of example, apk).

Small example and demo:

# file zstd-static-1.4.0-r0.apk
zstd-static-1.4.0-r0.apk: gzip compressed data, max compression, from Unix, original size modulo 2^32 849920

#cd zstd-static-1.4.0-r0.apk#
-ash: cd: can't cd to zstd-static-1.4.0-r0.apk#: No such file or directory

(running avfs -d, i got this message:
LOOKUP /mirror/alpine/alpine/v3.10/main/x86_64/zstd-static-1.4.0-r0.apk#
getattr /mirror/alpine/alpine/v3.10/main/x86_64/zstd-static-1.4.0-r0.apk#
 unique: 27554, error: -2 (No such file or directory), outsize: 16

and /var/log/messages dump this error:
Jul 25 07:20:19 ita-al-mirror user.info avfs[6534]: UZIP: Couldn't find End of Central Directory Record )

If i rename that apk in tar.gz, it works:

# mv zstd-static-1.4.0-r0.apk zstd-static-1.4.0-r0.tar.gz
# cd zstd-static-1.4.0-r0.tar.gz#
zstd-static-1.4.0-r0.tar.gz## ls
usr
zstd-static-1.4.0-r0.tar.gz## 

I've tried to check if I was missing some ./configure param, but seems not.
I'm testing this in a LVM FS, with this kernel and arch:
# uname -ar
Linux ita-al-mirror 4.19.58-0-vanilla #1-Alpine SMP Wed Jul 10 12:40:48 UTC 2019 x86_64 Linux

Thanks.

.: Francesco
.: Francesco Colista

[AVFS] new avfs release 1.1.0

[Ralf H. <ra...@bo...>]

Hi,

I have prepared a new release 1.1.0 of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.1.0

This release updates the ugzip and webdav module, improves the autofs
handling, and drops support for CODA and PRELOAD.

Here's the complete change log:

 - improved handling of single '#' to stop resolving archive handlers
   when it makes no sense to add another chain
 - support multiple gzip member in a single file (concatenated gzip
   files)
 - updated webdav module with work with latest libneon (which is no
   longer bundled)
 - CODA and PRELOAD support has been removed

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

Re: [AVFS] Support for SSL/TLS?

[Ralf H. <ra...@bo...>]

Hi,

On 07/06/2019 04.08, Lucas Ramage via Avf-user wrote:
> Does AVFS support HTTPS?
> 
> I'd like to use AVFS to mount a remote git repository on a mobile device.

no, there is no TLS support right now. But the HTTP support is limited
anyway, it can be used to get single pages or files, but there is no
directory structure or something like that.

Best regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Support for SSL/TLS?

[Lucas R. <ram...@pr...>]

Greetings,

Does AVFS support HTTPS?

I'd like to use AVFS to mount a remote git repository on a mobile device.

Regards,

Lucas Ramage / Software Engineer

ram...@pr...

PGP Fingerprint / [Learn More](https://emailselfdefense.fsf.org/en/)

[EAE7 45DF 818D 4948 DDA7 0F44 F52A 5A96 7B9B 6FB7](https://pgp.mit.edu/pks/lookup?op=get&search=0xF52A5A967B9B6FB7)

Visit online journal

[http://lramage.gitlab.io](https://lramage94.gitlab.io)

Sent with [ProtonMail](https://protonmail.com) Secure Email.

[AVFS] new avfs release 1.0.6

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new small update of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.0.6

The version fixes a security problem which allowed to execute arbitrary 
commands triggered by special file names.
This release also supports libzstd.

Here's the complete change log:

  - added support for libzstd (zst files)
  - fixed arbitrary command execution in rsh/ssh module
  - zip workaround for zip archives with unix attributes but regular
    files are not marked correctly

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Interesting app. And thoughts about migrating to GitHub

[timofonic t. <tim...@gm...>]

Hello.

This software seems interesting. It seems more to what I always wanted
instead of having GVFSd+GIO vs IDK+KIO vs etc.

An environment (not KDEism, no GNOMEism, etc) agnostic VFS! 9P reborn? :P

I want to transparently do this:

$ nano http://some.url/text.file
$ nano https://timofonic:verysecretpassword@some.url/text.file

It would be nice to be able to do the same for Tor, I2P, Magnet URLs,
FTP, SFTP, SCP, all kind of compressed files (including stuff like DMG
and VM images).

Or the same when opening a file on Gnome, KDE, XFCE, Enlightenment, or
any other window manager/ desktop environment.

But or course "blacklist" certain network aware apps like MPV (mpv.io)

Some imports...

https://github.com/timofonic/AVFS
https://github.com/lb1a/avfs
https://github.com/glycerine/avfs (not a real import...)

Kind regards.

[AVFS] new avfs release 1.0.5

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new small update of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.0.5

The version fixes some crashes and limits the memory usage for
long-running setups (like avfsd).

Here's the complete change log:

 - limit the file cache to 50 elements and age of 10 minutes to avoid
   endless grow of internal cache
 - allow reproducable builds
 - fixed crash in parsing ls output for modules which need to handle
   ls-like output
 - fix urar module when external rar/unrar tool crashed

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] readme

[SZÉPE V. <vi...@sz...>]

Good morning!

It could be obvious for some but it took me 15 minutes to realize that

"You have to change to the mount directory where you will find a copy  
of the filesystem's root."

So AVFS only works in - in my case - /root/.avfs not outside of it.

Thank you for considering!

All the best!



SZÉPE Viktor
https://github.com/szepeviktor/debian-server-tools/blob/master/CV.md
-- 
+36-20-4242498  sm...@sz...  skype: szepe.viktor
Budapest, III. kerület

[AVFS] new avfs release 1.0.4

[Ralf H. <ra...@bo...>]

Hi,

I have uploaded a new small update of AVFS:

https://sourceforge.net/projects/avf/files/avfs/1.0.4/

It fixes a problem in the zip module when reading large zip archives
with a lot of files, or very large files.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

Re: [AVFS] error: invalid argument

[Ralf H. <ra...@bo...>]

Hi,

On 2016-07-24 08:34, Jon wrote:
> I am using avfs 1.0.3 with fuse 2.9.7.  I am trying to read from a zip file and I am getting an error:
> 
> cp: cannot open ‘/images/5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg' for reading: Invalid argument

thanks for the report. Is this zip archive available so I can look into
it? Also, I guess the individual files are far less than 2 GB in size,
right? When you run find on the base dir, do you get those 450k entries
listed or are some or many missing?

Best Regards,

Ralf

> My zip file is zip64.  It is a 3.1 gig file with ~450k entries.  There is no compression in the zip.  I can list files within the zip file without a problem but as soon as I try to copy a file out of the zip file I get the error above.  I am using debian jessie with fuse and avfs compiled from source.  This is all done inside a docker container.
> 
> I am running avfsd with the following options:
> 
> avfsd -o modules=subdir -o subdir=/tpz -o rellinks -o allow_other -d -f /images
> 
> Here is the debug output when I list a file within the zip file:
> 
> unique: 32, opcode: LOOKUP (1), nodeid: 1, insize: 77, pid: 3110
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
>   NODEID: 2
>   unique: 32, success, outsize: 144
> unique: 33, opcode: LOOKUP (1), nodeid: 2, insize: 92, pid: 3110
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
>   NODEID: 3
>   unique: 33, success, outsize: 144
> unique: 34, opcode: LOOKUP (1), nodeid: 3, insize: 42, pid: 3110
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
>   NODEID: 4
>   unique: 34, success, outsize: 144
> unique: 35, opcode: LOOKUP (1), nodeid: 4, insize: 42, pid: 3110
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
>   NODEID: 5
>   unique: 35, success, outsize: 144
> unique: 36, opcode: LOOKUP (1), nodeid: 5, insize: 48, pid: 3110
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
>   NODEID: 6
>   unique: 36, success, outsize: 144
> 
> 
> 
> Here is the debug output when I try to copy a file from the zip file:
> 
> unique: 37, opcode: LOOKUP (1), nodeid: 1, insize: 77, pid: 3111
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
>   NODEID: 2
>   unique: 37, success, outsize: 144
> unique: 38, opcode: LOOKUP (1), nodeid: 2, insize: 92, pid: 3111
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
>   NODEID: 3
>   unique: 38, success, outsize: 144
> unique: 39, opcode: LOOKUP (1), nodeid: 3, insize: 42, pid: 3111
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
>   NODEID: 4
>   unique: 39, success, outsize: 144
> unique: 40, opcode: LOOKUP (1), nodeid: 4, insize: 42, pid: 3111
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
>   NODEID: 5
>   unique: 40, success, outsize: 144
> unique: 41, opcode: LOOKUP (1), nodeid: 5, insize: 48, pid: 3111
> LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
> getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
>   NODEID: 6
>   unique: 41, success, outsize: 144
> unique: 42, opcode: OPEN (14), nodeid: 6, insize: 48, pid: 3111
> open flags: 0x8000 /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
>   unique: 42, error: -22 (Invalid argument), outsize: 16
> 
> 
> 
> Any idea what is going on?  
> 
> Jon
> ------------------------------------------------------------------------------
> What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
> patterns at an interface-level. Reveals which users, apps, and protocols are 
> consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
> J-Flow, sFlow and other flows. Make informed decisions using capacity planning
> reports.http://sdm.link/zohodev2dev
> _______________________________________________
> Avf-user mailing list
> Avf...@li...
> https://lists.sourceforge.net/lists/listinfo/avf-user
> 


-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] error: invalid argument

[Jon <jro...@ya...>]

I am using avfs 1.0.3 with fuse 2.9.7.  I am trying to read from a zip file and I am getting an error:

cp: cannot open ‘/images/5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg' for reading: Invalid argument

My zip file is zip64.  It is a 3.1 gig file with ~450k entries.  There is no compression in the zip.  I can list files within the zip file without a problem but as soon as I try to copy a file out of the zip file I get the error above.  I am using debian jessie with fuse and avfs compiled from source.  This is all done inside a docker container.

I am running avfsd with the following options:

avfsd -o modules=subdir -o subdir=/tpz -o rellinks -o allow_other -d -f /images

Here is the debug output when I list a file within the zip file:

unique: 32, opcode: LOOKUP (1), nodeid: 1, insize: 77, pid: 3110
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
  NODEID: 2
  unique: 32, success, outsize: 144
unique: 33, opcode: LOOKUP (1), nodeid: 2, insize: 92, pid: 3110
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
  NODEID: 3
  unique: 33, success, outsize: 144
unique: 34, opcode: LOOKUP (1), nodeid: 3, insize: 42, pid: 3110
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
  NODEID: 4
  unique: 34, success, outsize: 144
unique: 35, opcode: LOOKUP (1), nodeid: 4, insize: 42, pid: 3110
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
  NODEID: 5
  unique: 35, success, outsize: 144
unique: 36, opcode: LOOKUP (1), nodeid: 5, insize: 48, pid: 3110
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
  NODEID: 6
  unique: 36, success, outsize: 144



Here is the debug output when I try to copy a file from the zip file:

unique: 37, opcode: LOOKUP (1), nodeid: 1, insize: 77, pid: 3111
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b
  NODEID: 2
  unique: 37, success, outsize: 144
unique: 38, opcode: LOOKUP (1), nodeid: 2, insize: 92, pid: 3111
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip
  NODEID: 3
  unique: 38, success, outsize: 144
unique: 39, opcode: LOOKUP (1), nodeid: 3, insize: 42, pid: 3111
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0
  NODEID: 4
  unique: 39, success, outsize: 144
unique: 40, opcode: LOOKUP (1), nodeid: 4, insize: 42, pid: 3111
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8
  NODEID: 5
  unique: 40, success, outsize: 144
unique: 41, opcode: LOOKUP (1), nodeid: 5, insize: 48, pid: 3111
LOOKUP /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
getattr /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
  NODEID: 6
  unique: 41, success, outsize: 144
unique: 42, opcode: OPEN (14), nodeid: 6, insize: 48, pid: 3111
open flags: 0x8000 /5a3f15ff-e4db-4d26-9df5-73f0dbb6362b/d165ee23-a229-44e4-9f8d-286f0a11695e_tiles.tpz#uzip/0/8/0_0.jpg
  unique: 42, error: -22 (Invalid argument), outsize: 16



Any idea what is going on?  

Jon

Re: [AVFS] Speed suddenly decreases after copying 100 MB of data

[Ralf H. <ra...@bo...>]

Hi,

On 2016-01-19 16:40, Richárd Orosz wrote:
> I mounted a http direct url, which points to a rar file, to decompress
> it without downloading. I measured the read speed with utility "pv",
> which in fact is a filter and shows a progress indicator:
>  cat file.rar| pv |cat > file_copy.rar
>  Initial read speed is the usual 10 MB / sec, but always after reading
> 100 MB of data the read speed suddenly decreases to a few KB / sec.
>  Error log generated by option "-o debug":
> http://pastebin.com/W3Z6TMrY
> 
> I am using Arch Linux (3.14.52-1-lts)

AVFS uses a temporary cache for the downloaded content, so when you
repeat your test, the first part is already available locally and
therefore the speed is much higher. But there is nothing actually
downloaded unless you reach data which hasn't been accessed yet. So when
you hit the boundary, the speed will drop to the speed of your actual
network connection.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

[AVFS] Speed suddenly decreases after copying 100 MB of data

[Richárd O. <kis...@gm...>]

I mounted a http direct url, which points to a rar file, to decompress
it without downloading. I measured the read speed with utility "pv",
which in fact is a filter and shows a progress indicator:
 cat file.rar| pv |cat > file_copy.rar
 Initial read speed is the usual 10 MB / sec, but always after reading
100 MB of data the read speed suddenly decreases to a few KB / sec.
 Error log generated by option "-o debug":
http://pastebin.com/W3Z6TMrY

I am using Arch Linux (3.14.52-1-lts)

Re: [AVFS] rar file size

[Jonathan B. <jon...@gm...>]

Ralf,
Did not get your reply, found it on the web page, weird.

Thanks, however, I can see the file with uextrar but not extract it.

works:
$ ls file.rar#urar/file.img
file.rar#urar/file.img

does not work:
$ ls file.rar#uextrar/file.img
ls: cannot access file.rar#uextrar/file.img: No such file or directory

I can see the file if i do:
$ ls file.rar#uextrar/
file.img

Am I doing something wrong?

On Sat, 31 Oct 2015 at 10:28 Jonathan Bower <jon...@gm...>
wrote:

> ext4
> Ubuntu server 14.04 LTS 64bit
> kernel 3.13.0-65-generic
> FUSE library version: 2.9.2
> fusermount version: 2.9.2
> using FUSE kernel interface version 7.19
>
>
>
> On Sat, 31 Oct 2015 at 04:00 Linlin Yan <yan...@gm...> wrote:
>
>> what's your file system?
>>
>> On Fri, Oct 30, 2015 at 6:44 PM, Jonathan Bower
>> <jon...@gm...> wrote:
>> > Hi,
>> > I'm having problems with rar archives larger than 2048M. Any way to
>> solve
>> > this?
>> >
>> > Steps to reproduce:
>> > dd if=/dev/zero of=./file.img bs=1M count=2049 && rar a -m0 ./file.rar
>> > ./file.img
>> >
>> > ls file.rar# does not produce any output.
>> >
>> > The step with 2048M works as expected.
>> >
>> > Thanks
>> > Jonathan
>> >
>> >
>> ------------------------------------------------------------------------------
>> >
>> > _______________________________________________
>> > Avf-user mailing list
>> > Avf...@li...
>> > https://lists.sourceforge.net/lists/listinfo/avf-user
>> >
>>
>

Re: [AVFS] rar file size

[Ralf H. <ra...@bo...>]

Hi,

On 2015-10-30 11:44, Jonathan Bower wrote:
> I'm having problems with rar archives larger than 2048M. Any way to solve
> this?
> 
> Steps to reproduce:
> dd if=/dev/zero of=./file.img bs=1M count=2049 && rar a -m0 ./file.rar
> ./file.img
> 
> ls file.rar# does not produce any output.
> 
> The step with 2048M works as expected.

The internal rar module does not support rar extensions in newer rar
versions for files larger than 2gib. If you have the rar or unrar tool
installed, you can use the extfs rar module, just use "...rar#uextrar"
instead of using only the hash. This module is available in the latest
version 1.0.3.

Best Regards,

Ralf

-- 
Ralf Hoffmann <ra...@bo...>
Homepage: http://www.boomerangsworld.de

Re: [AVFS] rar file size

[Jonathan B. <jon...@gm...>]

ext4
Ubuntu server 14.04 LTS 64bit
kernel 3.13.0-65-generic
FUSE library version: 2.9.2
fusermount version: 2.9.2
using FUSE kernel interface version 7.19



On Sat, 31 Oct 2015 at 04:00 Linlin Yan <yan...@gm...> wrote:

> what's your file system?
>
> On Fri, Oct 30, 2015 at 6:44 PM, Jonathan Bower
> <jon...@gm...> wrote:
> > Hi,
> > I'm having problems with rar archives larger than 2048M. Any way to solve
> > this?
> >
> > Steps to reproduce:
> > dd if=/dev/zero of=./file.img bs=1M count=2049 && rar a -m0 ./file.rar
> > ./file.img
> >
> > ls file.rar# does not produce any output.
> >
> > The step with 2048M works as expected.
> >
> > Thanks
> > Jonathan
> >
> >
> ------------------------------------------------------------------------------
> >
> > _______________________________________________
> > Avf-user mailing list
> > Avf...@li...
> > https://lists.sourceforge.net/lists/listinfo/avf-user
> >
>