Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#25 /tmp/, filesize limits?

closed
nobody
None
5
2006-12-28
2006-09-18
vulkain
No

I plan to use davfs2 to handle large files.
I have problems with files larger than 2GB.

Is this a known limitation? Can it be fixed?
Is this a coda issue or a davfs issue?

Also I read issues with running out of disk space in /tmp.
Is this still the case? Is the location of the /tmp
directory easily configurable?

My current situation:

==============

Uploading files larger than 2GB:
they are truncated to 2GB.
and the client (the shell with the mount point) says
"Filesize limit exceeded."
There is nothing interesting in /var/log/messages.

==============

Stat-ting files larger than 2GB:
Size gets truncated to 2GB
-rw------- 1 2147483647 ~/davmnt2/2gigs

Although the WebDAV answer just gave the correct size:
<D:getcontentlength>2147483675</D:getcontentlength>

==============

Downloading files larger than 2GB:
this also fails or truncates.

Discussion

  • Werner Baumann
    Werner Baumann
    2006-09-19

    Logged In: YES
    user_id=1260327

    There are currently two quite different versions of davfs2
    available:

    - the older davfs2-0.x.x, that does almost no cacheing on
    the cost of causing more traffic

    - the newer davfs2-1.x.x, that maintains a permanent cache
    and also a directory cache in memory; it reduces traffic and
    increases speed on the cost of more disk and memory usage.

    But both versions have one thing in common:
    Files that are opened will allways be downloaded in full (no
    partial GET) and saved on disk as long as they are open.
    There are currently no plans to change this.

    Caching:

    davfs2-0.x.x stores cached files in /tmp. When the file is
    closed (and stored back to the server) the cached version in
    /tmp will be deleted.

    davfs2-1.x.x uses a cache directory in the users home
    directory. If mounted by root the cache will be in
    /var/cache/davfs2. But both locations may be configured in
    the davfs2.conf files (system conf and per user conf). Files
    that are closed will not be deleted, but kept in cache. Next
    time the file is opened it will only be downloaded from the
    server if it has been changed remotely (like browsers do).
    The size of this cache is limited by configuration.

    But in both versions there must allways be enough free disk
    space to hold copies of all open files.

    Large file support:

    Most development on davfs2 was done on the base of the neon
    library version 0.2.4. This library did not support large
    files and so does davfs2.

    Newer versions of neon support large files. I am working on
    LFS for the next release of davfs2-1.x.x (indeed I compiled
    it with LFS yesterday, but it is not tested. I would like to
    send you a prelease package for testing if you are interested.)

    I did not yet bother with LFS for davfs2-0.x.x, but once it
    is working with davfs2-1.x.x it should not be that difficult.

    I do not know for sure whether coda supports large files.
    But it propably does (it uses 64-bit for communicating the
    file size). The next release of davfs2-1.x.x will be able to
    use the fuse kernel file system too, so there will be no
    problem with LFS by the kernel.

    Greetings
    Werner

     
  • Werner Baumann
    Werner Baumann
    2006-10-03

    Logged In: YES
    user_id=1260327

    The new version, davfs2 1.1.1, comes with support for large
    files. Please test it and report whether it works for you.

    Greetings
    Werner

     
  • Werner Baumann
    Werner Baumann
    2006-12-28

    • status: open --> closed