#30 Reduce the load on the READING from disk

Undecided
wont-fix
nobody
None
1
2012-11-28
2012-10-17
John
No

Hi !

How can I reduce the load on the READING from disk when downloading torrents ?
What options should I turn on / off?

Best regards.

Discussion

  • tujikawa
    tujikawa
    2012-10-17

    --enable-mmap may reduce load slightly (if file system support it). How much load did you observe?

     
    • John
      John
      2012-10-18

      I use aria2c-Debian server with network storage connected by 1Gbit Ethernet interface.

      If downloaded 20 active torent-downloads, I watch on storage interface OUTBOUND(not inbound) traffic 800Mbit/s. Aria show me total downloadSpeed ~200Mbit/s, total uploadSpeed ~ 100Mbit/s. Where Aria spends another 700 Megabits OUTBOUND?

      Config

      /files/761704514b0ea44fc49a0218a22450e96dffded0.torrent
      timeout=10
      connect-timeout=120
      max-tries=100
      dir=/files
      split=5
      lowest-speed-limit=0
      piece-length=1048576
      max-download-limit=104857600
      file-allocation=none
      no-file-allocation-limit=5242880
      allow-overwrite=true
      realtime-chunk-checksum=true
      check-integrity=false
      continue=false
      no-netrc=false
      auto-file-renaming=true
      parameterized-uri=false
      allow-piece-length-change=false
      async-dns=true
      uri-selector=feedback
      remote-time=false
      max-file-not-found=20
      dry-run=false
      reuse-uri=true
      remove-control-file=false
      always-resume=true
      max-resume-failure-tries=0
      max-connection-per-server=9
      min-split-size=20971520
      conditional-get=false
      enable-async-dns6=false
      retry-wait=1
      stream-piece-selector=default
      hash-check-only=false
      enable-mmap=false
      ftp-type=binary
      ftp-pasv=true
      ftp-reuse-connection=true
      user-agent=aria2/1.15.2
      enable-http-keep-alive=true
      enable-http-pipelining=false
      use-head=false
      http-auth-challenge=false
      http-no-cache=true
      http-accept-gzip=false
      proxy-method=get
      max-upload-limit=0
      follow-torrent=true
      select-file=1,2,3,4,5,6,7,8,9,10,11
      seed-time=1440
      seed-ratio=2
      enable-peer-exchange=true
      bt-min-crypto-level=plain
      bt-require-crypto=false
      bt-request-peer-speed-limit=16384
      bt-max-open-files=2
      bt-seed-unverified=true
      bt-hash-check-seed=true
      bt-max-peers=20
      bt-tracker-interval=0
      bt-stop-timeout=0
      bt-save-metadata=false
      bt-metadata-only=false
      bt-enable-lpd=false
      bt-tracker-timeout=60
      bt-tracker-connect-timeout=60
      bt-exclude-tracker=retracker.local
      bt-remove-unselected-file=true
      follow-metalink=true
      metalink-preferred-protocol=none
      metalink-enable-unique-protocol=true

       
      Last edit: John 2012-10-18
  • tujikawa
    tujikawa
    2012-10-18

    They are very interesting numbers.
    aria2 reads from file when a)uploading and b)download complete for 1 piece and need hash verification. Usually, b) does not happen because the piece data arrive in order and we can calculate hash on the fly. Even if we combine the two, it is far off from 800Mbits/s. Usually, when portion of data is read from disk, they are cached in memory, and no disk access happens next time unless the page is swapped out.
    I'm not expert for remote file system, but I guess that some kind of metadata may be exchanged along with data when reading from/writing to disks. I'm not sure if they grow so much like this.

    Does this only happen with aria2? What happens if you use other clients?

     
  • John
    John
    2012-11-09

    I apologize for the delay in response.
    Tried transmission. The result was very bad.
    I'll have to give up the idea to save downloaded on network drives.
    Thanks !

     
  • tujikawa
    tujikawa
    2012-11-28

    • status: open --> wont-fix
     
  • tujikawa
    tujikawa
    2012-11-28

    All right, let's close the issue