s3cmd keeps crashing out every ~100 files up

2008-11-24
2013-02-19
  • Hi,

    Thanks for a cool tool - I am having some problems though - trying to store a bunch of photos (~15000) and every 100 or so 's3cmd sync' command fails with:

    WARNING: Upload of '/external/incoming/Photos/2005 Off-Roading - Mundaring/IMG_1707.jpg' failed (110, 'Connection timed out')
    WARNING: Retrying on lower speed (throttle=0.01)
    /external/incoming/Photos/2005 
    !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
        An unexpected error has occurred.
      Please report the following lines to:
      s3tools-general@lists.sourceforge.net
    !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

    S3cmd:  0.9.9-pre1
    Python: 2.5.2 (r252:60911, Jul 31 2008, 17:28:52)  [GCC 4.2.3 (Ubuntu 4.2.3-2ubuntu7)]

    Traceback (most recent call last):
      File "/usr/bin/s3cmd", line 1129, in <module>
        main()
      File "/usr/bin/s3cmd", line 1108, in main
        cmd_func(args)
      File "/usr/bin/s3cmd", line 706, in cmd_sync
        return cmd_sync_local2remote(src, dst)
      File "/usr/bin/s3cmd", line 669, in cmd_sync_local2remote
        response = s3.object_put(src, uri, attr_header)
      File "/usr/lib/python2.5/site-packages/S3/S3.py", line 185, in object_put
        response = self.send_file(request, file)
      File "/usr/lib/python2.5/site-packages/S3/S3.py", line 401, in send_file
        return self.send_file(request, file, throttle, retries - 1)
      File "/usr/lib/python2.5/site-packages/S3/S3.py", line 375, in send_file
        conn.connect()
      File "/usr/lib/python2.5/httplib.py", line 667, in connect
        socket.SOCK_STREAM):
    gaierror: (-2, 'Name or service not known')

    !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
        An unexpected error has occurred.
        Please report the above lines to:
      s3tools-general@lists.sourceforge.net
    !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

    Connectivity is maintained throughout so I do not believe this is a networking issue.

    Any help is much appreciated!

    Some more details:

    tom@mythbackend:/$ python -V
    Python 2.5.2

    tom@mythbackend:/$ uname -a
    Linux mythbackend.tom-george.com 2.6.24-16-generic #1 SMP Thu Apr 10 13:23:42 UTC 2008 i686 GNU/Linux

     
    • Michal Ludvig
      Michal Ludvig
      2008-11-26

      Please upgrade to 0.9.9-pre2, this problem is fixed there.

       
  • Hi
    i am also having this problem.

     
  • same here with trunk