From: John T. <jo...@ve...> - 2008-11-23 11:50:14
|
Running s3cmd 0.9.5 from Hardy Heron repository I have a large bucket with multiple subfolders. s3cmd ls s3://mybucketname was working fine, but as the bucket has grown I'm now getting the following error. (s3cmd ls works on my other smaller buckets) I can still upload and download files to the bucket using s3cmd The bucket consists of files uploaded from a Hardy ext3 filesystem Any ideas? Regards John john@myserver:~$ s3cmd ls s3://mybucketname Bucket 'mybucketname': Traceback (most recent call last): File "/usr/bin/s3cmd", line 740, in <module> cmd_func(args) File "/usr/bin/s3cmd", line 87, in cmd_ls subcmd_bucket_list(s3, uri) File "/usr/bin/s3cmd", line 117, in subcmd_bucket_list response = s3.bucket_list(bucket, prefix = object) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 135, in bucket_list response = self.send_request(request) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 305, in send_request raise S3Error(response) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 32, in __init__ tree = ET.fromstring(response["data"]) File "/usr/lib/python2.5/xml/etree/ElementTree.py", line 964, in XML return parser.close() File "/usr/lib/python2.5/xml/etree/ElementTree.py", line 1254, in close self._parser.Parse("", 1) # end of data xml.parsers.expat.ExpatError: no element found: line 1, column 0 Crash report /var/crash/_usr_bin_s3cmd.1000.crash ProblemType: Crash Date: Sun Nov 23 11:12:48 2008 ExecutablePath: /usr/bin/s3cmd InterpreterPath: /usr/bin/python2.5 ProcCmdline: /usr/bin/python /usr/bin/s3cmd ls s3://mybucketname ProcCwd: /home/john ProcEnviron: SHELL=/bin/bash PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games LANG=en_GB.UTF-8 ProcMaps: 08048000-08140000 r-xp 00000000 08:01 3490546 /usr/bin/python2.5 08140000-08165000 rw-p 000f7000 08:01 3490546 /usr/bin/python2.5 08165000-088c3000 rw-p 08165000 00:00 0 [heap] b7869000-b7873000 r-xp 00000000 08:01 11274462 /lib/libgcc_s.so.1 b7873000-b7874000 rw-p 0000a000 08:01 11274462 /lib/libgcc_s.so.1 b7874000-b795c000 r-xp 00000000 08:01 3489923 /usr/lib/libstdc++.so.6.0.9 b795c000-b795f000 r--p 000e8000 08:01 3489923 /usr/lib/libstdc++.so.6.0.9 b795f000-b7961000 rw-p 000eb000 08:01 3489923 /usr/lib/libstdc++.so.6.0.9 b7961000-b7967000 rw-p b7961000 00:00 0 b7967000-b7a34000 r-xp 00000000 08:01 3491275 /usr/lib/libapt-pkg-libc6.7-6.so.4.6.0 b7a34000-b7a36000 rw-p 000cc000 08:01 3491275 /usr/lib/libapt-pkg-libc6.7-6.so.4.6.0 b7a48000-b7aac000 rw-p b7aac000 00:00 0 b7ab5000-b7ad6000 r-xp 00000000 08:01 3525188 /usr/lib/python2.5/site-packages/apt_pkg.so b7ad6000-b7ad9000 rw-p 00020000 08:01 3525188 /usr/lib/python2.5/site-packages/apt_pkg.so b7ad9000-b7b0c000 r-xp 00000000 08:01 3525119 /usr/lib/python2.5/lib-dynload/pyexpat.so b7b0c000-b7b0f000 rw-p 00033000 08:01 3525119 /usr/lib/python2.5/lib-dynload/pyexpat.so b7b0f000-b7b1e000 r-xp 00000000 08:01 11289942 /lib/tls/i686/cmov/libresolv-2.7.so b7b1e000-b7b20000 rw-p 0000f000 08:01 11289942 /lib/tls/i686/cmov/libresolv-2.7.so b7b20000-b7b22000 rw-p b7b20000 00:00 0 b7b22000-b7c4c000 r-xp 00000000 08:01 3522604 /usr/lib/i686/cmov/libcrypto.so.0.9.8 b7c4c000-b7c61000 rw-p 00129000 08:01 3522604 /usr/lib/i686/cmov/libcrypto.so.0.9.8 b7c61000-b7ca5000 rw-p b7c61000 00:00 0 b7ca7000-b7cab000 r-xp 00000000 08:01 11289929 /lib/tls/i686/cmov/libnss_dns-2.7.so b7cab000-b7cad000 rw-p 00003000 08:01 11289929 /lib/tls/i686/cmov/libnss_dns-2.7.so b7cad000-b7caf000 r-xp 00000000 08:01 11274449 /lib/libnss_mdns4_minimal.so.2 b7caf000-b7cb0000 rw-p 00001000 08:01 11274449 /lib/libnss_mdns4_minimal.so.2 b7cb0000-b7cb9000 r-xp 00000000 08:01 11289931 /lib/tls/i686/cmov/libnss_files-2.7.so b7cb9000-b7cbb000 rw-p 00008000 08:01 11289931 /lib/tls/i686/cmov/libnss_files-2.7.so b7cc4000-b7cc8000 r-xp 00000000 08:01 3525130 /usr/lib/python2.5/lib-dynload/zlib.so b7cc8000-b7cc9000 rw-p 00004000 08:01 3525130 /usr/lib/python2.5/lib-dynload/zlib.so b7cc9000-b7ccc000 r-xp 00000000 08:01 3525123 /usr/lib/python2.5/lib-dynload/select.so b7ccc000-b7ccd000 rw-p 00002000 08:01 3525123 /usr/lib/python2.5/lib-dynload/select.so b7ccd000-b7cd3000 r-xp 00000000 08:01 3525094 /usr/lib/python2.5/lib-dynload/array.so b7cd3000-b7cd5000 rw-p 00006000 08:01 3525094 /usr/lib/python2.5/lib-dynload/array.so b7cd5000-b7ce0000 r-xp 00000000 08:01 3525088 /usr/lib/python2.5/lib-dynload/_socket.so b7ce0000-b7ce3000 rw-p 0000a000 08:01 3525088 /usr/lib/python2.5/lib-dynload/_socket.so b7ce3000-b7cf7000 r-xp 00000000 08:01 3492097 /usr/lib/libz.so.1.2.3.3 b7cf7000-b7cf8000 rw-p 00013000 08:01 3492097 /usr/lib/libz.so.1.2.3.3 b7cf8000-b7d36000 r-xp 00000000 08:01 3522605 /usr/lib/i686/cmov/libssl.so.0.9.8 b7d36000-b7d3a000 rw-p 0003d000 08:01 3522605 /usr/lib/i686/cmov/libssl.so.0.9.8 b7d3b000-b7d3d000 rw-p b7d3b000 00:00 0 b7d3d000-b7d40000 r-xp 00000000 08:01 3525090 /usr/lib/python2.5/lib-dynload/_ssl.so b7d40000-b7d41000 rw-p 00003000 08:01 3525090 /usr/lib/python2.5/lib-dynload/_ssl.so b7d41000-b7d44000 r-xp 00000000 08:01 3525106 /usr/lib/python2.5/lib-dynload/fcntl.so b7d44000-b7d45000 rw-p 00003000 08:01 3525106 /usr/lib/python2.5/lib-dynload/fcntl.so b7d45000-b7d47000 r-xp 00000000 08:01 3525087 /usr/lib/python2.5/lib-dynload/_random.so b7d47000-b7d48000 rw-p 00002000 08:01 3525087 /usr/lib/python2.5/lib-dynload/_random.so b7d48000-b7d4b000 r-xp 00000000 08:01 3525113 /usr/lib/python2.5/lib-dynload/math.so b7d4b000-b7d4c000 rw-p 00002000 08:01 3525113 /usr/lib/python2.5/lib-dynload/math.so b7d4c000-b7d4e000 r-xp 00000000 08:01 3525081 /usr/lib/python2.5/lib-dynload/_hashlib.so b7d4e000-b7d4f000 rw-p 00002000 08:01 3525081 /usr/lib/python2.5/lib-dynload/_hashlib.so b7d4f000-b7d53000 r-xp 00000000 08:01 3525096 /usr/lib/python2.5/lib-dynload/binascii.so b7d53000-b7d54000 rw-p 00003000 08:01 3525096 /usr/lib/python2.5/lib-dynload/binascii.so b7d54000-b7d59000 r-xp 00000000 08:01 3525091 /usr/lib/python2.5/lib-dynload/_struct.so b7d59000-b7d5a000 rw-p 00005000 08:01 3525091 /usr/lib/python2.5/lib-dynload/_struct.so b7d5a000-b7d5f000 r-xp 00000000 08:01 3525116 /usr/lib/python2.5/lib-dynload/operator.so b7d5f000-b7d60000 rw-p 00005000 08:01 3525116 /usr/lib/python2.5/lib-dynload/operator.so b7d60000-b7d63000 r-xp 00000000 08:01 3525084 /usr/lib/python2.5/lib-dynload/_locale.so b7d63000-b7d64000 rw-p 00003000 08:01 3525084 /usr/lib/python2.5/lib-dynload/_locale.so b7d64000-b7d67000 r-xp 00000000 08:01 3525128 /usr/lib/python2.5/lib-dynload/time.so b7d67000-b7d69000 rw-p 00002000 08:01 3525128 /usr/lib/python2.5/lib-dynload/time.so b7d69000-b7d70000 r--s 00000000 08:01 3492510 /usr/lib/gconv/gconv-modules.cache b7d70000-b7daf000 r--p 00000000 08:01 3630106 /usr/lib/locale/en_GB.utf8/LC_CTYPE b7daf000-b7e32000 rw-p b7daf000 00:00 0 b7e32000-b7f7b000 r-xp 00000000 08:01 11289914 /lib/tls/i686/cmov/libc-2.7.so b7f7b000-b7f7c000 r--p 00149000 08:01 11289914 /lib/tls/i686/cmov/libc-2.7.so b7f7c000-b7f7e000 rw-p 0014a000 08:01 11289914 /lib/tls/i686/cmov/libc-2.7.so b7f7e000-b7f81000 rw-p b7f7e000 00:00 0 b7f81000-b7fa4000 r-xp 00000000 08:01 11289922 /lib/tls/i686/cmov/libm-2.7.so b7fa4000-b7fa6000 rw-p 00023000 08:01 11289922 /lib/tls/i686/cmov/libm-2.7.so b7fa6000-b7fa8000 r-xp 00000000 08:01 11289948 /lib/tls/i686/cmov/libutil-2.7.so b7fa8000-b7faa000 rw-p 00001000 08:01 11289948 /lib/tls/i686/cmov/libutil-2.7.so b7faa000-b7fab000 rw-p b7faa000 00:00 0 b7fab000-b7fad000 r-xp 00000000 08:01 11289920 /lib/tls/i686/cmov/libdl-2.7.so b7fad000-b7faf000 rw-p 00001000 08:01 11289920 /lib/tls/i686/cmov/libdl-2.7.so b7faf000-b7fc3000 r-xp 00000000 08:01 11289940 /lib/tls/i686/cmov/libpthread-2.7.so b7fc3000-b7fc5000 rw-p 00013000 08:01 11289940 /lib/tls/i686/cmov/libpthread-2.7.so b7fc5000-b7fc7000 rw-p b7fc5000 00:00 0 b7fc7000-b7fc9000 r-xp 00000000 08:01 3525109 /usr/lib/python2.5/lib-dynload/grp.so b7fc9000-b7fca000 rw-p 00001000 08:01 3525109 /usr/lib/python2.5/lib-dynload/grp.so b7fca000-b7fce000 r-xp 00000000 08:01 3525101 /usr/lib/python2.5/lib-dynload/collections.so b7fce000-b7fcf000 rw-p 00004000 08:01 3525101 /usr/lib/python2.5/lib-dynload/collections.so b7fcf000-b7fd2000 r-xp 00000000 08:01 3525099 /usr/lib/python2.5/lib-dynload/cStringIO.so b7fd2000-b7fd3000 rw-p 00003000 08:01 3525099 /usr/lib/python2.5/lib-dynload/cStringIO.so b7fd3000-b7fd7000 r-xp 00000000 08:01 3525125 /usr/lib/python2.5/lib-dynload/strop.so b7fd7000-b7fd9000 rw-p 00004000 08:01 3525125 /usr/lib/python2.5/lib-dynload/strop.so b7fd9000-b7fdb000 rw-p b7fd9000 00:00 0 b7fdb000-b7fdc000 r-xp b7fdb000 00:00 0 [vdso] b7fdc000-b7ff6000 r-xp 00000000 08:01 11272211 /lib/ld-2.7.so b7ff6000-b7ff8000 rw-p 00019000 08:01 11272211 /lib/ld-2.7.so bfcca000-bfcf4000 rw-p bffd6000 00:00 0 [stack] ProcStatus: Name: s3cmd State: R (running) Tgid: 12422 Pid: 12422 PPid: 11922 TracerPid: 0 Uid: 1000 1000 1000 1000 Gid: 1000 1000 1000 1000 FDSize: 256 Groups: 4 20 24 25 29 30 44 46 107 110 116 123 1000 VmPeak: 16436 kB VmSize: 16436 kB VmLck: 0 kB VmHWM: 12820 kB VmRSS: 12820 kB VmData: 8816 kB VmStk: 168 kB VmExe: 992 kB VmLib: 5700 kB VmPTE: 24 kB Threads: 1 SigQ: 0/8179 SigPnd: 0000000000000000 ShdPnd: 0000000000000000 SigBlk: 0000000000000000 SigIgn: 0000000001001000 SigCgt: 0000000180000002 CapInh: 0000000000000000 CapPrm: 0000000000000000 CapEff: 0000000000000000 voluntary_ctxt_switches: 304 nonvoluntary_ctxt_switches: 990 PythonArgs: ['/usr/bin/s3cmd', 'ls', 's3://mybucketname'] Traceback: Traceback (most recent call last): File "/usr/bin/s3cmd", line 740, in <module> cmd_func(args) File "/usr/bin/s3cmd", line 87, in cmd_ls subcmd_bucket_list(s3, uri) File "/usr/bin/s3cmd", line 117, in subcmd_bucket_list response = s3.bucket_list(bucket, prefix = object) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 135, in bucket_list response = self.send_request(request) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 305, in send_request raise S3Error(response) File "/usr/lib/python2.5/site-packages/S3/S3.py", line 32, in __init__ tree = ET.fromstring(response["data"]) File "/usr/lib/python2.5/xml/etree/ElementTree.py", line 964, in XML return parser.close() File "/usr/lib/python2.5/xml/etree/ElementTree.py", line 1254, in close self._parser.Parse("", 1) # end of data ExpatError: no element found: line 1, column 0 UserGroups: adm admin audio cdrom dialout dip floppy fuse lpadmin mythtv plugdev video |
From: Michal L. <mi...@lo...> - 2008-11-23 21:02:31
|
John Taylor wrote: > Running s3cmd 0.9.5 from Hardy Heron repository > > I have a large bucket with multiple subfolders. s3cmd ls > s3://mybucketname was working fine, but as the bucket has grown I'm > now getting the following error. (s3cmd ls works on my other smaller > buckets) > > > john@myserver:~$ s3cmd ls s3://mybucketname > [...] > xml.parsers.expat.ExpatError: no element found: line 1, column 0 How large is "large"? How many files are the there in the bucket, roughly? Michal |
From: John T. <jo...@ve...> - 2008-11-23 23:19:54
|
> > How large is "large"? How many files are the there in the bucket, roughly? > > Michal Not a huge number , just under a thousand. Slightly embarrassed to report the problem does not appear to occur in version 0.9.8.4 So be careful of the Hardy repository! Thanks for the help John |
From: Michal L. <mi...@lo...> - 2008-11-23 23:23:24
|
John Taylor wrote: >> How large is "large"? How many files are the there in the bucket, roughly? >> >> Michal > > Not a huge number , just under a thousand. > > Slightly embarrassed to report the problem does not appear to occur in > version 0.9.8.4 I'm glad to hear that. Means no work for me ;-) Michal |