Re: [S3tools-bugs] Problem: MemoryErr: S3cmd: 1.0.0

[Matt D. <ma...@do...>]

You are out of memory, which happens when approaching 1M files in a tree.
 Either split your syncs into separate subtree runs, or move to a 64bit
python instance with 8GB or more RAM.


On Thu, Oct 17, 2013 at 1:09 PM, （株）インフォアイ 脊戸土井貴之 <se...@in...>wrote:

> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>     An unexpected error has occurred.
>   Please report the following lines to:
>    s3t...@li...
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>
> Problem: MemoryErr:
> S3cmd:   1.0.0
>
> Traceback (most recent call last):
>   File "/usr/bin/s3cmd", line 2006, in ?
>     main()
>   File "/usr/bin/s3cmd", line 1950, in main
>     cmd_func(args)
>   File "/usr/bin/s3cmd", line 1211, in cmd_sync
>     return cmd_sync_local2remote(args)
>   File "/usr/bin/s3cmd", line 1111, in cmd_sync_local2remote
>     local_list, single_file_local = fetch_local_list(args[:-1],
> recursive = True)
>   File "/usr/bin/s3cmd", line 246, in fetch_local_list
>     local_list.update(list_for_uri)
> MemoryError
>
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>     An unexpected error has occurred.
>     Please report the above lines to:
>    s3t...@li...
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>
>
> ------------------------------------------------------------------------------
> October Webinars: Code for Performance
> Free Intel webinars can help you accelerate application performance.
> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most
> from
> the latest Intel processors and coprocessors. See abstracts and register >
> http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
>
>