Content-Type: multipart/related; boundary="------------030401040806030408020605" --------------030401040806030408020605 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Michal Ludvig wrote:
Hi Joe,

this problem has been fixed in s3cmd 1.0.0(-rc1). I hope you're not observing the crashes with this newest s3cmd, are you?

See http://s3tools.org/s3cmd-100rc1-released for more info on what has been changed/fixed.

I actually am using the 1.0.0 rc1 version :(


Michal

On 11/15/2010 09:06 PM, Joe Auty wrote:
Thanks for this!

Another problem I'm running into is that if a file is deleted on the source before it is sent, the sync fails and spews out an error message. This is a problem with data such as email where an email message might be deleted in real time, or perhaps a log file turned over or something. I don't see a way to force the sync job to continue on these sorts of errors, but I thought I would double check first?




Michal Ludvig wrote:
Hi Joe,

currently it isn't possible to skip checksums comparison.

If all your log files are in the same directory or have some common name pattern, e.g. *.log, you can exclude them with --exclude \*.log or some other variant of --exclude-from/--rexclude/--rexclude-from.

In the future there will be an option to not compare the checksums on sync, but I'm not sure if it's a good idea to skip comparing them on upload...

Michal

On 11/13/2010 11:26 AM, Joe Auty wrote:
Hello,

Is there a way to get s3cmd to not fuss over matching checksums on live log files and files that are constantly being written to? I realize that I can exclude them, but there are many of them that are dynamically created, I'd rather not list them individually.

What I'm finding is that because more information is being written to the source file by the time the upload is complete, I get stuck in an endless loop of uploading the file over and over again until checksums match. If giving up after x number of failures is a possibility and just accepting what has been uploaded that is cool too, but what would be awesome is to perhaps skip the comparison of final checksums for certain directories.

Has anybody else run into this problem? Any suggestions for techniques for working around this sort of problem?


--
Joe Auty, NetMusician
NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks.
www.netmusician.org
joe@netmusician.org

------------------------------------------------------------------------------ Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general
------------------------------------------------------------------------------ Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general


--
Joe Auty, NetMusician
NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks.
www.netmusician.org
joe@netmusician.org

------------------------------------------------------------------------------ Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general
------------------------------------------------------------------------------ Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general


--
Joe Auty, NetMusician
NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks.
www.netmusician.org
joe@netmusician.org

--------------030401040806030408020605 Content-Type: image/png Content-Transfer-Encoding: base64 Content-ID: iVBORw0KGgoAAAANSUhEUgAAAEMAAABDCAIAAABIqC8kAAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAABixJREFUeNrsmklsG1UYgOfN6nEWO05I6tq0TQoFRNqqK1UL lSgU9YKEiBAnLqiXSgUpEpeqQgJxQZQLKkKCAErbQ1UuLAIkhBAgpFRt6lBacuiSrWq8xEnG Tjye1TP89nMn47HrSWhIlTK/rNH4ef43//f+5b03HmSaJvFACEk8KOKReCQeibvQdX7DZc0s ifXVLgghx9GutewqDi13EvOOGIZhHfGJ/U64a5IsehUf4asd3lK0GwRXIptYHeLOq1UswYrV 6rVJ7BYUqsSCKcflna6tE9xu8VsnDrPIO2KZYlfB547BoigKH2matr46eGg7Bu4IjNZLomma kMkkEqlEMpnJZPOS5PAe7/M1Nja0P9QWDq8JNDdjn5jKbVP8i5CuIHUMFQSnw+kOk+0iGnYg /xOIaS+qGLqp3jZzg4R8DakTVSrIZMIEEyWbdtOBHSzfwTAMXRKMtBB+VjxgBhAAUBQFGK7f uDk6NqGqqnu20XQkEg2HzDXcBTr/CzLdVQwyJPue1+lOTjnPqueRqbmrMFEicIhtPcTxAZZl MZLlXmRFFHYF2C3LciKZujT0ZzY7t8i6gUhGmR/h5D/2b8lF2jlNX+wKyCA4klCWVKMK/G5y zRF/01qO44AHYMAzxSC0OwQwJElKp9ODsaElYehSXJ76MZUc+3UwNzWrMTRa9CSgLLXaUtJF Pf5Jbm4aRhzCB8zGqUhbPsFBJYri9Rsjc3PzNSxGiOd9kHXFeqDrsqKUIpOEQJeFC7qcZBh/ ckYbHpVagzSEbvFHRFJsCO5eHC5DMbTsIsaFJZlAaaIDFdnQagwoowyKswOIes5e0GhcOnB+ g0MEQUhNTVUrb+zq7OrcsHZtGLIcRiGfz6em0qNjY+O34pp4SxPHEMnBZSyDxuNq98ZCW4hn g/v4tqe5lu0kxYNRBWVayVyWpn+ThaHa/qGb/B0v+EK7uOYnCTAMhktOKZlYPv27Ojfs9Ezu Z9G/B4cWzhbaCi1wCJBAUEmy0+PP7Nv71O6d9pZAoBnq1dYt3ZevDP/0/ecw2BBjpdKM5nMF STFaNh3zh1+qqAq+MBfY3Bh9OTv66dzEGacrKF/b5vf51r0VKnzE17K9MdKTGfk4N/l1xU+F yYwo4lQppz4msXJdzIuOWbZzw/pdO7fXjgSEtm3tfuzxbqJYeUqlkCAg3VvXv+jAWBh4qiHY dYQLOjtsirziwFgYfjYU3HiUbXy0ohFJkAj2VFkggSa5JI6OotGINevVlIfXbarEIwLt2+pl AsVzgS2ORi64tV6WsyGmoatyEkcQQRBHThI8jYBbVMU5Ffg4X/0cbfSzBKJtcz9C3DqXksU0 VS+S3Moc42iAQQd7MQlQlKswnky0kiz1HroyjcgFWkj6zLzuYta/2XKbji/YWuyQok/syy2A gR+WeofSpGTajSQRsQKCrbWWaqR95VtqM1bLhsSx4iQdK/lV9KjFbvBCnqzGZ0WWzRU+8fbx 5QnErGpx2QVQxLIHAX3vXaga4jnCMMsFDDBU3WWAhHmiNUhqulWFzHsvd8tAkp7VJyaJbK5s TUsACVmXUh4blvSEHE8XQAXIox3U/kd8vvtL0vdZ35lTX96aKMAA46DiWOJa/NjRN3t7enpq ls4PT5z47ptz8bgA2wJQAaVAE7nnwgevvqYePHjg/pB80df33rvvwOwEQV/ekBCEJBPXr428 1dubFYTXDx92YLx9/Pip/v6CUZ5A4QhKaaHw7Q8XL8be+OjkyWcPHFjpjJ+dne3v7wfjgAFW mAiVP/gc1hFnz57NZDJ2lb+vXv3q3LniipAsJj1cCR84hz0mxyLo8Mzp09VL2P+cJHbp0lQq VeeCifHxoVjM3jIwMACr1zoqIzdvJhOJlSaZTqelqudGdoF9ZTabdajYn5hVy8zMjENlJUg0 Xa9vFn5+U7HNoF3SUi0t01eaBKHlX/Gie+jUW614JB6JR+KReCQeiUfikXgkHolH4pF4JP8P ElQpq8b0yteJSOtRgPXa0Wohwa8VWDzl98wwBlP8j975F2vhLo+CdLfHOfgvZXuL5vZakiiK d7udaVToUqiAX7+peJfIy3iPxCPxSDwSj8QjefBI/hFgALTOJEoGmHV+AAAAAElFTkSuQmCC --------------030401040806030408020605 Content-Type: image/png Content-Transfer-Encoding: base64 Content-ID: iVBORw0KGgoAAAANSUhEUgAAAEMAAABDCAIAAABIqC8kAAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAABixJREFUeNrsmklsG1UYgOfN6nEWO05I6tq0TQoFRNqqK1UL lSgU9YKEiBAnLqiXSgUpEpeqQgJxQZQLKkKCAErbQ1UuLAIkhBAgpFRt6lBacuiSrWq8xEnG Tjye1TP89nMn47HrSWhIlTK/rNH4ef43//f+5b03HmSaJvFACEk8KOKReCQeibvQdX7DZc0s ifXVLgghx9GutewqDi13EvOOGIZhHfGJ/U64a5IsehUf4asd3lK0GwRXIptYHeLOq1UswYrV 6rVJ7BYUqsSCKcflna6tE9xu8VsnDrPIO2KZYlfB547BoigKH2matr46eGg7Bu4IjNZLomma kMkkEqlEMpnJZPOS5PAe7/M1Nja0P9QWDq8JNDdjn5jKbVP8i5CuIHUMFQSnw+kOk+0iGnYg /xOIaS+qGLqp3jZzg4R8DakTVSrIZMIEEyWbdtOBHSzfwTAMXRKMtBB+VjxgBhAAUBQFGK7f uDk6NqGqqnu20XQkEg2HzDXcBTr/CzLdVQwyJPue1+lOTjnPqueRqbmrMFEicIhtPcTxAZZl MZLlXmRFFHYF2C3LciKZujT0ZzY7t8i6gUhGmR/h5D/2b8lF2jlNX+wKyCA4klCWVKMK/G5y zRF/01qO44AHYMAzxSC0OwQwJElKp9ODsaElYehSXJ76MZUc+3UwNzWrMTRa9CSgLLXaUtJF Pf5Jbm4aRhzCB8zGqUhbPsFBJYri9Rsjc3PzNSxGiOd9kHXFeqDrsqKUIpOEQJeFC7qcZBh/ ckYbHpVagzSEbvFHRFJsCO5eHC5DMbTsIsaFJZlAaaIDFdnQagwoowyKswOIes5e0GhcOnB+ g0MEQUhNTVUrb+zq7OrcsHZtGLIcRiGfz6em0qNjY+O34pp4SxPHEMnBZSyDxuNq98ZCW4hn g/v4tqe5lu0kxYNRBWVayVyWpn+ThaHa/qGb/B0v+EK7uOYnCTAMhktOKZlYPv27Ojfs9Ezu Z9G/B4cWzhbaCi1wCJBAUEmy0+PP7Nv71O6d9pZAoBnq1dYt3ZevDP/0/ecw2BBjpdKM5nMF STFaNh3zh1+qqAq+MBfY3Bh9OTv66dzEGacrKF/b5vf51r0VKnzE17K9MdKTGfk4N/l1xU+F yYwo4lQppz4msXJdzIuOWbZzw/pdO7fXjgSEtm3tfuzxbqJYeUqlkCAg3VvXv+jAWBh4qiHY dYQLOjtsirziwFgYfjYU3HiUbXy0ohFJkAj2VFkggSa5JI6OotGINevVlIfXbarEIwLt2+pl AsVzgS2ORi64tV6WsyGmoatyEkcQQRBHThI8jYBbVMU5Ffg4X/0cbfSzBKJtcz9C3DqXksU0 VS+S3Moc42iAQQd7MQlQlKswnky0kiz1HroyjcgFWkj6zLzuYta/2XKbji/YWuyQok/syy2A gR+WeofSpGTajSQRsQKCrbWWaqR95VtqM1bLhsSx4iQdK/lV9KjFbvBCnqzGZ0WWzRU+8fbx 5QnErGpx2QVQxLIHAX3vXaga4jnCMMsFDDBU3WWAhHmiNUhqulWFzHsvd8tAkp7VJyaJbK5s TUsACVmXUh4blvSEHE8XQAXIox3U/kd8vvtL0vdZ35lTX96aKMAA46DiWOJa/NjRN3t7enpq ls4PT5z47ptz8bgA2wJQAaVAE7nnwgevvqYePHjg/pB80df33rvvwOwEQV/ekBCEJBPXr428 1dubFYTXDx92YLx9/Pip/v6CUZ5A4QhKaaHw7Q8XL8be+OjkyWcPHFjpjJ+dne3v7wfjgAFW mAiVP/gc1hFnz57NZDJ2lb+vXv3q3LniipAsJj1cCR84hz0mxyLo8Mzp09VL2P+cJHbp0lQq VeeCifHxoVjM3jIwMACr1zoqIzdvJhOJlSaZTqelqudGdoF9ZTabdajYn5hVy8zMjENlJUg0 Xa9vFn5+U7HNoF3SUi0t01eaBKHlX/Gie+jUW614JB6JR+KReCQeiUfikXgkHolH4pF4JP8P ElQpq8b0yteJSOtRgPXa0Wohwa8VWDzl98wwBlP8j975F2vhLo+CdLfHOfgvZXuL5vZakiiK d7udaVToUqiAX7+peJfIy3iPxCPxSDwSj8QjefBI/hFgALTOJEoGmHV+AAAAAElFTkSuQmCC --------------030401040806030408020605 Content-Type: image/png; x-mac-type="504E4766"; x-mac-creator="3842494D"; name="nmtwitter.png" Content-Transfer-Encoding: base64 Content-ID: Content-Disposition: inline; filename="nmtwitter.png" iVBORw0KGgoAAAANSUhEUgAAAEMAAABDCAIAAABIqC8kAAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAABixJREFUeNrsmklsG1UYgOfN6nEWO05I6tq0TQoFRNqqK1UL lSgU9YKEiBAnLqiXSgUpEpeqQgJxQZQLKkKCAErbQ1UuLAIkhBAgpFRt6lBacuiSrWq8xEnG Tjye1TP89nMn47HrSWhIlTK/rNH4ef43//f+5b03HmSaJvFACEk8KOKReCQeibvQdX7DZc0s ifXVLgghx9GutewqDi13EvOOGIZhHfGJ/U64a5IsehUf4asd3lK0GwRXIptYHeLOq1UswYrV 6rVJ7BYUqsSCKcflna6tE9xu8VsnDrPIO2KZYlfB547BoigKH2matr46eGg7Bu4IjNZLomma kMkkEqlEMpnJZPOS5PAe7/M1Nja0P9QWDq8JNDdjn5jKbVP8i5CuIHUMFQSnw+kOk+0iGnYg /xOIaS+qGLqp3jZzg4R8DakTVSrIZMIEEyWbdtOBHSzfwTAMXRKMtBB+VjxgBhAAUBQFGK7f uDk6NqGqqnu20XQkEg2HzDXcBTr/CzLdVQwyJPue1+lOTjnPqueRqbmrMFEicIhtPcTxAZZl MZLlXmRFFHYF2C3LciKZujT0ZzY7t8i6gUhGmR/h5D/2b8lF2jlNX+wKyCA4klCWVKMK/G5y zRF/01qO44AHYMAzxSC0OwQwJElKp9ODsaElYehSXJ76MZUc+3UwNzWrMTRa9CSgLLXaUtJF Pf5Jbm4aRhzCB8zGqUhbPsFBJYri9Rsjc3PzNSxGiOd9kHXFeqDrsqKUIpOEQJeFC7qcZBh/ ckYbHpVagzSEbvFHRFJsCO5eHC5DMbTsIsaFJZlAaaIDFdnQagwoowyKswOIes5e0GhcOnB+ g0MEQUhNTVUrb+zq7OrcsHZtGLIcRiGfz6em0qNjY+O34pp4SxPHEMnBZSyDxuNq98ZCW4hn g/v4tqe5lu0kxYNRBWVayVyWpn+ThaHa/qGb/B0v+EK7uOYnCTAMhktOKZlYPv27Ojfs9Ezu Z9G/B4cWzhbaCi1wCJBAUEmy0+PP7Nv71O6d9pZAoBnq1dYt3ZevDP/0/ecw2BBjpdKM5nMF STFaNh3zh1+qqAq+MBfY3Bh9OTv66dzEGacrKF/b5vf51r0VKnzE17K9MdKTGfk4N/l1xU+F yYwo4lQppz4msXJdzIuOWbZzw/pdO7fXjgSEtm3tfuzxbqJYeUqlkCAg3VvXv+jAWBh4qiHY dYQLOjtsirziwFgYfjYU3HiUbXy0ohFJkAj2VFkggSa5JI6OotGINevVlIfXbarEIwLt2+pl AsVzgS2ORi64tV6WsyGmoatyEkcQQRBHThI8jYBbVMU5Ffg4X/0cbfSzBKJtcz9C3DqXksU0 VS+S3Moc42iAQQd7MQlQlKswnky0kiz1HroyjcgFWkj6zLzuYta/2XKbji/YWuyQok/syy2A gR+WeofSpGTajSQRsQKCrbWWaqR95VtqM1bLhsSx4iQdK/lV9KjFbvBCnqzGZ0WWzRU+8fbx 5QnErGpx2QVQxLIHAX3vXaga4jnCMMsFDDBU3WWAhHmiNUhqulWFzHsvd8tAkp7VJyaJbK5s TUsACVmXUh4blvSEHE8XQAXIox3U/kd8vvtL0vdZ35lTX96aKMAA46DiWOJa/NjRN3t7enpq ls4PT5z47ptz8bgA2wJQAaVAE7nnwgevvqYePHjg/pB80df33rvvwOwEQV/ekBCEJBPXr428 1dubFYTXDx92YLx9/Pip/v6CUZ5A4QhKaaHw7Q8XL8be+OjkyWcPHFjpjJ+dne3v7wfjgAFW mAiVP/gc1hFnz57NZDJ2lb+vXv3q3LniipAsJj1cCR84hz0mxyLo8Mzp09VL2P+cJHbp0lQq VeeCifHxoVjM3jIwMACr1zoqIzdvJhOJlSaZTqelqudGdoF9ZTabdajYn5hVy8zMjENlJUg0 Xa9vFn5+U7HNoF3SUi0t01eaBKHlX/Gie+jUW614JB6JR+KReCQeiUfikXgkHolH4pF4JP8P ElQpq8b0yteJSOtRgPXa0Wohwa8VWDzl98wwBlP8j975F2vhLo+CdLfHOfgvZXuL5vZakiiK d7udaVToUqiAX7+peJfIy3iPxCPxSDwSj8QjefBI/hFgALTOJEoGmHV+AAAAAElFTkSuQmCC --------------030401040806030408020605--