From: Steve J. <st...@st...> - 2010-11-09 00:53:53
|
I realize that s3cmd is for S3 commands (duh), but we've been using s3cmd to upload graphics from our server to a bucket which then get pushed out to our CDN on CloudFront. With new files, they push out right away. But when we overwrite files in our bucket, we have to manually invalidate them on CloudFront (http://aws.amazon.com/about-aws/whats-new/2010/08/31/cloudfront-adds-invali dation-feature/) Maybe it's opening Pandora's box to add a feature like this to s3cmd, but do you have any plans to add CloudFront invalidation as an option so I don't have to use a second tool just to update content on our CDN? Thanks, SteveJ From: Jobe Bittman [mailto:jo...@op...] Sent: Thursday, November 04, 2010 10:01 PM To: s3t...@li... Subject: [S3tools-general] Patches for updating headers without re-uploading I modified s3cmd 1.0.0-rc1 to allow replacing headers such as Cache-Control without having to reupload the file. I'm updating about 400,000 files with this right now. I used the information here http://doc.s3.amazonaws.com/proposals/copy.html and proxy sniffing BucketExplorer to figure it out. Can someone take a look and check it in? I've seen alot of people looking for this functionality on the net. Try it out. Dump some image on S3 and try the command below. s3cmd replace --acl-public --add-header "Cache-control: max-age=300" s3://media.aws.com/test.png wget -S http://media.aws.com/test.png s3cmd replace --acl-public --add-header "Cache-control: max-age=400" s3://media.aws.com/test.png wget -S http://media.aws.com/test.png You should see headers are updating without having to reupload the file. It copy's an s3 object to a new object in s3 and adds the headers. Thanks, Jobe Bittman |
From: Steve J. <st...@st...> - 2010-11-09 01:45:31
|
Sorry for the repost - I inadvertently hijacked another thread by pressing "Reply to All" and forgot to delete the subject line and previous thread. My apologies. Original post (with proper subject) below: I realize that s3cmd is for S3 commands (duh), but we've been using s3cmd to upload graphics from our server to a bucket which then get pushed out to our CDN on CloudFront. With new files, they push out right away. But when we overwrite files in our bucket, we have to manually invalidate them on CloudFront (http://aws.amazon.com/about-aws/whats-new/2010/08/31/cloudfront-adds-invali dation-feature/) Maybe it's opening Pandora's box to add a feature like this to s3cmd, but do you have any plans to add CloudFront invalidation as an option so I don't have to use a second tool just to update content on our CDN? Thanks, SteveJ |
From: Michal L. <ml...@lo...> - 2010-11-10 23:20:59
|
Hi Steve, it's not opening Pandora's box - s3cmd already has a decent support for CloudFront. And yes, this invalidation is on my TODO list. Actually I've seen a patch for this floating around a while ago. Will try to dig it up... Michal On 11/09/2010 02:45 PM, Steve Jenkins wrote: > > Sorry for the repost – I inadvertently hijacked another thread by > pressing “Reply to All” and forgot to delete the subject line and > previous thread. My apologies. Original post (with proper subject) below: > > I realize that s3cmd is for S3 commands (duh), but we’ve been using > s3cmd to upload graphics from our server to a bucket which then get > pushed out to our CDN on CloudFront. With new files, they push out > right away. But when we overwrite files in our bucket, we have to > manually invalidate them on CloudFront > (http://aws.amazon.com/about-aws/whats-new/2010/08/31/cloudfront-adds-invalidation-feature/) > > Maybe it’s opening Pandora’s box to add a feature like this to s3cmd, > but do you have any plans to add CloudFront invalidation as an option > so I don’t have to use a second tool just to update content on our CDN? > > Thanks, > > SteveJ > > > ------------------------------------------------------------------------------ > The Next 800 Companies to Lead America's Growth: New Video Whitepaper > David G. Thomson, author of the best-selling book "Blueprint to a > Billion" shares his insights and actions to help propel your > business during the next growth cycle. Listen Now! > http://p.sf.net/sfu/SAP-dev2dev > > > _______________________________________________ > S3tools-general mailing list > S3t...@li... > https://lists.sourceforge.net/lists/listinfo/s3tools-general |
From: Steve J. <st...@st...> - 2010-12-13 17:44:21
|
Anyone ever track down this patch, or hear of any other progress on CloudFront invalidation for s3cmd? Thanks! Steve From: Michal Ludvig [mailto:ml...@lo...] Sent: Wednesday, November 10, 2010 4:21 PM To: s3t...@li... Cc: Steve Jenkins Subject: Re: [S3tools-general] S3cmd for CloudFront Invalidation? Hi Steve, it's not opening Pandora's box - s3cmd already has a decent support for CloudFront. And yes, this invalidation is on my TODO list. Actually I've seen a patch for this floating around a while ago. Will try to dig it up... Michal On 11/09/2010 02:45 PM, Steve Jenkins wrote: Sorry for the repost – I inadvertently hijacked another thread by pressing “Reply to All” and forgot to delete the subject line and previous thread. My apologies. Original post (with proper subject) below: I realize that s3cmd is for S3 commands (duh), but we’ve been using s3cmd to upload graphics from our server to a bucket which then get pushed out to our CDN on CloudFront. With new files, they push out right away. But when we overwrite files in our bucket, we have to manually invalidate them on CloudFront (http://aws.amazon.com/about-aws/whats-new/2010/08/31/cloudfront-adds-invalidation-feature/) Maybe it’s opening Pandora’s box to add a feature like this to s3cmd, but do you have any plans to add CloudFront invalidation as an option so I don’t have to use a second tool just to update content on our CDN? Thanks, SteveJ ------------------------------------------------------------------------------ The Next 800 Companies to Lead America's Growth: New Video Whitepaper David G. Thomson, author of the best-selling book "Blueprint to a Billion" shares his insights and actions to help propel your business during the next growth cycle. Listen Now! http://p.sf.net/sfu/SAP-dev2dev _______________________________________________ S3tools-general mailing list S3t...@li... https://lists.sourceforge.net/lists/listinfo/s3tools-general |