amazon-s3

How to delete lot of objects named with common prefix from s3 bucket?

I have files in s3 bucket, and their names have the following format: username#file_id#... How to remove all john#doe#* items, without listing them? There are thousends of them, so when user request my app to delete all of them, he has to wait. ...

Does Amazon S3 guarantee write ordering?

Amazon S3 provides an "eventual consistency" model, where data you store is eventually visible to all clients. I can't find any official information as to whether write ordering is guaranteed or not. This is fundamentally important if you are building an architecture where a client might want to read data right after someone else stored...

Does anyone have any experience with Blobstreaming.org?

The practical implications of serving images from a database are easy to understand. On one hand it's consistent (since everything else is in the DB) and means that when you scale to multiple servers the files don't need replication. However it puts a huge burden on the database (time required to respond) and on the intermediat networ...

A bridge between an SSH and an S3 bucket for file transfers..

I have 17 gigs of images directly on my server that I would like to move to S3. First I tried to scp them and it it took roughly 9 hours, so that doesn't seem to be a good idea to use those because other people have probably touched those images since then. I'm thinking something similar to rsync, but rsync wouldn't work because I can't ...

Syncronizing S3 buckets

I have a S3 bucket that contains ~40 gigs of files - these files will be served via a production server We also have a staging server which needs a subset (if not all) the files in the production environment (to make sure we have a environment for testing purposes). I would like to know if there was a simple way to sync 2 buckets (prod...

How to install s3sync

This seems like an excellent script but lacks a key part to its installation I can't seem to figure out. Maybe someone out there can help a newb. What I've done so far : Installed the s3sync package. Downloaded the s3 certificate Downloaded the s3 ssl package ran it with sh ssh.certs.shar Edited the s3conf.yml file to have the correc...

Can i run Jets3t on android to connect , download , upload files from amazon s3?

if yes please add example cause i have several errors. ...

Using Amazon S3 to Host Flash Videos... Why does the FlashVar show no file extension?

I'm using FlowPlayer to replace an existing FLV player on my site that plays videos from Amazon E3. I have many pages and each should show a different video. For each page, I have a value stored in my CMS that is the "streamName". The stream name corresponds to a flashvars paramenter in the object/embed tags that show the video player...

git and Amazon s3

Can I setup Git and Amazon S3? Any ideas on ways of doing it? ...

How to keep secret keys a secret from sys admin?

We have a web app which can upload files to S3. For this to be possible a configuration file is required which contains the access key id and the access secret key of my AWS account. I am not the sys admin of the box that runs the web app. So basically this person can just grab my access secret key and eg start, stop and terminate EC2 i...

Amazon S3 Integration

Amazon Integration I have my own CMS which has a file manager. A lot of the files and formats which people can create are stored locally in a database. These are trivial examples like CSS files, basic content etc. The file manager can do all the things thats docs.google.com does. I actually based the entire methodolgy and design aroun...

Is it possible to transfer ownership of objects to another user using the Amazon S3?

If I have objects stored in the Amazon S3, is it possible to transfer ownership of an object to another user? ...

Setting mime-type on S3 object.

Is there a way to have S3 automatically set a mime-type depending on extension? I don't want my uploads to force download if I don't specify a mime-type but rather have the browser decide. ...

Is it possible to upload to S3 by just providing a URL?

Plainly, is that possible without having to read the remote resource to a local server and then PUT it on S3's servers ? So in a sense, instead of transmission looking like this: S3<--(PUT DATA)--LOCAL<--(REQUEST DATA)--REMOTE_URL it ends up looking like this. S3<--(PUT DATA BY URL)--LOCAL S3<--(REQUEST DATA)--REMOTE_URL ...

HTTP 504 timeout after exactly 120 seconds

I have a server application which runs in the Amazon EC2 cloud. From my client (the browser) I make a HTTP request which uploads a file to the server which then processes the file. If there is a lot of processing (large file ), the server always times out with a 504 backend continuation error always exactly after 120 seconds. Though I ge...

Automatically deleting objects older than n days in Amazon S3 (How ?)

I am storing many images in Amazon S3, using a ruby lib (http://amazon.rubyforge.org/) I don't care the photos older than 1 week, then to free the space in S3 I have to delete those photos. I know there is a method to delete the object in a certain bucket: S3Object.delete 'photo-1.jpg', 'photos' Is there a way to automatically delet...

Media Player Playback of mov fails

I'm uploading mov files selected with the uiimagepickercontroller to my amazon s3 bucket but when I then try to play them with the media player framework, I'm told it's an invalid format. Here's one: http://s3.amazonaws.com/irovr/users/9/92f7acd7-31b5-437c-8a30-16630e869d29/DEEDBFAE-8D41-4B52-B223-AA03B3A25491.mov ...

Benefits and Disadvantage of Amazon S3?

Possible Duplicate: Amazon S3: when/why Hi everybody. I want to use Amazon S3 Service for my web projects storage part. Is there anyone who use it? I want to learn benefits and disadvantages of it? Is there any web service suggestions instead of S3? Thanks ...

Drawing from an S3 through my photo model gets tangled.

I just migrated my server's photos to an S3. Everything seems to work swimmingly except one little catch. If a user chooses a photo from his existing media, the server returns a 500 error. I assume this is because it might still be either looking for it on my local, OR it doesn't draw from the photo model appropriately : a. From my loc...

python delete function not working in apache

i am using the s3cmd linux utility to deletes files from our amazon s3 bucket. i have created a function in python which calls the s3cmd command line utility and access and deletes the files amazon s3 bucket. command= 's3cmd -c .s3cfg del s3://project-bucket/images/testimage.jpg' os.system(command) when i run the project through djang...