amazon-s3

Storing images in file system, amazon-s3 datastores

There has been numerous discussions related to storing images (or binary data) in the database or file system (Refer: http://stackoverflow.com/questions/3748/storing-images-in-db-yea-or-nay) We have decided to use the file system for storing images and relevant image specific metadata in the database itself in the short term and migrat...

Controlling number of downloads on Amazon S3

Is there a way to control number of downloads of digital content on Amazon S3 or via some middle man software that talks to S3? I already use their timed links, but I would like to control number of downloads also. Any ideas of how to accomplish this using S3 or suggestions about alternative services that could? Thanks! ...

Selecting a random result from Simple Database (SDB) on AWS

Anyone know how to do this - just what would be the equivalent to this: "select * from YOUR_TABLE order by rand() limit 1" in mysql?? Maybe not possible in SDB? ...

How to copy a file via the browser to Amazon S3 using Python (and boto)?

Creating a file (key) into Amazon S3 using Python (and boto) is not a problem. With this code, I can connect to a bucket and create a key with a specific content: bucket_instance = connection.get_bucket('bucketname') key = bucket_instance.new_key('testfile.txt') key.set_contents_from_string('Content for File') I want to upload a file ...

How to download a file via the browser from Amazon S3 using Python (and boto) at Google App Engine?

I have a python script running inside the Google App Engine with boto 1.9b that gets all keys inside a S3-Bucket. The output is formated as a HTML-Table. bucket_instance = conn_s3.get_bucket(bucketname) liste_keys = bucket_instance.get_all_keys() table = '<table>' for i in range(laenge_liste_keys): table = table + '<tr><td>'+str(lis...

(JetS3t) Can not list the files that owned by me ?

I use the JetS3t to try to list sub files under a folder: S3Object[] objects = s3Service.listObjects(Bucket, path, "/"); List<S3Path> children = new ArrayList<S3Path>(); for (S3Object obj : objects) { children.add(new S3Path(obj.getKey())); } But it shows all the files under this folder, and finally through the help of S3Orgnizer ...

Cloud storage - How long is data kept?

I've been looking at Amazon S3 but no where can I find anything on how long they keep data for if it isn't accessed etc. I therefore assume it's just kept forever, but that seems a bit absurd. Any ideas? Thanks :) ...

With Amazon EC2 and S3, is it possible to do both transfers to AND FROM S3 through EC2, making it free?

This may be a silly question, but seeing as transfers between EC2 and S3 are free as long as within the same region, why isn't it possible to stream all transfers to and from S3 through EC2 and make the transfers completely free? Specifically, I'm looking at Heroku, which is a Ruby on Rails hosting service run on EC2, where bandwidth is...

OpenSource or paid JavaScript based file manager for Amazon S3

Does anyone know of a good JavaScript based file manager that works with Amazon S3 Web Services. I need something like http://ckfinder.com, but that works directly with S3. Something like this would be great: http://s3fm.com I will need both upload and download and it would be nice to have some kind of integration with Amazon S3's ACL s...

Hosting web site images: Flickr PRO, Amazon S3 or...?

Hi all, I'd like to save some of my site monthly bandwidth allocation and I'm wondering if I can use Flickr PRO or I should rely on Amazon S3 as an hosting service for my web site images. (My Web Application allows users to upload their own pictures and at the moment it's managing around 40GB of data) I've never used Amazon's services an...

In what geographical region is my S3 bucket stored?

I have created an Amazon Web Services S3 bucket in the past, without specifying the geographic region for it to be stored in. How do I determine which region the bucket is located in? My reason for asking, is that I am preparing to run some "Amazon Elastic MapReduce" jobs on the data in the bucket, and this service asks me in what regio...

Paperclip S3 download remote images

How I can download a remote image (http protocol, the url is in the image_remote_url attribute) and save it as an attachment to S3 via Paperclip ? class Product < ActiveRecord::Base require 'open-uri' attr_accessor :image_remote_url has_attached_file :photo, :storage => :s3, :s3_credentials => "#{RAILS_ROOT}/config/s3.yml"...

Easy way to upload files to S3 via HTTP Form

I have written a tiny web appication in python that allows me to browse my S3 buckets. The web appication runs inside the Google App Engine. Now, I want to create a html form for this web appication that allows me to upload a file into the bucket. These information are already inside the form: AWSAccessKeyId and the name of the bucket...

How to setup Park Place or other S3 clones

Hi, I'm about to design an application using S3 for storage. Unfortunately, I'm not allowed to use the real service for development. Thus, I've to work with an interface-compatible replacement. I searched a lot and ended up with to solutions: Eucalyptus Walrus and Park Place. However, I have some trouble with both. Walrus does not see...

Hotlinking Twitter avatar images ?

The Twitter API returns this value for the Twitter account 'image_url': http://a1.twimg.com/profile_images/75075164/twitter_bird_profile_bigger.png In my Twitter client webapp, I am considering hotlinking the HTTPS version of avatars which is hosted on Amazon S3 : https://s3.amazonaws.com/twitter_production/profile_images/75075164/twitt...

mod_rewrite to move Wordpress images to Amazon S3

Basically, I'm moving all my images over to s3, but will have tons of old references to old image locations on my website. Looking to rewrite anything in the wp-content/uploads/ folder to an s3 address. Short story is I'm not very good with regular expressions, and have been at it a while already. Any advice or help would be greatly ap...

Background Intelligent Transfer Service and Amazon S3.

Hi I'm using SharpBITS to download file from AmazonS3. > // Create new download job. BitsJob > job = this._bitsManager.CreateJob(jobName, JobType.Download); > // Add file to job. > job.AddFile(downloadFile.RemoteUrl, downloadFile.LocalDestination); > // Resume > job.Resume(); It works for files which do no need authentication. Howeve...

S3 browser upload via POST: unable to handle errors gracefully

I am writing an app where I want the customer to be able to upload to Amazon S3 straight from the browser. I can make this work just fine. But when errors occur, I want to handle them more gracefully than splattering an XML document on the customer's screen. I have a scheme that I think would work, but it's failing. Here's what I'm t...

Basic Questions about Amazon RDS, S3 Storage, and Default RDS Tables

I just created my first database instance on the Amazon RDS service. I was wondering... 1) Is there a way to have Amazon automatically back up my data in a way that it persists even if the instance is deleted? 2) Is it possible to share tables across multiple instances? 3) When I first connected to the instance, I found there were thr...

s3-put fails to send file

Hi, I'm trying to send a file to amazon s3 using the s3-bash scripts. Using this command: ./s3-put -T ./test2 -k <mykey> -s ./<mysecretkeyfile> /mybucketname leads to: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>MalformedXML</Code><Message>The XML you provided was not well-formed or did not validate against our published sc...