amazon-s3

Parallel uploading to Amazon S3 using Ruby and amazon.rubyforge.org

Hi, I am using Amazon S3 service to upload different directories (and the files inside) to different buckets (directory -> bucket). I am coding in Ruby, and I am using the lib http://amazon.rubyforge.org. The files are small (about 20KB). I'd like to upload the directories in parallel (using many threads) but I have to use synchronize ...

Deploy my css and javascripts with capistrano to amazon S3

I have account in amazon S3 and i use this just for my css and javascripts and photos like a CDN. I want a task capistrano for send my javascripts and css and photos to my bucket in amazon s3. How I do ? tahnks. thanks you John Topley Based in your code i did as below. configure you config/s3.yaml access_key_id: secret_access_key: bu...

Planning the development of a scalable web application

We have created a product that potentially will generate tons of requests for a data file that resides on our server. Currently we have a shared hosting server that runs a PHP script to query the DB and generate the data file for each user request. This is not efficient and has not been a problem so far but we want to move to a more scal...

Stop an in-progress query-string-authorized download on Amazon S3?

With Amazon S3, can I stop a query-string-authorized download that is in progress? Are there other file download services that provide such a feature? ...

Balancing browser caching of images and time expiration of links to avoid bandwidth theft

We host our images on Amazon S3, and serve them through Amazon Cloudfront. We'd like to reduce our bandwidth expenses. We believe that we have quite a bit of bandwidth theft, and want to start using signed URLs to prevent this. However, we have to balance this against the fact that each time we send out a new signed url, it invalidate...

Using FFmpeg to encode audio once uploaded, using Django, VPS (Linux) and Amazon S3

My project will require users to upload uncompressed WAV audio files and once they do, the server will need to encode it in MP3 to serve it on the site. I'm using Django for this project and it'll be hosted on a Linux VPS (from Linode). Due to space and bandwidth, I want to use Amazon S3. I'm not an expert at this stuff, this project wi...

How can I monitor the bandwidth of an object in the Amazon S3 sevice?

How can programmatically monitor the bandwidth of an object in AWS S3 service? I would like to do this to prevent excessive bandwidth usage by clients who are using our services and costing us more than we can afford. We like to limit 1TB bandwidth for each object. ...

where is the C# documentation on Amazon S3?

I'm creating an application that uses amazon s3 for storage in C#. It may be seen to be a stupid question. Where is the documentation on C# aws library? I'm really like some documentation on the functions calls I've been using. Thanks. ...

Amazon S3 Missing Files

We're working on developing user widgets that our members can embed on their websites and blogs. To reduce the load on our servers we'd like to be able to compile the necessary data file for each user ahead of time and store it on our Amazon S3 account. While that sounds simple enough, I'm hoping there might be a way for S3 to automatic...

Offline Amazon S3

So I would like to try using Heroku to be my server, however heroku does not allow writing to it's file system. Instead I need to use the database and something like Amazon S3 for storage of things like uploaded images. The problem is that I often don't have internet access when developing. Or very poor internet access. So developing fo...

How do I translate "File.open" to be S3 compatible?

I have this line.. @organization.search_image = File.open(@photo.photo.path(:original)) Except that 's looking for something local, and all my photos are on S3 now. How would I translate that to opening a file on S3? ...

Are there any examples/instructions on how to use AWS S3 with CKFinder?

I want to use AWS's S3 service to host files and images for my site, but I also want to use CKEditor & CKFinder for the editor. Are there any examples of integrating AWS & CKFinder? ...

what's best way to check if a S3 object exists?

Currently, I make a GetObjectMetaDataRequest, if the GetObjectMetaDataResponse throw an exception means the object doesn't exist. Is there a better way to check whether the file exists without downloading the file. ...

Amazon S3 Browser Based Upload - Prevent Overwrites

We are using Amazon S3 for images on our website and users upload the images/files directly to S3 through our website. In our policy file we ensure it "begins-with" "upload/". Anyone is able to see the full urls of these images since they are publicly readable images after they are uploaded. Could a hacker come in and use the policy d...

When to use Amazon Cloudfront or S3

Are there use cases that lend themselves better to Amazon cloudfront over s3 or the other way around? I'm trying to understand the difference between the 2 through examples. ...

Ruby: Paperclip, S3, and Deep-cloning

What I have is a Theme model, which contains many Assets. Assets are using Paperclip and storing their file content in my Amazon AWS-S3 system. I'm also using deep_clone because my customers have the ability to copy built in Themes and then modify them to their hearts content. All the deep_clone stuff is working great, but when I deep...

How to solve problem with refreashing our uploaded content on Amazon S3?

Hi, We have a problem with refreashing our uploaded content on Amazon S3. We are keeping our software updates on amazon s3. We overwrite old version of our software by new versions on S3. Sometimes our users get old verions of files, when new versions already uploaded and new files located on S3 more then 10 hours already Step by step ...

Does each cloud instance have its own IP

For a cloud instance that runs Apache, I'm guessing the cloud has an IP address. One of the benefits of using a cloud is scaling, but I'm not sure how that scaling happens. I thought that new instances are created automatically to accommodate rise in traffic. IF that's correct (correct me if I'm wrong), then does that mean that each ne...

Quick way to list all files in Amazon S3 bucket?

I have an amazon s3 bucket that has tens of thousands of filenames in it. What's the easiest way to get a text file that lists all the filenames in the bucket? ...

simple text to image solution for rails

Before I start rolling my own using Rmagick I though i'd ask as this is probably a quite common use case. I have a few hundred email addresses which I would like to display to the user for each entry however I would like to avoid displaying the emails as plain text to avoid scraping, so I'm looking for some text-to-image solution. It ...