I'm working on a Rails app using attachment_ fu and Amazon S3 storage. Is it possible to make the :s3_ access (a part of the has_attachment options) conditional based on a user input when creating the object. I would like the user to be able if to select if the attachment is authenticated-read or public-read. Is this possible and how w...
This question is for anyone who has actually used Amazon EC2. I'm looking into what it would take to deploy a server there. It looks like I can start in VirtualBox, setup my server and then export the image using the provided ec2-tools. What gets tricky is if I actually want to make configuration changes to my running server, they will...
What's the Fastest way to get a large number of files (relatively small 10-50kB) from Amazon S3 from Python? (In the order of 200,000 - million files). At the moment I am using boto to generate Signed URLs, and using PyCURL to get the files one by one. Would some type of concurrency help? PyCurl.CurlMulti object? I am open to all s...
Hi guys! Here is the thing. Right now I have this e-commerce web site where people can send a lot of pictures for their products. All the images are stored at Amazon's S3. When we need a thumbnail or something, I check over S3 if there is one available. If not, I process one and send it to S3 and display it on the browser. Every differe...
I am pulling my hair out on this one... I am using the ASIHTTPRequest (http://allseeing-i.com/ASIHTTPRequest/) wrapper library for accessing Amazon S3 storage. I am able to connect just fine and grab a listing of buckets without any problems. My frustration is with trying to UPLOAD (PUT and/or POST) a new object (a photo) to an existing ...
I'm trying to play with Google Web Toolkit (GWT 1.6) on Google AppEngine with Java (GAE/J) and I have encountered problem storing data files to GAE. So I have decided to use S3 to store my files but when I googled, I've found library called gwt-s3 that allows me to store File to S3 using GWT, but the problem is that it only allows storin...
I need to provide a utility on a PHP site for a client to upload files to an amazon S3 bucket. Are there any open source utilities available that I can use? ideally, this utility would allow the client to select a local file, press the upload button, and then would tell him the URL of the newly uploaded file. Bonus points if this can ...
Hi there, is there any way to update files stored on Amazon's CDN service? Seems like it won't take any update of a file we make (eg. removing the file and storing the new one with the same file name as before). Do I have to explicitly trigger an update process to remove the files from the edge servers to get the new file contents publi...
I’m currently developing an application that will be heavy on images, that I hope to host “in the cloud” It’s a c# / asp.net application. So i'm considering using Amazon S3 for storing the images. That bit’s fine. However, i'm considering using EC2 to host the application on. The application uses SQL server (only on a fairly basic l...
I'm developing a Ruby on Rails application that needs to allow the user to simultaneously upload 16 high-quality images at once. This often means somewhere around 10-20 megabytes (sometimes more), but it's the number of connections that are becoming the most pertinent issue. The images are being sent to Amazon S3 from Paperclip, which ...
I'm building app that will store large video files to the server and then user will be able to view them. For my app I'm using GWT + GAE/J and to store files I would like to use S3 account. But as we know that you can upload max 10mb to GAE. I have asked this kind of question before and the answer that I have accepted will work only if y...
I tried a couple of things: S3Browse, the RightAws Ruby gem and other tools. All allow granting access on an individual key basis, but I wasn't able to set the ACL on buckets. Actually, I set the ACL on the bucket, no errors are returned. But when I refresh or check in another tool, the bucket's ACL is reset to owner only. I want to g...
I've read over the agreements several times, and I can't find anything that guarantees Amazon will not lose or corrupt your data. Do they make any such guarantees? Can I trust S3 as my long term backup storage? ...
I am developing a system that is all about media archiving, searching, uploading, distributing and thus about handling BLOBs. I am currently trying to find out the best way how to handle the BLOB's. I have limited resources for high end servers with a lot of memory and huge disks, but I can access a large array of medium performance off...
I just read tons of material on Amazon's S3 and CouchDB. Maybe not enough yet though, so here is my question: Both systems sound very appealing to me. CouchDB is distributed using the Apache License V2 and with Amazon's S3, you pay per stored megabyte and the traffic you generate. So there is a bit of a difference monetarily. But from...
I have a rails app with Video and Image models. Both use SWFUpload for progress indication feedback and queued uploading. So they are uploaded to a TempImage, and TempVideo model then when the ActiveRecord Video and Image models are saved the temps are moved over. On the images the different styles are created with the default paperc...
Does anyone know of a client implementation for the S3 REST API that will work on J2ME? All the implementations I can find is only targeted for J2SE. I do not want to use the SOAP API, because I think REST will be faster (partly because you don't need to BASE64 encode the payload). Edit: Part of the problem seems to be that J2ME does n...
I'm Looking at using Amazon S3 and simpleDB in a desktop application. The main issue I have is that I either need to store my aws credentials in the application or use some other scheme. I'm guessing that storing them in the application is out of the question as they would be easily picked out. Another option is to create a web serv...
I am looking for a way to dynamically stream download a zip of files from Amazon S3. The application is hosted on EC2 and the files are stored on S3. Need to give users the ability to select from a group of files which will then get bundled up and downloaded to them. Have heard about a few Actionscript libraries (aszip and fzip) tha...
HI there: I m a software developer and as (probably) most of you, have an app that has data that i want to back up to a different location. I created this little application that will back up my data every so often and then keep a copy to ourselves and do another copy and upload it to S3. The "customer" (ie the actual owner of this d...