Exploring around S3's UI, it seems they only enjoy file uploads from my local box. Is there a way to push the files directly from my production server to an s3 account?
+2
A:
Amazon doesn't offer a pull service for FTP to S3, and I haven't seen anyone else advertising one either. (It's not a terrible business idea though.)
That having been said, there are a ton of tools to help with this!
A lot of people use something like s3fs with their favorite backup utility (ie, cron + rsync).
Lately, I've had great success with boto and some custom Python scripts. The reason I like this is because it integrates nicely with whatever other services you're running on the box, and gives status updates.
Hope that helps!
Best,
Zach
zach at longtail
2010-07-01 16:07:32
Yah I really wish there was a way to go direct to direct. You can't ssh into Amazon S3 can you?
Trip
2010-07-01 20:43:22
Indeed you can! I've written a shell script that starts up an EC2 instance, connects via SSH, has the EC2 box download data from an FTP site to it's local disk, and then upload the new data to S3.
zach at longtail
2010-07-01 21:32:29
+2
A:
As you've tagged your question ruby-on-rails I will suggest the AWS::S3 gem. I use it myself to copy daily MySQL database dumps from my production server to S3 (blog entry with the details if you're interested).
John Topley
2010-07-01 16:19:06
I did a scp login:login [orig path] [dest path] to my local box, and then i'm going to upload it to my s3. I use the AWS::S3 Gem. But more than the sql db, I've been keeping all user photos on my server directly. Ha! It started getting heavy very fast, so now i'm pulling it all off and on to s3.
Trip
2010-07-01 17:37:28