amazon-ec2

S3 to EC2 Performance for fetching large numbers of small files

I have a large collection of data chunks sized 1kB (in the order of several hundred million), and need a way to store and query these data chunks. The data chunks are added, but never deleted or updated. Our service is deployed on the S3, EC2 platform. I know Amazon SimpleDB exists, but I want a solution that is platform agnostic (in c...

Latency of requesting a object from S3 to EC2

What's the latency to GET an object from S3 from an EC2 Instance. For example, how many ms before the actual data stream for that object starts streaming back when requesting a object by it's full path. If the object exists on S3 If the object does not exist and to send a 404 Latency, not Throughput. ...

What would be the equivalent of Tomcat for DNS on Linux?

I'm working on migrating to Amazon EC2 for our servers and need to try out internal DNS options. I'm looking for the equivalent of Tomcat (a standard well know easy to use servlet container) in the DNS area. BIND is the only one I'm familiar with by name, but I'm wondering if there are other "better" options or if that's the one I should...

Run startupscript on Fedora 8 Core

Hello. I'm using Amazon EC2 with a Fedora 8 Core AMI. I have an EBS volume mounted at /ebsmnt, and a startupscript located at /ebsmnt/startupscript.sh . Currently I have to login to the server, cd to /ebsmnt/ and run the script manually. How can I make Fedora run this script automatically at startup, without any interaction from me? (by ...

Amazon EC2 usable as a VMware testing platform?

We have the need to perform tests on localized platforms that put some burden on our hardware resources because for just a few weeks we might need plenty of servers and clients (Windows 2003 and Windows 2008, Vista, XP, Red Hat, etc) in multiple languages. We typically have relied on blades with Windows 2003 and VMWare, but sometimes th...

Oracle DB on Amazon's EC2 + EBS

I just installed Oracle on my Amazon's Virtual EC2 Linux (Ubuntu) Server. Because i'm not really familiar with Oracle Database Administration I'm wondering what files and how i need to move to ESB so when i shut down or terminate my instance the data won't be lost. I have found THIS tutorial, but i'm not sure if this is what i need. ...

How can i return and process results from running a .bat file from PHP

I have a PHP script that executes a .bat file using system("cmd /c C:\dir\file.bat"); This launches an AWS server and returns info such as the id of the server started. I need to use this id in the script later on. How can I return the results from the .bat file to PHP and then how can I extract the id from the rest of the results. I...

Can you attach Amazon EBS to multiple instances?

We currently use multiple webservers accessing one mysql server and fileserver. Looking at moving to the cloud, can I use this same setup and attach the EBS to multiple machine instances or what's another solution? ...

Elastic Load Balancing in EC2

Hi Its been on the cards for a while, but now that Amazon have released Elastic Load balancing what are your thoughts on deploying this solution for a high-traffic web app. Should we replace HAProxy or consider ELB as a complimentary service in front of HAProxy Appreciate any comments or suggestions Thanks Dom ...

Memcached on EC2

Am I right in thinking that until I am able to afford dedicated servers or have any spare servers, I could successfully run a small number of memcached servers through EC2? With the annoucement of the new auto-scaling and load balancing by Amazon today, do you guys think this would be a viable option? And what would be the basic techni...

Running apt-get on EC2 without coughing up for a bunch of bandwidth charges

I'm running Ubuntu on EC2 (using the alestic community AMI) and on startup my new instances use up a bunch of bandwidth running apt-get upgrade etc. Bandwidth between EC2 instances is free... anyone know if there's a mirror of the Ubuntu packages somewhere on EC2 I can use instead? ...

Amazon EC2 and EBS using Windows AMIs

I put our application on EC2 (Windows 2003 x64 server) and attached up to 7 EBS volumes. The app is very I/O intensive to storage -- typically we use DAS with NTFS mount points (usually around 32 mount points, each to 1TB drives) so i tried to replicate that using EBS but the I/O rates are bad as in 22MB/s tops. We suspect the NIC card ...

MP3 coversion on Amazon's EC2

I run a small record label and we have a bunch of audio files stored on Amazon's S3. We want them converted to MP3's with a standard bitrate. I read about the NYTimes converting all their PDF's using EC2 and since I'm a nerdy web programmer, I'm intrigued. Instead of downloading all the files and converting them by hand, I'm wondering wh...

Lost modified /etc/hosts file on Amazon EC2 every reboot instance?

I have setup an Ubuntu 8.10 server instance on Amazon EC2. I install ejabberd on server, but I face some problems on ejabberd node can't start because hostname on cloud changes each time we relaunch the instance. After I follow this link http://blog.kenweiner.com/2008/05/ejabberd-on-amazon-ec2-ubuntu-ami.html to edit and add hostname in ...

Is it possible to roll my own Amazon Machine Image with a pre-Windows 2003 OS?

I've been researching EC2 over at Amazon Web Services and the website notes: "You are also empowered to use our bundling tools to upload your own operating systems." Now I've been trying to find out if the only Windows version that is supported is Windows Server 2003 or if I would be able to virtualize an older version of Win...

EC2onRails + SSL + Apache: No response on port 443

Hi, I'm trying to configure SSL on EC2onrails with no luck. At present I am unable to even telnet into my server at port 443, it simply says "trying MY.IP.ADDRESS..." and stays there indefinitely. Telnet into 80 works fine. This was my starting point: groups.google.com/group/ec2-on-rails-discuss/browse_thread/thread/79b60bf683b2365b (a...

Explain what Amazon EC2 is, and can I use it as a web hosting service?

Hello! Goodafternoon, I want to buy an Amazon EC2 instance, is it possible to use it as a web host? Like what other standard web host do. Is it recommended for web hosting? The truth is, I just want to learn this technology. So I'm thinking that I'll just host my website using Amazon EC2 to learn the cloud. And I have projects in the fu...

How to get an EC2 Windows machine's instance-id into a batch variable

I have a batch file that I'd like to run on startup of an EC2 Windows AMI. The program I'd like to run from that batch file takes the instance-id of the EC2 machine as a parameter. What is the simplest way to get that Instance ID passed as an argument to that program? From Amazon's Documentation on the subject, I see that you're suppo...

mounting an s3 bucket in ec2 and using transparently as a mnt point

I have a webapp (call it myapp.com) that allows users to upload files. The webapp will be deployed on Amazon EC2 instance. I would like to serve these files back out to the webapp consumers via an s3 bucket based domain (i.e. uploads.myapp.com). When the user uploads the files, I can easily drop them in into a folder called "site_up...

Google App Engine and Amazon S3 File Uploads

Hi guys, I know this has been asked before but there is really not a clear answer. My problem is I built a file upload script for GAE and only found out after, that you can only store files up to aprox. 1MB in the data store. I can stop you right here if you can tell me that if I enable billing the 1MB limit is history but I doubt it. I...