The Spread Toolkit (http://www.spread.org) allows for easy distributed messaging using publish-subscribe semantics. Is it possible to use this toolkit on EC2? What other pub-sub message buses can be used on EC2 (other than Amazon's SQS)? ...
SMTP is a whole new ballgame for me, but I am reading up on it. I am attempting to send email from my EC2 instance using GoDaddy's SMTP server. My domain name is registered through GoDaddy and I have 2 email accounts with them. I can successfully send the email from my dev box no problem. my web.config <system.net> <mailSettings...
Hello Guys! I have been trying to install ejabberd server on Amazons EC2 instance. I am kinds a stuck at this step right now. I am following this guide: http://tdewolf.blogspot.com/2009/07/clustering-ejabberd-nodes-using-mnes... From the guide I have sucessfully completed the Set up First Node (on ejabberd1) part. But am stuck in part 4 ...
I am working on a project that involves gps data collection from many users (say 1000) every second (while they move). I am planning on using a dedicated database instance on EC2 with the mysql persistent block storage and run a ruby on rails application with nginx frontend. I haven't worked on such data collection application before. A...
We have a server solution written entirely in unmanaged Visual C++. It contains complicated methods for really heavy data processing. The whole thing contains millions lines of code, so rewritning it all in some other language is not an option. We could write some extra code or make isolated changes, but rewriting everything is out of t...
I am doing a project in the university which requires running of multiple instances (1000s) of a program I've written (in C++), which runs for quite a while (say 2 hours). The program is very self contained - it does not require input files, and the only dependency I think is boost. I'm currently using the university-owned cluster of co...
I like to develop locally on my laptop, but want to deploy to EC2/Rightscale. What's the best way to load a rightscale or ec2 AMI onto my local desktop so that i can have a mirror copy of the cloud operating environment that I can develop against? ...
I need to run a web crawler and I want to do it from EC2 because I want the HTTP requests to come from different IP ranges so I don't get blocked. So I thought distributing this on EC2 instances might help, but I can't find any information about what the outbound IP range will be. I don't want to go to the trouble of figuring out the e...
I am starting a new project for a client from the academic sector. We are trying to choose the right technology for the project and I am interested in hiring Django or Rails developers to work on it (as there will be some custom module development involved). The client wants to be able to sign up with a reliable service package after lau...
I mounted volume by following it gets mounted but files get lost after stop. mkfs -t ext2 /dev/sdb mkdir /mnt/myVol mount /dev/sdb /mnt/myVol ...
What libraries or services exist to run logistic or linear regressions in a distributed fashion on cloud providers like EC2? Alternatively, what Ordinary Least Squares regression libraries exist for cloud distribution? The data set is far larger than can fit in memory - so the library must handle this constraint. ...
we are currently developing a high traffic rails application with facebooker (facebook game). since amazon simpledb (aws-sdb) is really slow, we are thinking of using a dedicated mongodb server as offered by mongoHQ for example. questions: what is the read/writes peak value for a mongodb server running on a amazon ec2 instance? what w...
I found this article explaining how to run MySQL on Amazon EC2. It talks about using XFS as the filesystem and then leveraging EBS snapshots to create backups of the data. Does anyone know if I can do something similar using PostgreSQL? Are there changes to the SQL commands to FLUSH and LOCK the tables? Thanks! ...
Hi, I have setup a Hadoop cluster containing 5 nodes on Amazon EC2. Now, when i login into the Master node and submit the following command bin/hadoop jar <program>.jar <arg1> <arg2> <path/to/input/file/on/S3> It throws the following errors (not at the same time.) The first error is thrown when i don't replace the slashes with '%2F' ...
The ec2-describe-instances command is not very helpful in distinguishing the instances. Are there command line tools that give a better overview? Perhaps somewhat like http://github.com/newbamboo/manec2 but with support for different regions etc. ...
What gives best performance for running PostgreSQL on EC2? EBS in RAID? PGData on /mnt? Do you have any preferences or experiences? Main "plus" for running pgsql on EBS is switching from one to another instances. Can this be the reason to be slower that /mnt partition? PS. im running postgresql 8.4 with datas/size about 50G, amazon ec2...
I'm trying to use autoscaling to create new EC2 instances whenever average CPU load on existing instances goes high. Here's the situation: I'm setting up autoscaling using this boto script (with keys and image names removed). http://balti.ukcod.org.uk/~francis/tmp/start_scaling_ptdaemon.nokeys.py I've got min_size set to 2, and the Au...
I am trying to get a feel for the costs imposed by running apache on AWS continually. Assuming that the service is scarcely used, does anyone know how many cpu hours that would eat up in a month just by sitting there and running? I understand that this is slightly impractical but I am trying to figure out what the cost of entry is to dep...
Hi, I would like to move my application on EC2. I would like to know the AMI Image which has Linux(Preferably Ubuntu),PHP 5,MemCached, eAccelerator or XCache. Please advise. Regards, Mugil. ...
I created a new ebs backed EC2-instance and the necessary key-pair. Now I am able to connect to the instance as ubuntu user. Once i did that I created another user and added it to the sudoers list but I am unable to connect to the instance as the new user I created. I get the following error. I am using the same key to connect with the ...