tags:

views:

23

answers:

0
Q: 

Run code on hundreds of machines, for a couple of seconds?

Say I have a task which can be ideally parallelized and requires 600 CPU-minutes to finish.

  • I can complete it on my workstation in 10 hours.
  • I can launch 10 EC2 instances and complete it in 1 hour.
  • Is there a way I can run it on 100 machines and have it finish in 6 minutes? (and not pay for more)
  • 1000 machines and have it finish in 36 seconds?

Perhaps AppEngine-MapReduce? Is there anyone else selling CPU time in units smaller than 1 hour?

related questions

What's the best way to unit test concurrent Erlang code?
How can i connect two or more machines via tcp cable to form a network grid?
How are you taking advantage of Multicore?
Start stored procedures sequentially or in parallel
Using Parallel.For to test SQL queries and comparison with the ThreadPool
Multithreaded image processing in C++
RT parallel processing in Rails
What is a good textbook for Parallel Computing?
Easy parallelisation
How to wait untill all child processes called by fork() complete?
Free OpenMosix replacement?
What is the easiest way to parallelize my C# program across multiple PCs
Passing values with Parallel Extensions and VB.net
What's the best way of executing tasks in parallel in Ksh and Perl?
What are some practical problems that parallel computing, f#, and GPU-parallel processing might solve.
How to paralleize search for a string in a file with a help of fork? (GNU Linux/g++)
Unit Testing, Deadlocks, and Race Conditions
How would you simply Monitor.TryEnter
How would you simplfy Entering and Exiting a ReaderWriterLock?
Which parallel programming APIs do you use?
How does NUnit (and MSTest) handle tests that change static/shared variables?
MPI for multicore ?
Is it possible that F# will be optimized more than other .Net languages in the future?
What parallel programming model do you recommend today to take advantage of the manycore processors of tomorrow?
What are the current best options for parallelizing a CPU-intensive .NET app?