Improving efficiency of a time consuming program using grid computing

Question

I have a Java program which takes few hours to complete! Now we have to rewrite it using latest in open source which can reducing the time.

I can think of achieving it by using multiple computers and further multiple threads (All configurable). Can you suggest some open source projects to match this requirement?

Answer 1

Go for Java Parallel Processing Framework JPPF .

I have personally used it in one of my project ,

If I have understood your requirement than this is the perfect solution for you.

Answer 2

Also check out Apache's Hadoop. Specifically their MapReduce implementation. You'll have to compare and see what fits your needs best.

Answer 3

Have you looked at Jini and Javaspaces (an implementation of a Tuple Space) ?

Javaspaces make it very easy to implement a scatter/gather grid. You simply push your work units out as serialisable objects into a Javaspace, and run up 'N' consumers to transactionally take those work units, process them, and put them back.

Answer 4

I found Grid Gain easy to use. You could also try using ActiveMQ to distribute compute and a cache to distribute data. There are many options to distribute data and compute for Java. I agree with @bemace, you should compare the various options against your requirements.

Answer 5

You may also consider Hazelcast. There is a comparison of several grid computing frameworks:

http://java.dzone.com/articles/comparison-gridcloud-computing-0