Java Parallel Processing on cluster systems (cluster computing)

Question

I am developing a web-based application to provide some services. This is a scientific application which performs some processing on data uploaded by users. The methods corresponds to this processing actions are written in Java and they are completely independent. Obviously, the data of the different users are also independent.

I'm looking for a technique to scale this computation on a cluster like MPI in C. I'm searching for the same tool in Java.

Thanks.

I guess setup a HADOOP cluster requires substantial effort, isn't it? — cartoonist
– cartoonist, Commented Jul 31, 2011 at 9:08
There are companies (such as Cloudera) that package up hadoop software for (relatively) easy deployment on EC2. But yes, there is a bit of a learning curve for both using hadoop and managing your clusters. I do not know how it compares to GridGain, as I've never used the latter. — Ray Toal
– Ray Toal, Commented Jul 31, 2011 at 18:18

Grooveek · Accepted Answer · 2011-07-30 08:50:39Z

9

You've got a lot of solutions to scale computings with Java, but the one I prefer, and which has the most straighforward code to begin is Gridgain

You can have a try with Hazelcast which is a data-grid, techniquely, but can be used for remote execution and parallelisation of action on a cluster

If you're searching explicitely for MPI implementation, you should have a look to MPJ

answered Jul 30, 2011 at 8:50

Grooveek

10.1k1 gold badge30 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Java Parallel Processing on cluster systems (cluster computing)

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related