We aim to implement a distributed system on a cluster, which will perform resource-consuming image-based computing with heavy storage I/O, having following characteristics: There is a dedicated manager computer node and up to 100 compute nodes. The cluster must be easily expandable. It is built around job-task concept. A job may have o...
Hi All, I have a multi-threaded java application for some research simulations. The lab I am working in has a large linux cluster, as well as a bunch of personal computers. I am a grad student, and have been programming in java for a long time, but I'm not very familiar with clusters. If I run my application on the cluster, will it be ab...
I parallelized a simulation engine in 12 threads to run it on a cluster of 12 nodes(each node running one thread). Since chances of availability of 12 systems is generally less, I also tweaked it for 6 threads(to run on 6 nodes), 4 threads(to run on 4 nodes), 3 threads(to run on 3 nodes), and 2 threads(to run on 2 nodes). I have noticed ...
I am trying to build a pipeline of jobs to be submitted to lsf job queues but the documentation left me somewhat guessing as to how this can be implemented. Let's say I have 3 jobs A, B and C, where B depends on A being finished successfully and C depends on B. I know about the -w option for bsub, with which I can define a dependency su...