parallel-processing

diameter of a huge graph

I have a huge graph that I would like to process using many machines. I had like to compute if the graph diameter is higher than 50. How would I split the data and I would I write a parallel algorithm that can calculate it? (the return value is boolean) The graph diameter is the greatest distance between any pair of vertices ...

Find a median in parallel

If you have one huge amount of numbers and one hundred computers, How would you find the median of the numbers? ...

How to implement two periodical processes in C++ under Linux?

Hello, I am doing real time programming in C++, under Linux. I have two process, let me say A and B. A process is being started periodically, every 5ms. B process is being started every 10ms. The process A is doing some change of data. The process B is reading that data and displays it. I am confused about how to run periodically pro...

Implementing Load Balancing Using Python

I am doing some research this summer and working on parallelizing pre-existing code. The main focus right now is a way to load balance the code so that it will run more efficient on the cluster. The current task is to make a proof of concept that creates several processes with each one having their own stack available and when the proces...

Automatic parallelization

What is your opinion regarding a project that will try to take a code and split it to threads automatically(maybe compile time, probably in runtime). Take a look at the code below: for(int i=0;i<100;i++) sum1 += rand(100) for(int j=0;j<100;j++) sum2 += rand(100)/2 This kind of code can automatically get split to 2 different thr...

Multithreaded drawing in .NET?

(Edit: to clarify, my main goal is concurrency, but not necessarily for multi-core machines) I'm fairly new to all concepts on concurrency, but I figured out I needed to have parallel drawing routines, for a number of reasons: I wanted to draw different portions of a graphic separatedly (background refreshed less often than foreground...

Does Java have support for multicore processors/parallel processing?

I know that now that most processors have two or more cores, multicore programming is all the rage. Is there functionality to utilize this in Java? I know that Java has a Thread class, but I also know this was around a long time before multicores became popular. If I can make use of multiple cores in Java, what class/technique would I us...

Finally, is it really advantageously to use parallel computing in high-loaded projects?

When I was writing my first server application (independent - with listening port and etc.), I found many examples of parallel-working server apps and perceived it (parallel computing) as a new capacity technology, designed for new time. Now, I found many high load-oriented apps in which specifications their developers paid attentions t...

Concurrent periodic task running

I'm trying to find the best solution for periodic task running in parallel. Requirements: Java (Spring w/o Hibernate). Tasks are being managed by front-end application and stored in MySQL DB (fields: id, frequency (in seconds), <other attributes/settings about task scenario>). -- Something like crontab, only with frequency (seconds) fi...

Rx extensions/parallel task library in .net compact/xna3.1 for xbox360?

Is there any way I can use the .net task parallel library that was included in the Rx extensions for .net 3.5 SP1 in xna 3.1 for xbox 360? Or, alternatively, to use the Rx extensions themselves? The assemblies installed by .net 3.5 SP1 Rx extensions installer do not appear to be compatible with the .net compact framework. Or, if not pos...

Parallel programming in Java

Hey. How can we do Parallel Programming in Java? Is there any special framework for that? How can we make the stuff work? I will tell you guys what I need, think that I am developed a web crawler, its crawl lot of website from the internet, one system crawling will not make things to work proper, so we need 1000 of system to work,if th...

Open Source or Free .NET HPC Implementations

I'm trying to find out how feasible it would be to create a compute grid using Windows XP, Vista and 7 machines. I know that there is already Windows HPC Server 2008 out there, but when looking into the cost it was basically a situation of if you have to ask, you can't afford it. I did find MPI.NET, however this looks like it hasn't be...

Different summation results with Parallel.ForEach

I have a foreach loop that I am parallelizing and I noticed something odd. The code looks like double sum = 0.0; Parallel.ForEach(myCollection, arg => { sum += ComplicatedFunction(arg); }); // Use sum variable below When I use a regular foreach loop I get different results. There may be something deeper down inside the Compli...

web indexer using java

is parallel system or distributed system is good for web site crawler and web indexer which is develop in JAVA,if so which are the available frameworks? ...

Sparse matrix creation in parallel

Are there any algorithms that allow efficient creation (element filling) of sparse (e.g. CSR or coordinate) matrix in parallel? ...

Parallel.ForEach local storage

I recently changed a For Each loop to a Parallel.ForEach loop. I'm concerned about an object being declared outside the loop but assigned while iterating in the loop. Here is the simplified code. Dim results As ModelResults Dim noResultsModel As New List(Of ModelResults) Dim lock As New Object Parallel.ForEach(_modelEngines, Sub(mod...

Multi-node concurrency in Java

I've written a multi-threaded Java program to solve an embarrassingly parallel problem such that it utilizes all the free CPU cycles of on a multi-core CPU. I'd like to refactor my solution so that it can run on multiple nodes while still keeping the majority of the code I've already written. I've used MPI with C in the past and been t...

python multiprocessing does not work

I don't understand why this simple code # file: mp.py from multiprocessing import Process import sys def func(x): print 'works ', x + 2 sys.stdout.flush() p = Process(target= func, args= (2, )) p.start() p.join() p.terminate() print 'done' sys.stdout.flush() creates "pythonw.exe" processes continuously and it doesn't print a...

Demonstrating instruction level parallelism at work

I'm trying to show instruction level parallelism at work. What I was originally doing was using python (willing to change) and doing the following: def test(): for i in range(5000): j = 0 k = 0 l = 0 def test2(): for i in range(5000): j = i * i k = j * 2 l = k * i if __name__=='_...

Pythonistas, please help convert this to utilize Python Threading concepts

Update : For anyone wondering what I went with at the end - I divided the result-set into 4 and ran 4 instances of the same program with one argument each indicating what set to process. It did the trick for me. I also consider PP module. Though it worked, it prefer the same program. Please pitch in if this is a horrible implementation! ...