parallel-processing

Non-trivial private data in Fortran90 OpenMP

I have a section of a Fortran90 program that should be parallelized with OpenMP. !$omp parallel num_threads(8) & !$omp private(j, s, prop_states) & !$omp firstprivate(targets, pulses) ! ... modify something in pulses. targets(s)%ham contains pointers to ! elements of pulses ... do s = 1, n_systems prop_states(s) = targets(s)%...

Is there any Non-blocking IO open source implementation for Scala's actors?

I have quite large files that I need to deal with (500Meg+ zip files). Are there any non-blocking IO open source implementations for Scala's actors? ...

Parallelizing nested loops with dependencies

My question is about how best to structure my (C++) code to support parallelizing a time consuming computation. The pseudocode in question has the following structure: for a_1(y_1) in A_1 for a_2(y_2) in A_2(a_1) ... for a_n(y_n) in A_n(a_1, ..., a_{n-1}) y_n = f(a_1, ..., a_n) y_{n-1} = g_n(Y_n) ... ...

C# Events: How to process event in a parallel manner

I have an event which I would like to have processed in a parallel manner. My idea is to make each callback be added to the ThreadPool, effectivley having each method that registered the event handled by the ThreadPool. My try-out code looks something like the following: Delegate[] delegates = myEvent.GetInvocationList(); IAsyncResult[...

Getting starting with Parallel programming.

Hi guys, So it looks like multicore and all its associated complications are here to stay. I am planning a software project that will definitely benefit from parallelism. The problem is that I have very little experience writing concurrent software. I studied it at University and understand the concepts and theory very well but have zer...

What are some scenarios for which MPI is a better fit than MapReduce?

As far as I understand, MPI gives me much more control over how exactly different nodes in the cluster will communicate. In MapReduce/Hadoop, each node does some computation, exchanges data with other nodes, and then collates its partition of results. Seems simple, but since you can iterate the process, even algorithms like K-means or P...

What are recommended books for Parallelization ?

Hi, From my previous posts, I come to know that today software industry is moving towards more and more of parallelization and I want to learn and understand more about this technology and what are some of the recommended books/resources for Parallelization ? Thanks. ...

Parallel, but slower

I'm using monte carlo method to calculate pi and do a basic experience with parallel programming and openmp the problem is that when i use 1 thread, x iterations, always runs faster than n thread, x iterations. Can anyone tell me why? For example the code runs like this "a.out 1 1000000", where 1 is threads and 1000000 the iterations ...

Why are Asynchronous processes not called Synchronous?

So I'm a little confused by this terminology. Everyone refers to "Asynchronous" computing as running different processes on seperate threads, which gives the illusion that these processes are running at the same time. This is not the definition of the word asynchronous. a⋅syn⋅chro⋅nous –adjective 1. not occurring at the same time. 2...

A python compute cluster!

Would it be possible to make a python cluster, by writing a telnet server, then telnet-ing the commands and output back-and-forth? Has anyone got a better idea for a python compute cluster? PS. Preferably for python 3.x, if anyone knows how. ...

How to parllelize this, using OPENMP sections

Hi, I have this function which i want to parallelize using openmp sections. I broke the function into various sections and applied #pragma omp sections but it gives segmentation fault. Can somebody please explain why and a solution to it. Should i use some clause with sections. Which one and how please. /*! ****************************...

DirectShow Editing Services on multiple machines in parallel?

Is it in any way possible to process at least 1 DShow video project on multiple machines in parallel at the same time for faster rendering or just for fun? In any language? With help of any program? ...

Word Tearing on x86

Under what circumstances is it unsafe to have two different threads simultaneously writing to adjacent elements of the same array on x86? I understand that on some DS9K-like architectures with insane memory models this can cause word tearing, but on x86 single bytes are addressable. For example, in the D programming language real is a...

Multicore make in parallel rather than "threaded" execution?

I have a Makefile to execute a test suite that looks roughly like this: %.diff.png: %.test.png echo '$*: Comparing with good PNG.' %.test.png: %.pdf echo '$*: Converting PDF to PNG.' %.pdf: %.tex echo '$*: Generating PDF output.' with all the echo statements supplemented with the actual tests in the real Makefile. When...

Can Sql Server 2008 Stored Procedures (or Triggers) manually parallel or background some logic?

Hi folks, If i have a stored procedure or a trigger in Sql Server 2008, can it do some sql calculations 'in another non-blocking thread'? ie. something in the background also, can two sql code blocks be ran in parallel? or two stored procs be ran in parallel? for example. Imagine we are given the job calculating the scores for each St...

How to create a system with 1500 servers that deliver results instantaneously?

I want to create a system that delivers user interface response within 100ms, but which requires minutes of computation. Fortunately, I can divide it up into very small pieces, so that I could distribute this to a lot of servers, let's say 1500 servers. The query would be delivered to one of them, which then redistributes to 10-100 other...

How do I get the child process id in Parallel::ForkManager?

use LWP::Simple; use Parallel::ForkManager; @links=( ["http://prdownloads.sourceforge.net/sweethome3d/SweetHome3D-2.1-windows.exe","SweetHome3D-2.1-windows.exe"], ["http://prdownloads.sourceforge.net/sweethome3d/SweetHome3D-2.1-macosx.dmg","SweetHome3D-2.1-macosx.dmg"], ["http://prdownloads.sourceforge.net/sweethome...

Is parallel processing actually possible ?

I have seen new computers having two processors on same motherboard . How can two processors on same motherboard function properly because it will be something like two brains (trying) to control one body, How actually they carry out parallel processing, is it actually does it ? ...

Parallelization of recursive jobs in GNU make

Hi, I am looking for an elegant way for the parallelization of jobs in GNU make. Here is a sample of what I did so far. Make processes the directories dir-1, dir-2 and dir-3 in a serial fashion which is logical but not my intention: SUBDIRS=dir-1 dir-2 dir-3 default: all all: @for dir in $(SUBDIRS); do (cd $$dir; $(MAKE)); done .P...

What was the name of the parallel implementation of Linq (not from Microsoft)

I remember seeing a link about it here where some people claimed it's 1000 times faster than the BCL Linq. Anyone used it here? Is it true? Also is Microsoft's PLinq gonna be along the same lines? Because it seemed to me like the above mentioned Linq was automatically parallel or something. And if that's the case, why isn't Microsoft ...