parallel

Book Request: Distributed algorithms

Hey guys. I wanna learn sth about distributed algorithms, so I'm looking for any recommendation for books. I'm more interested in theoretical books, because implementation is just the matter of taste (I will use probably erlang (or c#)). But on the other hand i don't want raw, mathematican analyse of algorithms. Just the idea how sth wor...

Best Practice Instrumenting a Webpage when having parallel tasks

I try to get an understanding of the performance of a web page and use Trace.Write Problem is that I use Parallel.Invoke and starts more threads where I would like to report back using Trace.Write Parallel.Invoke(() => Chart1AndLegend(param), () => Chart2(param), () => Chart3(param), ...

Massively Parallel algorithm to propagate pixels

I'm designing a CUDA app to process some video. The algorithm I'm using calls for filling in blank pixels in a way that's not unlike Conway's game of life: if the pixels around another pixels are all filled and all of similar values, the specific pixel gets filled in with the surrounding value. This iterates until all the number of pixel...

Efficient foreach child evaluation in parallel

I have a list of objects, each with a bool ShouldRun() method on them. I am currently iterating over the list of objects, and checking ShouldRun() on each object, and calling Run() on the first one to return true foreach (child in Children) { if (child.ShouldRun()) { child.Run(); break; } } I would like to do t...

R programming - submitting jobs on a multiple node linux cluster using PBS

I am running R on a multiple node Linux cluster. I would like to run my analysis on R using scripts or batch mode without using parallel computing software such as MPI or snow. I know this can be done by dividing the input data such that each node runs different parts of the data. My question is how do I go about this exactly? I am ...

Python 2.6: parallel parsing with urllib2

Hi there, I'm currently retrieving and parsing pages from a website using urllib2. However, there are many of them (more than 1000), and processing them sequentially is painfully slow. I was hoping there was a way to retrieve and parse pages in a parallel fashion. If that's a good idea, is it possible, and how do I do it? Also, what...

Intel TBB license

I'm a bit confused over the Intel Threading Building Blocks commercial vs open source license. The open source version is licensed under GPLv2 with the runtime exception, but what does that imply in plain english? Can it be used in a commercial, closed source application as long as it just links with the unmodified .dlls? ...

Parallelising Cholesky decomposition for use in training a machine learning algorithm

I am trying to work out if I can parallelise the training aspect of a machine learning algorithm. The computationally expensive part of the training involves Cholesky decomposing a positive-definite matrix (covariance matrix). I'll try and frame the question purely in terms of the matrix algebra. Let me know if you need any more info. L...

IEnumerable yield return combined with .AsParallel()

I've written some code to try and describe my concern: static void Main(string[] args) { IEnumerable<decimal> marks = GetClassMarks(); IEnumerable<Person> students = GetStudents(); students.AsParallel().ForAll(p => GenerateClassReport(p, marks)); Console.ReadKey(); } GetClassMarks uses yield return in it from my weir...

Parallel/Multithread in CMD

I need to run a counter and a timer at the same time, but I'm not sure about how to achieve it. I have a batch file that counts the number of times any key is pressed in an easy loop made by a goto, once its done (keypress) for the first time, it fires a timer for 1 min; the key pressed in that time, must be stored in another variable...

Is there a way to have parallel for-each loops?

Let's say I have 2 lists in Python and I want to loop through each one in parallel - e.g. do something with element 1 for both lists, do something with element 2 for both lists... I know that I can do this by using an index: for listIndex in range(len(list1)): doSomething(list1[listIndex]) doSomething(list2[listIndex]) But is th...

starting TS and TSNoise via batch and closing TSNoise when TS is quit

ok, i know how to start both programs parallel, but i'd like to make TSNoise close on closing TS. atm my .bat is this: @ECHO OFF start /b E:\Programme\teamspeak2RC2\TeamSpeak.exe start /b I:\Programme\TN1.0.4\TS-NOISE.exe ECHO. EXIT ...

C# Parallel Task methods that return value using Func<>

I want to use TASK for running parallel activities.This task returns a value.How do i use a FUNC inside the task for returning a value?.I get an error at Func. Task<Row> source = new Task<Row>(Func<Row> Check = () => { var sFields = ( from c in XFactory.Slot("IdentifierA") where c["SlotID"] == "A100" select n...

Parallel Programming with Tools.

I was looking into Intel's Parallel Studio. It said it is for C & C++ programmers. I know C# 4.0 has a lot of parallelism features. I like a few things in Parallel Studio. Can Parallel Studio be used for C# as well? ...

Nested Parallel.ForEach Loops on the same list?

I need to parallelize a method that does an exhaustive pairwise comparison on elements in a list. The serial implementation is straight-forward: foreach (var element1 in list) foreach (var element2 in list) foo(element1, element2); In this case, foo won't alter the state of element1 or element2. I know it's not safe to sim...

Parallel programming using python's multiprocessing and process defunc

Hi there, I have a problem with creating parallel program using multiprocessing. AFAIK when I start a new process using this module (multiprocessing) I should do "os.wait()" or "childProcess.join()" to get its' exit status. But placing above functions in my program can occur in stopping main process if something happens to child process...

Choosing minimum among minima using Parallel.ForEach

I am new to C#, Parallel.ForEach, and .NET in general. I want to parallelize a search that involves thousands of locations. For each location, I compute great circle distance. That is a calculation I want to spread to different cores. My question is how do I do this if I only have one thread-local variable, as in this MSDN TPL exampl...

Processes, threads, green threads, protothreads, fibers, coroutines: what's the difference?

I'm reading up on concurrency. I've got a bit over my head with terms that have confusingly similar definitions. Namely: Processes Threads "Green threads" Protothreads Fibers Coroutines "Goroutines" in the Go language My impression is that the distinctions rest on (1) whether truly parallel or multiplexed; (2) whether managed at th...

parallel search in CUDA

Are there any CUDA methods/approaches/libraries for search operation, say a integer in an array of million entries ? More of a parallel search approach.. ...

implementing a basic queue/thread process within python

hi.. looking for some eyeballs to verifiy that the following chunk of psuedo python makes sense. i'm looking to spawn a number of threads to implement some inproc functions as fast as possible. the idea is to spawn the threads in the master loop, so the app will run the threads simultaneously in a parallel/concurrent manner chunk of co...