Does .NET 4 Parallel Extensions include an implementation of a lock-free Producer/Consumer queue? Is there any class or interface to implement which could help me to implement this pattern correctly? Thanks! ...
I've had the need for a multi-threaded data structure that supports these claims: Allows multiple concurrent readers and writers Is sorted Is easy to reason about Fulfilling multiple readers and one writer is a lot easier, but I really would wan't to allow multiple writers. I've been doing research into this area, and I'm aware of ...
I'm looking for a framework / approach to do message passing distributed computation in C++. I've currently got an iterative, single-threaded algorithm that incrementally updates some data model. The updates are literally additive, and I'd like to distribute (or at least parallelize) the computation hereof over as many machines+cores a...
Is it possible to run a particular thread/process on any core we want? Since multi-core systems are available today . Is it possible to assign two (mutually independent ) segments of code run on any core we want to rather than wait for it to be assigned in a round robin fashion? This way we can truly reap the benefits of parallel proces...
I have been looking at using MapReduce to build a parallelized record combining system. The language doesn't matter, I can use a pre-existing library such as Hadoop or build my own if necessary, I'm not worried about that. The problem that I keep running into, however, is that I need the records to be matched on multiple criteria. For e...
I'm looking for a simple implementation of a parallelized (multi-threaded) sort algorithm in C# that can operate on List<T> or Arrays, and possibly using Parallel Extensions but that part isn't strictly necessary. Edit: Frank Krueger provides a good answer, however I wish to convert that example to one that doesn't use LINQ. Also note t...
There is a set of N real-time data-independent tasks. Each of the tasks processes some digital data stream. A data stream for each task comes from an input port and a resulted stream then is being directed to an output port. 1) What is computationally less intensive: tasks in form of the processes or threads? 2) Does best choice depen...
I've had the same need a few times now and wanted to get other thoughts on the right way to structure a solution. The need is to perform some operation on many elements on many threads without needing to have all elements in memory at once, just the ones under computation. As in, Iterables.partition is insufficient because it brings al...
I was wondering if there is any way to get the foreach package in R to use a pre-allocated structure to put results. basically it involves lots of small linalg operations on very big data sets. My non-foreach original code is something like results <- rep(NA,m*l*[big.number]) dim(results) <- c(m,l,[big.number]) for (i in 1:m){ for ...
I have an ASP.NET MVC web application that makes REST style web service calls to other servers. I have a scenario where I am making two HttpWebRequest calls to two separate services. I need them both to complete to continue, but their order doesn't matter. They may take 1-2 seconds each and I am running them in sequence now. Running ...
I have two threads in my application. Is it possible to execute both the threads simultaneously without sleeping any thread? ...
Since Microsoft probably killed all download links to the Parallel Extensions CTP, I am totally lost. I want to specify the max number of tasks running at a certain time, as I want more threads than processors. Any clue how to do this in RX? ...
I've recently started working on a new application which will utilize task parallelism. I have just begun writing a tasking framework, but have recently seen a number of posts on SO regarding the new System.Threading.Tasks namespace which may be useful to me (and I would rather use an existing framework than roll my own). However lookin...
The problem Although the code about which I will talk here I wrote in F#, it is based on the .NET 4 framework, not specifically depending on any particularity of F# (at least it seems so!). I have some pieces of data on my disk that I should update from the network, saving the latest version to the disk: type MyData = { field1 : i...
The application has a CPU intensive long process that currently runs on one server (an EJB method) serially when the client requests it. It’s theoretically possible (from a conceptual point of view) to split that process in N chunks and execute them in parallel, as long as the output of all parallel jobs can be collected and joined toge...
I installed mpi into windows. I can use its libraries. The problem is that in windows when i write mpiexec -n 4 proj.exe into command prompt it does not make the proper operations. 4 different processes uses the whole code file seperately. They dont behave like parallel processes that are working only in the MPI_Init and MPI_Finalize row...
Say I have a task like: for(Object object: objects) { Result result = compute(objects); list.add(result); } What is the easiest way to parallelize each compute() (assuming they are already parallelizable)? I do not need an answer that matches strictly the code above, just a general answer. But if you need more info: my tasks ...
Hi All , I am planning to enhance my knowledge about parallel and concurrent programming. Can somebody help me to find out some online learning resources? Thanks, ...
Well, first I want to say I'm a bit new in the world of Internet dev. Anyway, I'm trying to know if its possible to run two pieces of code in parallel using javascript. What I really need is to call two methods that are in a remote server. I pass, for both, a callback function that will be executed soon the data I want is ready. As t...
I am currently taking a parallel programming class and our first programming exercise was to create four threads that displayed a "hello world" kinda of message. I would like to know what cores are running the threads. I have tried using the TOP command on Unix to display all processes and I do see the 5 different threads, but not sure h...