parallel-processing

[.NET] Monitor multiple windows service instances in a cluster of machine.

I have implemented a windows service application that will be deployed to multiple machines and run concurrently to process tasks in a central queue. I have a log file for each instance of service running. But I want to be able to monitor all instances of the service and retrieve application specific information, such as Name and ID of t...

ASP.NET Single Worker Thread? (In Memory Session)

I'm using in memory sessions in my ASP.NET MVC application which means that I can only have one single worker thread correct? Does this mean I have parallel processing in my application (think concurrent requests) or not? Does my application accept only 1 request at a time? Edit: According to the IIS7 web site: If the application use...

Java framework/tool for simple distributed computing problem

Hi We generate pdf files with data regarding monthly financial balance of tens of thousands of clients. At it's peak (100.000 files at the end of year), the process may take as long as 5 days to complete using distribute the load between 5 servers. The distribution of workload is a manual process (eg. server 1 generates pdf for clients ...

Turn off OpenMP

Hi, In my C++ program, I'd like to run its executable sometimes with and sometimes without using OpenMP (i.e. multi-threading or single-threading). I am considering any of the following two cases how my code is using OpenMP: (1) Assume that my code is only having #include <omp.h> and OpenMP directives. (2) Same as (1) and my code furt...

Why should I use Grand Central Dispatch over OpenMP?

Apple introduced Grand Central Dispatch (a thread pool) in Snow Leopard, but haven't gone into why one should use it over OpenMP, which is cross-platform and also works on Leopard. They're both pretty easy to use and look similar in capability. So, any ideas? ...

Executing a simple task on another thread in scala

I was wondering if there was a way to execute very simple tasks on another thread in scala that does not have a lot of overhead? Basically I would like to make a global 'executor' that can handle executing an arbitrary number of tasks. I can then use the executor to build up additional constructs. Additionally it would be nice if block...

Is there a parallel processing implementation of HashMap available to Java? Is it even possible?

Searching for the magic ParallelHashMap class More succinctly, can you use multiple threads to speed up HashMap lookups? Are there any implementations out there that do this already? In my project, we need to maintain a large map of objects in memory. We never modify the map after it is created, so the map is strictly read-only. Howeve...

Best way to decouple (for parallel processing) a web application's non-immediate processes?

Hello, I'm looking for a good strategy to truly decouple, for parallel processing, my web application's (ASP.NET MVC/C#) non-immediate processes. I define non-immediate as everything that doesn't require to be done right away to render a page or update information. Those processes include sending email, updating some internal statisti...

Parallel Programming and Numerical Methods References / Books

I am looking for strong references on parallel computing and numerical methods. While there are a lot of questions and posted references on these topics independently, I would like to find a body of knowledge dedicated to their intersection. For example What algorithms (such as an eigen decomposition or a matrix inverse) are well sui...

How to make R use all processors?

I have a quad-core laptop running Windows XP, but looking at Task Manager R only ever seems to use one processor at a time. How can I make R use all four processors and speed up my R programs? ...

How to scale cholesky factorization on multiple GPUs

Hello folks, I have implemented Cholesky Factorization for solving large linear equation on GPU using ATI Stream SDK. Now I want to exploit computation power of more and more GPUs and I want to run this code on multiple GPUs. Currently I have One Machine and One GPU installed on it and cholesky factorization is running properly. I want...

ATI Stream SDK on ubuntu 9.04

Hello All, I have used ATI Stream SDK on windows XP SP3 and implemented one algorithm on GPU. But Now I am interested in scaling this algorithm on multiple GPUs on mutiple machines I switched to UBUNTU to use MPI ( To send messages ). I googled this but I got references for installation on SLES and RHEL but I am looking for UBUNTU 9.04...

Grand Central Dispatch versus Cilk++

Anybody have any thoughts on Grand Central Dispatch (which has now been open-sourced by Apple) and Cilk++? Comparisons/contrasts? Is Cilk more Windows-only? ...

Oracle parallel query - How to find out actual number of spawned processes?

I am using Oracle parallel query feature on a 10G 3-node RAC where each node is a 16-CPU machine. The question is, how can I see the actual number of Oracle processes spawned to execute the query on all 3 nodes? ...

How can I use foreach with snow, to allow multicore on windows XP (in R).

could you please give an example on how that might be done using the doSNOW ? (I asked the same question here: http://blog.revolution-computing.com/2009/08/parallel-programming-with-foreach-and-snow.html And got only a partial reply) Tal ...

Just how good is VTK?

I have heard some good reviews oF Visualization ToolKit(VTK) from developers. But, exactly how powerful is it? For example, can it handle visualization of an entire oil reservoir (in a simulator) with billions of grids?? Most industrial reservoir simulators run on parallel processors. I know VTK supports parallel processing, but again h...

Multi threaded FFTW 3.1.2 on a shared memory computer

I use FFTW 3.1.2 with Fortran to perform real to complex and complex to real FFTs. It works perfectly on one thread. Unfortunately I have some problems when I use the multi-threaded FFTW on a 32 CPU shared memory computer. I have two plans, one for 9 real to complex FFT and one for 9 complex to real FFT (size of each real field: 512*512...

Non-linear scaling of .NET operations on multi-core machine

I've encountered a strange behavior in a .NET application that performs some highly parallel processing on a set of in-memory data. When run on a multi-core processor (IntelCore2 Quad Q6600 2.4GHz) it exhibits non-linear scaling as multiple threads are kicked off to process the data. When run as a non-multithreaded loop on a single cor...

How to create Chrome like application in Delphi which runs multiple processes inside one Window?

Is it possible to create an "application group" which would run under one window, but in separate processes, like in Chrome browser? I'd like to divide one application into multiple parts, so that one crashing or jamming process cannot take down others, but still keep the look and feel as close to original system as possible. I know the...

A question about parallelizing a task

Hello all, I have a question about parallelization: I have two datasets. Dataset1 has m rows and k columns, Dataset2 has n rows and k columns.(m > n) My program reads those datasets from files and store them in the memory. The task is to take each instance of Dataset1(let's call this query instance) and compare with all instances of Da...