parallel-processing

Workload Distribution / Parallel Execution in JAVA

Dear All, I have a situation here where I need to distribute work over to multiple JAVA processes running in different JVMs, probably different machines. Lets say I have a table with records 1 to 1000. I am looking for work to be collected and distributed is sets of 10. Lets say records 1-10 to workerOne. Then records 11-20 to workerT...

Example of a parallel acceleration anomaly

What is an example of a parallel acceleration anomaly? ie. A task that when run over p processors, results in a speedup greater than p. ...

Concurrency vs Parallelism - What is the difference?

Concurrency vs Parallelism - What is the difference? Any examples ...

Using PLINQ to speed-up calls to external services

Possible Duplicate: Parallel Linq - Use more threads than processors (for non-CPU bound tasks) Hello. I wondering how to use PLINQ to speed-up crawling of web-pages. I have a list of objects that is should be posted to web page. Doing it in one thread is a bit slowly. I have tried to enroll processing loop using PLINQ's Parall...

Parallel MATLAB and logging

I am running an experiment distributed over several computers using the Parallel computing toolbox. I want to be able to produce a log of the progress of the experiment (or of any error occurring) and save this info in a file while the processes are running. What is the standard way to do it? EDIT: I use embarrassingly parallel I want...

MPI using C++

Hi, I have a program, that is been implemented in C++, now I want to add MPI support. The point is exist a MPI bind for C++, with namespace MPI and everything. In my case I have a specific object that is suitable to be the parallelized process into the cluster. Question, does anyone already did something like this ? Can give some advic...

What is best module for parallel processing in Perl?

What is best module for parallel process in Perl? I have never done the parallel processing in Perl. What is good Perl module for parallel process which is going to used in DB access and mailing ? I have looked in module Parallel::ForkManager. Any idea appreciated. ...

C# Monte Carlo Incremental Risk Calculation optimisation, random numbers, parallel execution

My current task is to optimise a Monte Carlo Simulation that calculates Capital Adequacy figures by region for a set of Obligors. It is running about 10 x too slow for where it will need to be in production and number or daily runs required. Additionally the granularity of the result figures will need to be improved down to desk possib...

Parallel Dynamic Programming

Are there any good papers discussing how to take a dynamic program and parallelize it? ...

c# migrate a single threaded app to multi-threaded, parallel execution, monte carlo simulation

I've been tasked with taking an existing single threaded monte carlo simulation and optimising it. This is a c# console app, no db access it loads data once from a csv file and writes it out at the end, so it's pretty much just CPU bound, also only uses about 50mb of memory. I've run it through Jetbrains dotTrace profiler. Of total exec...

gui for mpi program

Hi, I have a problem about a simple mpi program.This program have some 3D points and these points are moving during the program. I created an simple code by implemented c++ and then I tried to add an simple gui. I used gnuplot library and I have a problem. When I call the gui function the gui is created and it is disappeared at the same ...

What future does the GPU have in computing?

Your CPU may be a quad-core, but did you know that some graphics cards today have over 200 cores? We've already seen what GPU's in today's graphics cards can do when it comes to graphics. Now they can be used for non-graphical tasks as well, and in my opinion the results are nothing short of amazing. An algorithm that lends itself wel...

How does the MapReduce sort algorithm work?

Hi, One of the main examples that is used in demonstrating the power of MapReduce is the Terasort benchmark. I'm having trouble understanding the basics of the sorting algorithm used in the MapReduce environment. To me sorting simply involves determining the relative position of an element in relationship to all other elements. So sor...

Parallelize A Batch Application

I am currently working on an application that parses huge XML files. For each file, there will be different processes but all of them will be parsed into a single object model. Currently, the objects parsed from each XML file will go into a single collection. This collection is also used during parsing, e.g. if a similar object alread...

Why am I not able to query a database from a forked child in Perl?

I have tried with Perl fork manager and DBI . But i got the error DBD::mysql::st execute failed: Lost connection to MySQL server during query . Here the sample code: I want make query between low to high value (i have spitted int 10k records) use Parallel::ForkManager; my $pm = new Parallel::ForkManager(50); my $db = krish::DB->new or...

SQL Server & update (or insert) parallelism

Dear Boffins I got a large conversion job- 299Gb of JPEG images, already in the database, into thumbnail equivalents for reporting and bandwidth purposes. I've written a thread safe SQLCLR function to do the business of re-sampling the images, lovely job. Problem is, when I execute it in an UPDATE statement (from the PhotoData field ...

Is it possible to execute MIMD with OpenCL framework?

Hello: Soon enough we will have nVidia GTX 300 that would be able to execute multiple instrucions on multiple data (MIMD). I wonder if OpenCL can execute MIMD? ...

Parallel software?

What is the meaning of "parallel software" and what are the differences between "parallel software" and "regular software"? What are its advantages and disadvantages? Does writing "parallel software" require a specific hardware or programming language ? ...

How to detect which mutex gives largest amount of time to the OS?

How to measure amount of time given by a mutex to the OS? The main goal is to detect a mutex, that blocks threads for largest amount of time. PS: I tried oprofile. It reports 30% of time spent inside vmlinux/.poll_idle. This is unexpected, because the app is designed to take 100% of its core. Therefore, I'm suspecting, that the time is ...

What is the most efficient way to make multiple (parallel) requests against a web service using WCF?

I have a WCF service client and it was generated using the /async argument with svcutil.exe, so it uses the asynchronous programming model. When I make multiple asynchronous requests with a single client though it serializes the execution of those requests. Here is an example that shows how I am executing the parellel requests. [TestM...