parallel-processing

Atomic or Gigantic

If you are planning to write a very parallel application in C#, is it better to build things very small, like 20 small classes, making 40 larger classes, and together making 60 more, for a total of 120 or gigantic like: making these 60 classes individually (still with reusability in mind). So in #2 these 60 classes can contain method...

What can make a program run slower when using more threads?

This question is about the same program I previously asked about. To recap, I have a program with a loop structure like this: for (int i1 = 0; i1 < N; i1++) for (int i2 = 0; i2 < N; i2++) for (int i3 = 0; i3 < N; i3++) for (int i4 = 0; i4 < N; i4++) histogram[bin_index(i1, i2, i3, i4)] += 1; bin_index is a complete...

How to reduce CPU usage of a program?

I wrote a multi-threaded program which does some CPU heavy computation with a lot of floating point operations. More specifically, it's a program which compares animation sequences frame by frame. I.e. it compares frame data from animation A with all the frames in animation B, for all frames in animation A. I carry out this intensive ope...

Are functional languages inherently more parallelizable than their OO or imperative cousins?

I've been reading and thinking a fair bit about this. The buzz seems to be that in the multi-core future, functional languages will become more popular. I'm a relative noob to functional programming. My only exposure was academic, and nothing complicated enough to really put this class of language through its paces. So, as I understand ...

unix-fork-monitor-child-progress

I have an application where a bit of parallel processing would be of benefit. For the purposes of the discussion, let's say there is a directory with 10 text files in it, and I want to start a program, that forks off 10 processes, each taking one of the files, and uppercasing the contents of the file. I acknowledge that the parent progr...

Are lambda expressions multi-threaded?

Are lambda expressions multi-threaded? Say when you write a mathematical formula as a lambda method, when you pass it to another method, would it be multi-threaded? ...

D2010 Beta: The Perfect Way to support Multi-Core

In my previous question about the expected features in the new D2010 one of the highest rated answers was 'Multi-Core Support'. Well, as we all know Delphi support thread programming since D2 (IIRC) and is used heavily in some areas. More specifically which is, in your opinion, the perfect way to support parallel programming in Delphi?...

What are some hints that an algorithm should parallelized?

My experience thus far has shown me that even with multi-core processors, parallelizing an algorithm won't always speed it up noticably. In fact, sometimes it can slow things down. What are some good hints that an algorithm can be sped up significantly by being parallelized? (Of course given the caveats with premature optimization...

Parallel execution of shell processes

Is there a tool available to execute several process in parallel in a Windows batch file? I have found some interesting tools for Linux (parallel and PPSS), however, I would need a tool for Windows platforms. Bonus: It would be great if the tool also allowed to distribute processes in an easy way among several machines, running the pro...

Does F# provide you automatic parallelism?

By this I meant: when you design your app side effects free, etc, will F# code be automatically distributed across all cores? ...

Take advantage of multiple cores executing SQL statements

Hi I have a small application that reads XML files and inserts the information on a SQL DB. There are ~ 300 000 files to import, each one with ~ 1000 records. I started the application on 20% of the files and it has been running for 18 hours now, I hope I can improve this time for the rest of the files. I'm not using a multi-thread a...

What type of problems can mapreduce solve?

Is there a theoretical analysis available which describes what kind of problems mapreduce can solve? ...

PHP Daemon/worker environment

Problem: I want to implement several php-worker processes who are listening on a MQ-server queue for asynchronous jobs. The problem now is that simply running this processes as daemons on a server doesn't really give me any level of control over the instances (Load, Status, locked up)...except maybe for dumping ps -aux. Because of that I...

transaction management with common-j components

We have a Websphere JEE application that requires parallelization, for which we're looking to use CommonJ work components. Each 'thread' would require its own view onto data coming from a database. Most of this would be pre-fetched, but it would still need to go to the database to get some. We anticipate that the duration of the overa...

How to code parallel computing process in C# 4.0

How to achieve parallel computing process in C# 4.0. ...

MPI Genetic Monte Carlo Algorithm Resources?

I have been working with some friends to convert a Matlab Genetic Algorithm to C++ and it works in a sequential order currently. Matlab is no longer a portion of our current code. We are looking to use it on a cluster, but have been a little dry on resources. We have a cluster available at the University and it is equipped with Rocks ...

How can you run a process on another computer in .net

Let's say I have a windows service called "MyService" and an executable called "MyEXE" located on serveral computers on my network. Is it possible (from within "MyService") to start several instances of "MyEXE" on a diffrent/same computer, have it do some task and return a true/false result to a callback method in "MyService"? Somethin...

CPU Cards for Parallel Computation?

I remember reading some time ago that there were cpu cards for systems to add additional processing power to do mass parallelization. Anyone have any experience on this and any resources to get looking into the hardware and software aspects of the project? Is this technology inferior to a traditional cluster? Is it more power consciou...

Threading vs Parallelism, how do they differ?

What is the difference between threading and parallelism? Which one has advantage over the other? ...

What's the opposite of "embarrassingly parallel"?

According to Wikipedia, an "embarrassingly parallel" problem is one for which little or no effort is required to separate the problem into a number of parallel tasks. Raytracing is often cited as an example because each ray can, in principle, be processed in parallel. Obviously, some problems are much harder to parallelize. Some may eve...