parallel

iFrames not executing in parallel

We are using 6 iFrames on our page. They fetch data from couple of external web services and an internal WCF service and display the data. There is a separate aspx page built for each of the iFrames. From our perf monitoring we found out that at any point only two threads are executing in parallel. Not all 6 threads get executed. What ca...

Assigning Process to Cores using Perl

Hi Folks, How can I assign processes to specific cores ?. I have a 16 core machine and need to assign processes to multiple cores rather then all/few of them running on same cores. Can Parallel::ForkManager do this ?. or How do you do it with using standard perl distribution ? Any pointers are appreciated. Thanks ...

Demonstrating instruction level parallelism at work

I'm trying to show instruction level parallelism at work. What I was originally doing was using python (willing to change) and doing the following: def test(): for i in range(5000): j = 0 k = 0 l = 0 def test2(): for i in range(5000): j = i * i k = j * 2 l = k * i if __name__=='_...

Physical location aware user space memory allocation in Linux (memory controller affinity)

I want to test the performance variations that may happen if memory is allocated and accessed from different physical CPUs and from different embedded memory controllers for a 64 bit, 2 CPU, 16 core Intel Xeon 5500 CPU based server. (Dell T710) Looking at the vendor white paper i can see each physical CPU has 3 independent memory contro...

Should this be a synchronized method?

I'm using TestNG to run tests in parallel and want to be careful about possible synchronization issues with helper classes and utilities. To my knowledge, each test is its own object, transparently created by the test runner. Thus, I don't need to worry about synchronizing anything non-static, since it would be an object created in a Thr...

Problem with Invoke to parallelize foreach

I have a problem with using System.Threading.Tasks.Parallel.ForEach. The body foreach progressBar want to update. But Invoke method sometimes freeze. I attach the code to the form which is prograssbar and Buton. private void button1_Click(object sender, EventArgs e) { DateTime start = DateTime.Now; pforeach(); Text = (DateT...

.net parallel computing on a computer cluster

I'm running some simulations using Task Parallel Library on .net 4. These simulations run well as parallel on my i7 cpu machine. If i want to utilize other idle PCs too, then what kind of tool or library should I use? Can TPL use other machines' resources if i properly set up? Or should I use something like MPI? ...

C# Is a Parallel foreach while loop possible?

I'm not sure how the internal thread handling of Parallel.foreach works and whether it can guarantee that a construct like this would work? Parallel.Foreach(Connections, c => { Input in = c.getInput(); while (in.hasNext()) { object o = in.getNext(); dosomething(o); } } ); where i...

Yet another C# Deadlock Debugging Question

Hi All, I have a multi-threaded application build in C# using VS2010 Professional. It's quite a large application and we've experienced the classing GUI cross-threading and deadlock issues before, but in the past month we've noticed the appears to lock up when left idle for around 20-30 minutes. The application is irresponsive and alth...

What is OpenMP?

What's a high-level description of OpenMP? The Wikipedia article states that "OpenMP (Open Multi-Processing) is an application programming interface (API) that supports multi-platform shared memory multiprocessing programming in C, C++ and Fortran on many architectures, including Unix and Microsoft Windows platforms. It consists of a se...

Multiple Threads reading from the same file

I have a xml file that needs to be read from many many times. I am trying to use the Parallel.ForEach to speed this processes up since none of that data being read in is relevant as to what order it is being read in. The data is just being used to populate objects. My problem is even though I am opening the file each time in the thread...

MapReduce skipping keys?

I'm running a local, single-system test using Qizmt of a simple MapReduce operation. At the end of the 'Map' phase I am calling: output.Add(rKey, rValue); This is called let's say a million times, and the keys are 1,2,3,4,5,6 etc - each unique (I'm just testing, after all). I've checked that this is happening as intended. It is. The f...

How do I share a transaction across a set of parallel tasks

I have a TransactionScope object and I want to use it for all the tasks created using Parallel.ForEach, how do I achieve this? I want to writing to a message queue in parallel, 20-50 messages, message queue is transactional: using (var queue = new MessageQueue(_exportEndpoint)) { var label = string.Format("{0} ComponentId - {1}...

Good library/platform for a real-time/parallel HTTP crawler?

I am building a crawler that fetches information in parallel from a number of websites in real-time in response to a request for this information from a client. I need to request specific pages from 10-20 websites, parse their contents for specific snippets of information and return this information to the client as fast as possible. I w...

how to run several .cmd files in parallel

Hi I have 4 .cmd files. I want to run then in parallel taking 2 at one time. say my files are : 1.cmd, 2.cmd, 3.cmd, 4.cmd i want to run 1.cmd and 2.cmd in parallel. Now when any of these ends , i want to run 3.cmd and then 4.cmd. In short, at any given time i want 2 of the .cmd files to run. I am using the Start command for parallel...

QStatemachine and parallel states

Dear All, I'm going crazy with QStateMachine wth ParallelState. I've a main state (sequential) which contain a first state, a second state which contains a group of parallel states, and another state that is again sequential. The first state represent a process which create N input files, the second represents N threads which works over ...

Parallel Programming C# 4.0 Task.StartNew

I am trying to process 2 independent tasks using the new .NET 4.0 Task Parallel Library inputList1 is List<CustomObject> inputList2 is List<DateTime> List<double> firstCall = GetDoubleListing(inputList1, inputList2); List<double> secondCall = GetAnotherListing(inputList3, inputList2); inputList2 is common in both the calls ( it is...

If MPI is Message Passing Interface, then what is MPICH ?

Can anyone defines clearly what is MPICH ? For what it is used ? Its relation with MPI. Why do we need MPICH ? ...

Parallelized sorting algorithm, a good choice

Hello buddies! I wanna implement a fast algorithm for a homework, but using parallel processing for this task. I heard that the parallel version of Quicksort is the best choice, but I'm not sure of this... maybe Heapsort is a good idea. Which algorithm do you think is the best one for a parallelized environment, and why? Regards. ...

Multiple simultaneous tcp client connections for performace test

Hi i need to create multiple TCP connections simultaneously to some custom TCP-server application for its performance testing. I know a lot of such for Web (i.e. curl-loader based on libcurl), but I didn't found some general one. Scenario for client is the simplest: create connection, send special data, read the answer and close connecti...