parallel-processing

Improving efficiency of a time consuming program using grid computing

I have a Java program which takes few hours to complete! Now we have to rewrite it using latest in open source which can reducing the time. I can think of achieving it by using multiple computers and further multiple threads (All configurable). Can you suggest some open source projects to match this requirement? ...

Parallel optimization of a checksum algorithm ?

Hello All, The below code sample is an implementation of CRC-CCITT that I'm using in one of my projects. public static unsafe ushort CRC(byte * it, byte * end) { unchecked { ushort crc = 0xFFFF; ushort quick = 0; for (;;) ...

Algorithm to transform a workflow DAG into parallel resource allocation?

Say I have a graph where nodes are workloads of various kinds and edges are dependencies between the workloads. (This is a DAG since cyclical dependencies must not exist.) I also have a set of multiple agents who can perform the work. Some workload varieties may be given to any agent, others must be given to a specific agent, and other...

CUDA kernels throw different results on 2 different GPUs(GeForce 8600M GT vs Quadro FX 770M)

Hi everybody, I've been working on an AES CUDA application and I have a kernel which performs ECB encryption on the GPU. In order to assure the logic of the algorithm is not modified when running in parallel I send a known input test vector provided by NIST and then from host code compare the output with the know test vector output prov...

Why must loop variables be signed in a parallel for?

I'm just learning OpenMP from online tutorials and resources. I want to square a matrix (multiply it with itself) using a parallel for loop. In IBM compiler documentation, I found the requirement that "the iteration variable must be a signed integer." Is this also true in the GCC implementation? Is it specified in the OpenMP standard? If...

ASP.NET: How parallel requests are processed

Let's imaging there are 2 pages on the web site: quick and slow. Requests to slow page are executed for a 1 minute, request to quick 5 seconds. Whole my development career I thought that if 1st started request is slow: he will do a (synchronous) call to DB... wait answer... If during this time request to quick page will be done, this re...

"Parallel.For" for Java?

Hi, I was wondering if there is a Parallel.For equivalent to the .net version for Java? If there is could someone please supply an example? thanks! Jamie ...

Can Powershell Run Commands in Parallel?

I have a powershell script to do some batch processing on a bunch of images and I'd like to do some parallel processing. Powershell seems to have some background processing options such as start-job, wait-job, etc, but the only good resource I found for doing parallel work was writing the text of a script out and running those (PowerShe...

OpenMP parallel on one machine but serial on another

I finally got a section of my code to run in parallel with OpenMP without errors. When I deployed the dll to another machine, however, it no longer ran in parallel. Logging reveals that omp_in_parallel() == 0 on the other machine but not on mine. My machine is using an Intel i5 CPU which has 2 hyperthreaded cores for an effective omp_g...

parallel downloads in PHP

Hi, I want to download (or simply file_get_contents) for 5 places. I wait say 1.2 sec for each that means in total 1.2X5=6 seconds. I want to save waiting time. I thought I could wait 1.3 sec is enough. How can I approach? ...

How to parallelize a Data-Driven unit test in Visual Studio 2010?

I know regular ms-test unit tests can be parallelized on a multi-core machine (with caveats of course) by specifying parallelTestCount attribute in the .testresults file in the test solution. Like this, <Execution parallelTestCount="1"> <TestTypeSpecific /> <AgentRule name="Execution Agents"> </AgentRule> </Execution> Mo...

parallel file parsing, multiple CPU cores

I asked a related but very general question earlier (see especially this response). This question is very specific. This is all the code I care about: result = {} for line in open('input.txt'): key, value = parse(line) result[key] = value The function parse is completely self-contained (i.e., doesn't use any shared resources). ...

How can I increase the I/O queue depth to maximize performance

Disk benchmarks typically have a chart that shows the I/O throughput increasing as the queue depth increases. I'm assuming that what's going on at the hardware level is that the disk controller is reordering the requests to coincide with where the magnetic head happens to be. But how can I increase the queue depth in my own I/O-heavy a...

How to utilise parallel processing in Matlab

I am working on a time series based calculation. Each iteration of the calculation is independent. Could anyone share some tips / online primers on using utilising parallel processing in Matlab? How can this be specified inside the actual code? ...

what is the relation between avogadors number and parallel processing

what is the relation between avogadors number and parallel processing some say parallel processing helps solving for this number? what is there to solve, it is just a number suggested by some scientist.. ...

Run code on hundreds of machines, for a couple of seconds?

Say I have a task which can be ideally parallelized and requires 600 CPU-minutes to finish. I can complete it on my workstation in 10 hours. I can launch 10 EC2 instances and complete it in 1 hour. Is there a way I can run it on 100 machines and have it finish in 6 minutes? (and not pay for more) 1000 machines and have it finish in 36 ...