distributed-computing

[.NET] Monitor multiple windows service instances in a cluster of machine.

I have implemented a windows service application that will be deployed to multiple machines and run concurrently to process tasks in a central queue. I have a log file for each instance of service running. But I want to be able to monitor all instances of the service and retrieve application specific information, such as Name and ID of t...

Robust way to send and handle messages for a distributed system

I'm working on a small distributed system, which is completely message driven. Right now, I usually open up a socket each time I have to send something and close it right afterwards. State is only maintained on the server side (for instance, if no message arrives for 5 minutes from a client, consider it dead). However, I have to do some...

.NET Distributed Code Execution Framework in C#

We current operate a datacenter that aggregates a bunch of login data and stores it into a database. We have several "jobs" that run periodically that operate on the data, perform statistics analysis, etc. The current scheduler and job system is pretty basic, and I'd like to kick it in the nuts and send it into overdrive (just go with ...

Difference between cloud computing and distributed computing ?

Hi All, I wanted to know about the difference about cloud computing and distributed computing. I read an article about cloud computing and get an feeling that somewhere there is relation between cloud computing and distributed computing and so wanted to ask about difference between technologies. Also if someone can point me to useful...

How to scale cholesky factorization on multiple GPUs

Hello folks, I have implemented Cholesky Factorization for solving large linear equation on GPU using ATI Stream SDK. Now I want to exploit computation power of more and more GPUs and I want to run this code on multiple GPUs. Currently I have One Machine and One GPU installed on it and cholesky factorization is running properly. I want...

What's the best trick to speed up a monte carlo simulation?

Whenever I run large scale monte carlo simulations in S-Plus, I always end up growing a beard while I wait for it to complete. What are the best tricks for running monte carlo simulations in R? Any good examples of running processes in a distributed fashion? ...

.net n-Tiered/Distributed Programming Technologies

If want to learn how to program n-Tiered/Distributed applications in .net, what technology should I start my learning with COM+/Remoting/Web Services/WCF? Are these technologies complementary or exclusive and to what degree? ...

Creating threads within the cluster

Hi, I wish to know is there any way that I can create the threads on other nodes without starting the process on the nodes. For example :- lets say I have cluster of 5 nodes I am running an application on node1. Which creates 5 threads on I want the threads not to be created in the same system but across the cluster lets say 1 node 1 t...

Heartbeat Protocols/Algorithms or best practices

Recently I've added some load-balancing capabilities to a piece of software that I wrote. It is a networked application that does some data crunching based on input coming from a SQL database. Since the crunching can be pretty intensive I've added the capability to have multiple instances of this application running on different servers ...

MSDTC with Entity Framework

I have an app that is saving to a db (using Entity Framework) and saving documents to Sharepoint in a single save. I'm attempting to use MSDTC with a TransactionScope. Part of my EF insert logic includes passing a list of foreign keys to the data layer. The layer retrieves the "foreign key'd" object from the db and then adds it to t...

Slaves working for Masters - Distributing Jobs

For a new project that I'm working on I need to set up a centralized computing environment with a primary server (master) and several workstations (slaves). The master will recieve several types of job orders with diferent intervals and expiration dates, example: NAME INTERVAL EXPIRATION OPERATIONS Job A 5 m ...

Can computer clusters be used for general everyday applications?

Does anyone know how a computer cluster can be used for everyday applications, like for example video games? I would like to build a computer cluster that can run applications over the cluster that were not specifically designed for computer clusters and still see the performance increase. One use would be for video games, but I would ...

open source gossip-based membership protocol?

I am looking for a library which I can plug into a distributed application which implements any gossip-based membership protocol. Such a library would allow me to send/receive membership lists, merge received membership lists, etc... Even better would be if the library implemented a protocol with performance O(logn) performance guarante...

Purposefully Slow MATLAB Function?

I want to write a really, really, slow program for MATLAB. I'm talking like, O(2^n) or worse. It has to finish, and it has to be deterministically slow, so no "if rand() = 123,123, exit!" This sounds crazy, but it's actually for a distributed systems test. I need to create a .m file, compile it (with MCC), and then run it on my distribut...

shared memory vs distributed memory and multithread vs multiprocess

I am learning parallel programming by myself. I wonder if distributed memory is always multiprocess and multithread is always shared memory? if multiprocess can be both for distributed memory and for shared memory? Thanks and regards! ...

ProActive Parallel Suite .NET alternative

I have recently started using ProActive Parallel Suite (http://proactive.inria.fr/). I was wondering if there are any alternatives for .NET Framework which are open-source and which have relatively the same feature set. ...

Distributed Computing Framework (.NET) - Specifically for CPU Instensive operations

I am currently researching the options that are available (both Open Source and Commercial) for developing a distributed application. "A distributed system consists of multiple autonomous computers that communicate through a computer network." Wikipedia The application is focused on distributing highly cpu intensive operations (as ...

Master-Slave Pattern for Distributed Environment

Hi, Currently we have a batch driven process at work which runs every 15 mins and everytime it runs it repeats this cycle several times: Calls a sproc and get some data back from the DB Process the data Saves the result back to the DB It can't load all the data in one go because the data are segregated by a number of fields and each...

Ideas for computer science project with CORBA or ICE

We have to perform a semester project with distributed computing using CORBA or ICE. It is a single-person project and we have a couple of months of time. For the programming language I'd like to focus on c# for it may be any other like C++. I don't want to write the one millionth prime generator, maybe there is something much more int...

performance penalty of message passing as opposed to shared data

There is a lot of buzz these days about not using locks and using Message passing approaches like Erlang. Or about using immutable datastructures like in Functional programming vs. C++/Java. But what I am concerned with is the following: AFAIK, Erlang does not guarantee Message delivery. Messages might be lost. Won't the algorithm and...