Hello, I've been looking at MapReduce for a while, and it seems to be a very good way to implement fault-tolerant distributed computing. I read a lot of papers and articles on that topic, installed Hadoop on an array of virtual machines, and did some very interesting tests. I really think I understand the Map and Reduce steps. But here...
We have a large high-performance software system which consists of multiple interacting Java processes (not EJBs). Each process can be on the same machine or on a different machine. Certain events are generated in one process, and are then propagated in different ways to other processes for further processing and so on. For benchmarki...
Hello, A quick design question for the worth. I need to share data between C++ client and Java server. The Client talks to the server using SOAP. The issue is - I have a generic interface serving all kinds of requests on the Java backend. I don't want to "pollute" is with specific kind of request object which will most of the times re...
One of the features of the actor model in Erlang is transparent distribution. Unless I'm misinterpreting, when you send messages between actors, you theoretically shouldn't assume that they are in the same process space or even co-located on the same physical machine. I've always been under the impression that distributed, fault tole...
I'm trying to set up a new Windows computer with Visual Studio 2008 to work on a Sourceforge project I maintain. I'd like to use a distributed version control system (tried SVN, didn't like it). I've used git and mercurial before on UNIX, but I'm having no luck finding a quality plugin that integrates in Visual Studio 2008 and allows me...
...question says it all! Looking at tools for collaborative editing for a distributed and having uses SEE in the past I would love to go down that road (but it has to be cross-platform).... ...
I have several large projects that I work on. Depending on the project and options, build times are from 10-100 minutes long, rendering me useless for that time. I do have a few extra computers laying around however. Is there anyway that I can configure these computers as 'compile nodes' so that I can still work while a build is going o...
The in-house developed software where I work connects directly to a mysql server here in our office via our devexpress orm (XPO). Performance is great. We're opening another office... cross country. Performance: not so great. The requirement is that the software be as responsive in both offices as it is in this office and that the data ...
Lately I've been reading up on HDFS (Hadoop) and GFS (Google) and find myself wondering if there are any similar native implementations for windows and/or .NET. A lot of the applications I develop include features to support user generated content, and currently, that means relying on some type of storage service such as Mosso or S3, or ...
Hello, I'm part of a distributed development team. We all work through terminal services, accessing a remote server where our applications are located. We're working on a project in which a client application consumes a WCF service, which exposes all the business logic functionality. In our development process, a developer is often ask...
Is there any library for distributed in-memory cache, distributed tasks, publish/subscribe messaging? I have used Hazelcast in Java, I would like something similar. I know that Memcached is an in-memory cache and even distributed, but it is missing the messaging and remote task. I just need something to coordinate a cluster of server w...
I was wondering if anyone knows of any good Open Source distributed computing projects? I have a computationally intensive program that could benefit from distributed computing (a la SETI@Home, etc.) and want to know if anyone has seen such a thing or will I be developing it from scratch? ...
Disclaimer: I already asked this question, but without the deployment requirement. I got an answer that got 3 upvotes, and when I edited the question to include the deployment requirement the answer then became irrelevant. The reason I'm resubmitting is because SO considers the original question 'answered', even though I...
How do I create an index on a table that exist in a remote SQL Server database using the openquery syntax? ...
I am planning a protocol where two applications open a socket between them and send and receive legal json objects. Can a sequence of json objects be unequivocally parsed, or will I need delimiters, or prefixing each object with its lengths or something like that? ...
Need to be able to set server(s) that replicate all information, as a master data store that has all the data. Also need servers that specifically store/replicate certain data, available in local LANs, so that when the internet connection goes down, they can still access their local data. Under normal circumstances, the clients will ac...
How do you verify the state of the environment for a system without drastically increasing the scope of the system? I'm working on a system which talks to some remote servers. For example, it connects to a server and grabs logs of MyApp that ran on that server. These remote servers use a multitude of operating systems and are "manually"...
I'm building a web application that from day one will be on the limits of what a single server can handle. So I'm considering to adopt a distributed architecture with several identical nodes. The goal is to provide scalability (add servers to accommodate more users) and fault tolerance. The nodes need to share some state between them, th...
Hi, I am intrigued as to how singletons work in Google App Engine (or any distributed server environment). Given your application can be running in multiple processes (on multiple machines) at once, and requests can get routed all off the place, what actually happens under the hood when an app does something like: 'CacheManager.getInst...
I require to do a project as a part of my final year of engineering graduation studies.Can you suggest some projects pertaining to distributed systems and artificial intelligence together and which require python,c or c++ for programming? Note:-Please suggest a project that is attainable for a group of 2 students. ...