distributed

How do you keep two related, but separate, systems in sync with each other?

My current development project has two aspects to it. First, there is a public website where external users can submit and update information for various purposes. This information is then saved to a local SQL Server at the colo facility. The second aspect is an internal application which employees use to manage those same records (conc...

Are there good resources on federated software?

Imagine you want to build a version of SOFlow that does every topic. Much more encyclopdic -- somewhat similar to a collection of all of the "talk" pages on Wikipedia. If I were designing this, I wouldn't try to do it as one site. I'd do it as a framework where anybody could create a version for their special topic, but all of the spe...

Experience with Hadoop?

Hi, Have any of you tried Hadoop? Can it be used without the distributed filesystem that goes with it, in a Share-nothing architecture? Would that make sense? I'm also interested into any performance results you have... ...

Is Project Darkstar Realistic?

Project Darkstar was the topic of the monthly JavaSIG meeting down at the Google offices in NYC last night. For those that don't know (probably everyone), Project Darkstar is a framework for massively multiplayer online games that attempts to take care of all of the "hard stuff." The basic idea is that you write your game server logic ...

What would be a good, windows and iis (http) based distributed version control system

At my job we make & sell websites. Usually we install our .NET C# based site on a customer's server and maintain and support it remotely. However, every once in a while, for bigger development works and just to make things simpler (and faster!), we will copy the site to a local server. This is great, but has one pain - moving the site b...

Spread vs MPI vs zeromq?

In one of the answers to Broadcast like UDP with the Reliability of TCP, a user mentions the Spread messaging API. I've also run across one called ØMQ. I also have some familiarity with MPI. So, my main question is: why would I choose one over the other? More specifically, why would I choose to use Spread or ØMQ when there are matu...

Decision making in distributed applications

With a distributed application, where you have lots of clients and one main server, should you: - Make the clients dumb and the server smart: clients are fast and non-invasive. Business rules are needed in only 1 place - Make the clients smart and the server dumb: take as much load as possible off of the server Additional info: - ...

How to robustly, but minimally, distribute items across a peer-to-peer system

If one has a peer-to-peer system that can be queried, one would like to reduce the total number of queries across the network (by distributing "popular" items widely and "similar" items together) avoid excess storage at each node assure good availability to even moderately rare items in the face of client downtime, hardware failure, ...

Best technology for developing an app that runs on DESKTOP and in BROWSER?

Microsoft WPF? Adobe AIR/Flex? Adobe Flash? Curl programming language? How does AJAX fit in? Given a server written in C++ .NET. ...

Best way to aggregate multiple log files from several servers

I need a simple way to monitor multiple text log files distributed over a number of HP-UX servers. They are a mix of text and XML log files from several distributed legacy systems. Currently we just ssh to the servers and use tail -f and grep, but that doesn't scale when you have many logs to keep track of. Since the logs are in differe...

Copyright and Fair Use in Distributable Software

At what length of text and/or length of audio snippet does a piece of commercially distributable software pass the threshold of fair use and violate the included work's copyright? Does attribution absolve the developer from infringement? An example would be a quote from a novel used on a start-up screen. ...

Distributed python

Hi all, what is the best python framework to make distributed apps? For example to build a P2P app. Thanks ...

What are the advantages/disadvantages for distributing multi stage tasks via JMS or JavaSpaces?

When trying to distribute work that requires a multiple stage processing pipeline what are the communication, synchronization and throughput costs limitations in JMS vs JavaSpaces? ...

Distributed Processing: C++ equivalent of JTA

I'm developing a mission-critical solution where data integrity is paramount and performance a close second. If data gets stuffed up, it's gonna be cata$trophic. So, I'm looking for the C/C++ version of JTA (Java Transaction API). Does anyone know of any C or C++ libraries that supports distributed transactions? And yes, I've googled it...

Wise to run MS Velocity on my development machine?

I've never developed a web application that uses distributed memory. Is it common practice to run a tool such as Microsoft Velocity on my local machine as I develop, should I run Velocity on another server as I develop, or should I just develop as normal (default session & cache) and use Velocity only after I've deployed to our develop...

MPI for multicore ?

With the recent buzz on multicore programming is anyone exploring the possibilities of using MPI ? ...

ASP.NET Single Login - Is distributing session the answer

We have 5 balanced web servers with various websites. What I am trying to achieve is to ensure a single login. i.e. the same user account cannot login to the same website more than once at any given time. The method i'm considering for solving this, is to share session amongst the servers so I can control which session is assigned to w...

Distributed file source

Looking for a software solution to to store large files (>50MB - 1.5GB), distributed across multiple servers. We have looked at MogileFS, however, given existing software demands, need to have an NFS interface. Would prefer open source, however, open to all options. ...

Sql Server 2005 SSIS unable to enlist SYBASE distributed transaction

Good morning, I know very little (arguably nothing) about SYBASE setup, but I do know SSIS is having trouble enlisting SYBASE in a distributed transaction. Has anyone been able to make this work? The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x80004005 "Unspecified error". This h...

Distributed event handling mechanism for Java

I'm looking for a reasonably fast event handling mechanism in Java to generate and handle events across different JVMs running on different hosts. For event handling across multiple threads in a single JVM, I found some good candidates like Jetlang. But in my search for a distributed equivalent , I couldn't find anything that was lightw...