I am thinking of ways by which people may interact with video and probably publish them. So, I have a service in mind that people can use to upload the video to one place and then just write plugins which tells my webservice what to do with these videos. my current plans are like if someone uploads a video to my service and then edits it...
I'm interested in open source messaging and/or distributed cache technologies that satisfy the following requirements. Multiple load-balanced instances of Java web application (probably on Amazon EC2) It's possible for number of instances to be changing over time for scaling. When a request comes with an id FOO, the event is cached i...
We have a box that has terabytes of data (10-20TB) each day, where each file on the drive is anywhere from megabytes to gigabytes. We want to send all these files to a set of 'pizza boxes', where they will consume and process the files. I can't seem to find anything that is built to handle this amount of data besides distcp (hadoop). R...
We need to have documents shared between clients (CRM-like functionality). Users need to be able to: Edit the documents and save them again Attach new documents Our application is coded in WPF with WCF for data-transport and NHibernate/SQL for data on the server. what we're thinking is to use SVN and have the app create a local chec...
Hi, My friend and I are working on a project for distributed KD-tree with applications to location-aware services in mind. Can anyone point us to papers related to this? Thanks ...
I am querying a linked SQL Server and not getting an error that I do get when querying locally. Something like this: SELECT CAST(ColumnName AS INT) FROM TableName and this: SELECT CAST(ColumnName AS INT) FROM ServerName.DatabaseName.Schema.TableName The first query when run locally returns an error 'Arithmetic overflow error convert...
Hi, How do I create a cluster of computers in Amazon EC2? What are the best practices for security? Can I access other machines in the local network? Thanks! ...
Hi Folks, As part of my work we get approx 25TB worth log files annually, currently it been saved over an NFS based filesystem. Some are archived as in zipped/tar.gz while others reside in pure text format. I am looking for alternatives of using an NFS based system. I looked at MongoDB, CouchDB. The fact that they are document oriented...
I'm currently thinking how I could protect my REST API which is used only by my mobile application from being used by other applications? Could a API-Key be a good solution, because just me know the secret API key. Is there a better solution? ...
Can an MSMQ queued messages survive a service/server restart? What I mean is that if a queue has messages and the server were to experience a hard restart, would the messages be still available in the queue after the restart? ...
I have a working distributed application that has a rather big blemish. The client.exe needs the server.exe to work. The reason for this is that the client and server use a MarshalByRef Class (which exists on both sides in the form of a .DLL) which contains a reference to the server. Is there any way I can rearrange things so that I do...
My workplace is connected via cable internet with limited up/downstream, so for load-testing a web application I am using a distributed approach: An instance of jmeter-server (v2.4) is running on a remote linux box which has proper internet connectivity. The controlling jmeter GUI (also 2.4) is running on my desktop. The two are conne...
Dear Experts, I am working on a distributed animation of moving BALLS with RMI. My goal is to move multiple balls in a way, so that multiple clients observe the same movement/position of balls, i m using ball object which is remote object. The ball is moving fine, when it is only one, but when i m trying to increase the number of bal...
Suppose I've got a ton (a continuous stream) of requests to process, and each request has several stages. For example: "connecting to data source", "reading data from data source", "validating data", "processing data", "connecting to data sink", "writing result to data sink". Which visualization methods or even tools fit well to visuali...
Hi, I am doing some text processing using hadoop map-reduce jobs. My job is 99.2% complete and stuck on last map job. The last few lines of the map output show as below. Last time, when this problem occured, I tried printing out the key values emmited from map and noticed that one of the key is having large number of values associated...
I need to synchronize the data that "one client" updated and need to be refreshed on "other client" (on another room) of the same application. 1 - Which is the best approach to doing this? I was thinking on SqlDependency but the application can also run on other database engines (I dismiss it) I also think of a timer polling for update...
Posit the following situation: You have a large and complex system (distributed, concurrent, huge dataset) which supports many users. The code is sent to the data. You want to allow mobile code in the system - ie untrusted code that will run within the same JVMs as the rest of the system, to take advantage of the locality of the data,...
I want to build a large scalable database with millions of high dimensional vectors using LSH. Since I have to hold all the data in ram for fast querying, the data must be distributed onto multiple servers to hold all the objects. A naïve approach would be to spread all objects to different servers and send one query to every server. Th...
We have started using a third party platform (GigaSpaces) that helps us with distributed computing. One of the major problems we are trying to solve now is how to manage our log files in this distributed environment. We have the following setup currently. Our platform is distributed over 8 machines. On each machine we have 12-15 process...
Dear Experts, I am working on a distributed animation of moving BALLS with RMI. My goal is to move multiple balls in a way, so that multiple clients observe the same movement/position of balls, i m using ball object which is remote object. registering objects: public MyMultiRemoteBallServer() { try { RMIball[0] = new R...