Hi! Since I kicked off the process of inserting 7M rows from one table into two others, I'm wondering now if there's a faster way to do this. The process is expected to finish in an hour, that's 24h of processing. Here's how it goes: The data from this table RAW (word VARCHAR2(4000), doc VARCHAR2(4000), count NUMBER); should find a...
How can i connect two or more machines to form a network grid and how can i distribute work load to the two machines? What operating systems do i need to run on the machines, and what application should i use to manage the load balancing? NB: I read somewhere that google uses cheap machines to perform this fete, how do they connect tw...
We are working on a database solution for a high available (5 9s) application with high performance and data consistency needs. We are planning to use MySQL Cluster as the primary in-memory datastore backed up by a secondary innoDB MySQL datastore for persistent storage. The proposed approach is that the online application will only inte...
I have a Glassfish v2u2 cluster with two instances and I want to to fail-over between them. Every document that I read on this subject says that I should use a load balancer in front of Glassfish, like Apache httpd. In this scenario failover works, but I again have a single point of failure. Is Glassfish able to do that fail-over without...
I have been trying to find out if it is possible to do table partitioning with disk based tables in MySQL Cluster. I want to store a large table on disk, and do range partitioning on the table. I have a feeling the answer is no. Thanks for any info you can offer. Mike. ...
I have a cluster of 32 servers and I need a tool to distribute a Java service, packaged as a Jar file, to each machine and remotely start the service. The cluster consists of Linux (Suse 10) servers with 8 cores per blade. The application is a data grid which uses Oracle Coherence. What is the best tool for doing this? ...
I need to migrate extremely large quantities of data (millions of files, Terabytes of data) to an SQL cluster. The migration process is partitioned into weekly migrations, with a few hundreds of new users (i.e request-generators) every week. So far things have run pretty smoothly, but lately i've discovered that the SQL cluster started ...
I found this comment in the LabVIEW instrument driver guidelines (section 6.2): If you need more terminals than the recommended patterns, reconsider the grouping of the controls and indicators on the VI. Except for error in and error out, avoid using clusters to minimize the number of terminals. Clusters often require the user to unb...
By Upper tens of thousands requests/second I want to see 60,000 -> +90,000 requests/second. My Setup consists of the following: user ---> web app --> message queue --> parser --> database? I should mention that the parser currently can parse/stuff around 18750 records/second using COPY so we are limited on that end until we start addi...
Would would be the most cost effective way of implementing a terabyte distributed memory cache using commodity hardware these days? What would class as a piece of commodity hardware? ...
Hello, I need SQL to be running on 2 data centers(DC) active/active. There are tonnes of challanges to be done here and below are my requirements. Data synchronization must be async. (For higher performance) I need to be able to read/write on both DC When Site1 goes down, all the traffic will be routed to Site2 and when Site1 comes ba...
I have several slave machines and a master machine which together run a distributed application. Processes on each slave machine have to have a GUI and network access (I think it would be called an interactive process then). For ease of use it would be nice if the master machine could start/stop the processes on those slave machines. My...
I am currently in need of a high performance java storage mechanism. This means: 1) I have 10,000+ objects with 1 - Many Relationship. 2) The objects are updated every 5 seconds, with the most recent updates persistent in the case of system failure. 3) The objects need to be queryable in a reasonable time (1-5 seconds). (IE: Give me...
I'm setting up a Misc SQL Cluster (Windows 2008/SQL 2005 & 2008) that will be active/active and have about a dozen SQL instances on it. From the documentation I've read, I can't tell if each SQL instance will need its own LUN, or if I can have a single, really big LUN created, and then create a dozen different partitions on that LUN (one...
Hello everyone, Could anyone point me or tell me how to write connection string to a SQL Server cluster instance? I want to establish trusted connection to a database (initial catalog) of the specific instance of SQL Server cluster. I find for quite some time but can not find official answer from Google. BTW: I am asking for the connec...
I've got processes that need to be farmed out over a cluster that supports PBS, however, due to limitations with the process, I can only run one process per node at a time. Each node has two processors, the ghetto approach would be to simply request two processors per job. But that wastes a core per job. Is it possible to request a singl...
I have a single Tomcat 6 instance that frequently needs to be rebooted because of PermGen issues after multiple WAR deployments. In a Production environment it's clearly bad practice to take down the site, leaving any visitors with nothing but a connection failure. The big picture is to set up a fail-over Tomcat cluster of one or two mo...
My app runs well on my quad-core machine. It is 'embarrasingly parallel', with about 100K processes, and thus nicely suited to run on a cluster of machines. However, I have trouble finding documentation on how to spread all those processes out on all available nodes in the cluster. The documentation for distributed Erlang seems to focus...
I've been thinking about getting a little bit greener with my computers and using some lower power, mini-itx boards in my next computer. Some can generate under 10 watts and are pretty inexpensive. So I though, if one is such low cost and low power, why not try to make a cluster out of them? However, I'm not really sure what I would nee...
I have a database that needs to be able to scale up to billions of entries or rows. Can this many rows be supported per single table? Is it advisable? Would a single table be split over several clusters if used in a NDBCLUSTER. Other load balancing techniques? What are some advisable methods of deploying such a database? What are be...