I'm developing an application using the CakePHP framework and am currently in the process of designing the database. I want to make sure that I design the objects and their associations correctly so that the application performs well, is organized properly, is extensible, and scales well. I will first describe the application in detail, ...
Hi. Is there a C# MongoDb Driver which supports replica sets? ...
I have a multisite Drupal installation with about 20 urls pointing to the same code base and a common database. I have around 20,000 visitors visiting all sites daily which I hope would increase. I am using 2 servers currently- one being the webserver Apache 2 on Linux Platform and the other is the database server- MYSQL. Offlate my MY...
One database connection is equal to one web request (in case, of course, your client reads the database on each request). By using a connection pool these connections are pre-created, but they are still used one-per-request. Now to some numbers - if you google for "Tomcat concurrent connections" or "Apache concurrent connections", you'l...
Sorry if this might seem obvious. I've monitored that a web request on my Rails app uses 30-33% of CPU every time. For example, if I load a web page, then 30% of CPU is used. Does that mean that my box can only handle 3 concurrent web requests, and will stall if there are more than 3 web requests (i.e. I'll get a 100% CPU)? If so, does ...
Hi all, I have recently come across SCALA while going through the designs of twitter and linkedin. A part of the twitter and linkedin are being shifted to scala for scalability which where originally developed in RoR? Does changing the programming language guarantee scalability? How exactly is this decided? Can there by any pre-plannin...
Does Telerik has a plan to make ASP.NET MVC's combobox have a feature of only fetching the data brought into view(as scrolled by user). The current ASP.NET MVC combobox fetch all rows even though they are not brought into view by the user. If they don't have that feature yet, I'm worried that ASP.NET MVC combobox would not scale in real...
I have a single table in SQLite that essentially has the following: id : integer (primary key) name: text timestamp: text data1: integer data2: integer ... data6: integer I need to filter by name and timestamp, so I have the (name, timestamp) index set up. At 100,000,000 rows, SQLite crawls at querying. Understand the index reduces t...
We're planning a new API server that will mainly serve JSON responses, with a RESTful interface. We're concerned about scale and availability. Are we on the right track using Restlet with Jetty (or another connector)? One question we're asking is, is there anything in the Java world like Phusion Passenger? For example, a pre-built solut...
Hi Consider a somewhat process consuming PHP application that works heavily with complex DB transactions, and doesn't have any choice but to have fairly high memory consuming algorithms. Like up to 4MB memory usage per request. (1 MB on average for those certain requests, less than 200KB of variable data for regular requests) Its obvious...
I'm building a website where players can play a turn based game for virtual credits (like a Poker site, but different). The setup I came up with: One data server which contains all player accounts with associated data (a database + service). Database and API may be split into two servers, if that helps. One or more webservers which ser...
I use CEDET (latest CVS) with several moderately large projects (a few hundred kLOCs each, mostly C, but some C++) and sometimes experience long pauses in which the system is completely unresponsive for seconds. More rarely, it spins out of control completely and I have to mash on C-g and try to move the cursor or switch to a different ...
Whats the best practice for scalable servers which need to maintain a list of active users? Should I open a persistent TCP Connection for each client on which the server sends update messages? This could lead in many open connection and propably no traffic for many seconds. Is this a problem in TCP? Or would it be better to let the Cli...
I'm currently developing the foundation of a social platform, and looking for ways to optimize performance. My setup is based on the CakePHP framework, but I believe my question is relevant to any technology stack, as it relates to data caching. Let's take a typical post-author relation, which is represented by 2 tables in my db. When I...
I think one of the advantages of no-sql such as MongoDB is that it can scale horizontally automatically: just add a cheap machine and the data can "spread over" to the new machine. How about for RDBMS, does any RDBMS do that automatically too? ...
I have been working on my [first] startup for a month now, and while it's probably atleast one more month away from an alpha release, I want to know how to deploy it the right way. The site will have an initial high amount of load (network + CPU) for a new user, so I am thinking of having a separate server/queue for this initial process,...
I gathered from the much famed scaling rails screencasts that at some point when your site gets big and bigger, proxy caching is the way to go. Proxy caching uses etag, among other things and since etags can be more specific and strong validator is perhaps the way to go. However, I also hear that in server farm scenarios the etag is not...
Hi, Is there a technique that I can use in Rails so that whenever a simple "find" is performed on a Model object, memcached is first searched for the result, only if no result is found will a query by then made to the database? Ideally, I'd like the solution to be implicit, so that I can just write Model.find(id), it first checks the c...
How can using something like MSMQ help with scalability and reliability? In the scenario of one web server to one database server does it help at all? Any comments or links would be greatly appreciated. Thanks EDIT: The web server will be running WCF exposing SOAP style web methods. There is also a possibility, looking to the future, ...
If you ever used twitter for at least a couple of weeks, big chances are you've seen the twitter whale. I am now following the twitter api account and most of their tweets are about some broken feature or not available at the moment. The last one I just saw is about missing tweets in my time line, which happens pretty often I must say. ...