scalability

What does it mean that Linq To SQL is not scalable?

I've once heard from some developers that L2S is not scalable. I'm not sure that I fully understand what that means. I guess that it has something to do with the layers in your app (provided your app is a layered one). Can someone please shed some light on this subject? Thanks, Avi ...

Scalability implications of converting stateless session beans to POJOs

Imagine a heavily-used service object that's implemented as an EJB 2.1 SLSB, and that also happens to be thread-safe in itself by virtue of having no state whatsoever. All its public methods are transactional (via CMT), most simply requiring a transaction, but some requiring a new transaction. If I convert this SLSB to a genuine singlet...

What happens when a live site has too many users?

Hi I'm new to production level web development, so sorry if this is obvious. My site has a potential to have a sudden surge of (permanent) users and I'm wondering what happens if too many users sign up in a short period of time, causing the site to run slowly. Since development takes time, would it just be a case of adding more boxes t...

High availability & scalability for C#

I've got a C# service that currently runs single-instance on a PC. I'd like to split this component so that it runs on multiple PCs. Each PC should be assigned a certain part of the work. If one PC fails, its work should be moved to a backup machine. Data synchronization can be done by the DB, so that should not be much of an issue. My ...

Pros and Cons of Sticky Session / Session Affinity load blancing strategy?

One approach to high scalability is to use network load balancing to split processing load between several servers. One challenge that this approach presents is where servers are state aware - storing user state in a "session". One solution to this problem is "sticky session" (aka "session affinity") where each user is assigned to a ...

Where should IsChanged functionality be handled?

I'm having an internal debate about where I should handle checking for changes to data and can't decide on the practice that makes the most sense: Handling IsChanged in the GUI - This requires persistence of data between page load and posting of data which is potentially a lot of bandwidth/page delivery overhead. This isn't so bad in ...

How do different visitor metrics relate?

Hypothetically, tets say someone tells you to to expect X (like 100,000 or something) number of unique visitors per day as a result of a successful marketing campaing. How does that translate to peak requests/second? Peak simultaneous requests? Obviously this depends on many factors, such as typical number of pages requested per user...

Are there any scalability best practices specifically for sites with huge audiences?

While this question has been asked in a variety of contexts before, I can't find any information pertaining specifically to sites targeting very large audiences - for example on the scale of hundreds of thousands or even millions of users. When writing sites that target smaller audiences (such as intranet hosted data driven sites that h...

How do I maintain state across multiple web servers?

Can I have multiple web servers hooked up to a SQL Server cluster and still maintain a user's session? I've thought of various approaches. The one suggested by the Microsoft site is to use response.redirect to the "correct" server. While I can understand the reasoning for this, it seems kind of short sighted. If the load balancer is ...

Scaling up from 1 Web Server + 1 DB Server

We are Web 2.0 company that built a hosted Content Management solution from the ground up using LAMP. In short, people log into our backend to manage their website content and then use our API to extract that content. This API gets plugged into templates that can be hosted anywhere on the interwebs. Scaling for us has progressed as foll...

Rails: scaling with group calculations

Hello, currently I am running something similar to this command: Person.sum(:cholesterol, :group => :age) which seems to work great when I have a small number of records. However when I attempt to call this with a few thousand records or more in the table, it takes literally minutes to run. However, the SQL querey: SELECT sum(`peopl...

php vs python. scalability

Why is PHP considered more scalable than python? I've heard may times that one of the reasons PHP is "better" than python is that PHP is more easily scalable, and that Yahoo proves that(assumig Yahoo still uses PHP). Whats the difference between PHP and Python when it comes to scalability? -- edit -- well, i have no evidence, the que...

How to partition Mysql across MULTIPLE SERVERS?

I know that horizontal partitioning...you can create many tables. How can you do this with multiple servers? This will allow Mysql to scale. Create X tables on X servers? Does anyone care to explain, or have a good beginner's tutorial (step-by-step) that teaches you how to partition across multiple servers? ...

What is the best Clustering or Distributed System solution for Java applications

What are the best approaches to clustering/distributing a Java server application ? I'm looking for an approach that allows you to scale horizontally by adding more application servers, and more database servers. What technologies (software engineering techniques or specific technologies) would you suggest to approach this type of pro...

any good books on scalable web applications (Java/Ajax/REST)?

Are there any good books on the subject worth reading and still up-to-date with current technologies? I'm mostly interested in back-end architecture and things I should consider choosing clustering and database solution as I plan to use GWT for the front-end therefore won't be able to control a lot there. I'm looking for a book which w...

Amazon RDS: can databases be setup in replicaton mode?

I am studying the new Amazon RDS product and it seems it can be scaled only vertically (i.e. put a stronger server). Did anyone see a possibility to configure multiple instances so that one is master and the other/s is/are replication slaves? ...

Reasons for NOT scaling-up vs. -out?

As a programmer I make revolutionary findings every few years. I'm either ahead of the curve, or behind it by about π in the phase. One hard lesson I learned was that scaling OUT is not always better, quite often the biggest performance gains are when we regrouped and scaled up. What reasons to you have for scaling out vs. up? Price, ...

Scaling a system bound by database?

Following is the scenario and some proposed solutions. Are there any better solutions? There is a system A which has to "analyse" lots of URLs. Another system B generates these URLs - currently there are about 10 million of them in a database. Sample schema: id URL has_extracted 1 abc.com 0 2 bit.ly 1 My solutions are as follows: N...

New to MySQL scaling-how to have 2 master-write servers?

From what I learned, a MySQL MASTER server is one that can both read and write. Correct? My question is: Suppose you have 2 MySQL master-write servers (and many slave-read servers). How can you solve the problem of auto-increment? How do you sync it? Suppose you are writing to both the Master1 and Master2...how will you sync it so tha...

I have one database (mysql). What is the best "failover" strategy?

Does MySQL come with a built-in automatic failover? Or, are there load-balancers out there that can "detect" whether the database is alive...and if not...shoot it to the failover database? I know basic MySQL, but do not know the best way to design failover for one master DB. ...