I'm working on a project were we need more performance. Over time we've continued to evolve the design to work more in parallel(both threaded and distributed). Then latest step has been to move part of it onto a new machine with 16 cores. I'm finding that we need to rethink how we do things to scale to that many cores in a shared memory ...
I am particularly interested in Document Libraries, but in terms of general SharePoint lists, can anyone answer the following...? What is the maximum number of items that a SharePoint list can contain? What is the maximum number of lists that a single SharePoint server can host? When the number of items in the list approaches the maxim...
In general, what kinds of design decisions help an application scale well? (Note: Having just learned about Big O Notation, I'm looking to gather more principles of programming here. I've attempted to explain Big O Notation by answering my own question below, but I want the community to improve both this question and the answers.) Resp...
Generally the database server is the biggest, most expensive box we have to buy as scaling vertically is the only option. Are there any databases that scale well horizontally (i.e. across multiple commodity machines) and what are the limitations in this approach? ...
Does anyone have any experience with how well services build with Microsoft's WCF will scale to a large number of users? The level I'm thinking of is in the region of 1000+ client users connecting to a collection of services providing the business logic for our application, and these talking to a database, in something akin to a traditi...
Can somebody suggest a good solid book on scaling Asp.Net applications? One that could potentially scale to millions of users. Some of the books listed here are pretty good (http://highscalability.com/book-store). They cover a range of techniques which can be used independently of the technology used. What I was looking for is somethin...
I have an application that's a mix of Java and C++ on Solaris. The Java aspects of the code run the web UI and establish state on the devices that we're talking to, and the C++ code does the real-time crunching of data coming back from the devices. Shared memory is used to pass device state and context information from the Java code thro...
(I'll begin by making it clear, I am not a .NET developer and am not tied to any other environment.) Recently, I heard that the London Stock Exchange went down for an entire day. I've also heard that the software was written in .NET. Up to this point they would experience performance hits on busy days. People seem to be blaming .NET. ...
I recently read this Question about SQLite vs MySQL and the answer pointed out that SQLite doesn't scale well and the official website sort-of confirms this, however. How scalable is SQLite and what are its upper most limits? ...
My team is developing a new service oriented product with a web front-end. In discussions about what technologies we will use we have settled on running a JBoss application server, and Flex frontend (with possible desktop deployment using Adobe AIR), and web services to interface the client and server. We've reached an impasse when it ...
How cheap can MySQL be compared to MS SQL when you have tons of data (and joins/search)? Consider a site like stackoverflow full of Q&As already and after getting dugg. My ASP.NET sites are currently on SQL Server Express so I don't have any idea how cost compares in the long run. Although after a quick research, I'm starting to envy ...
The IIS 6.0 is serving my Classical ASP pages in a serial fashion (one at a time) The #2 request will be handled by the web server only when the #1 request ends. If the #1 request takes a little longer, the #2 request will have to wait for the #1 ends to starts being handled by IIS. Is this a missconfiguration in IIS? The operation ...
In many projects we are developing we need to have CMS functionalities in the back end of the site. On the other end we don't want to or can't commit to a complete front end solution. To explain this better: CMSes like Joomla or DotNetNuke are complete web site solutions, they let you store and publish data. They are not friendly at al...
I'm building a PHP site, but for now the only PHP I'm using is a half-dozen or so includes on certain pages. (I will probably use some database queries eventually.) Are simple include() statements a concern for speed or scaling, as opposed to static HTML? What kinds of things tend to cause a site to bog down? ...
I'm evaluating Terracotta to help me scale up an application which is currently RAM-bounded. It is a collaborative filter and stores about 2 kilobytes of data per-user. I want to use Amazon's EC2, which means I'm limited to 14GB of RAM, which gives me an effective per-server upper-bound of around 7 million users. I need to be able to sca...
This question is related to another: http://stackoverflow.com/questions/108445/will-having-multiple-filegroups-help-speed-up-my-database The software we're developing is an analytical tool that uses MS SQL Server 2005 to store relational data. Initial analysis can be slow (since we're processing millions or billions of rows of data), b...
When trying to distribute work that requires a multiple stage processing pipeline what are the communication, synchronization and throughput costs limitations in JMS vs JavaSpaces? ...
There are a lot of MVC frameworks for PHP. Which one is the best in terms of scalability? Is there any framework that supports splitting applications on many front end and database servers? Sharding? Other enterprise features? Ideally the framework should support sites with thousands of concurrent users per server. I would greatly...
I am about to start a project for a potentially heavily accessed ASPNET MVC application and I was thinking to use Subsonic for my DAL. I have some concern about the ability of Subsonic to handle thousands of concurrent requests. Can anyone give me some examples of popular web sites using Subsonic? Also if you have any suggestion regardi...
How do you organize DB layer, business logic and cross-platform API of your information management system, if uploading and processing 500000 data records in one session is a normal operation (C# .NET 3.5 + MS SQL 2005)? I’m specifically interested in production-proven paging patterns that behave well with the concurrency, scalability a...