scalability

Piwi PHP Transformation Framework - Scaling and Performance?

I recently inherited a simple PHP application built on Piwi (http://www.piwiframework.de/default.html). Has anyone deployed this framework in a high-availability high-concurrency scenario? I was thinking about 5000 concurrent users (at least) with a 2-3 hour burst totaling about 15-50k unique sessions. I'm not asking if php can be scal...

Trading Platform built on Silverlight?

I've had an idea for some time now to write a trading platform application similar to think or swim in Silverlight. First of all is it something that one person can do in a reasonable time-frame? Ok next question is how would the performance of the Silverlight be running such a memory intensive application? Will it scale? Nearly all t...

Scalable & Very High Performance Web Sites: Books, tutorials or other resources?

Most web frameworks and "best practices" are not suitable for very high performance sites and the whitepapers from vendors out there ain't worth the paper they are printed on. So where should someone look to find books, tutorials or other resources on this subject? ...

(memcached + relational db) vs nosql

Memcached + relational db looks like a good solutions if you don't have to scale in magnitude of twitter or facebook... are there reasons when NoSQL would be preferred even if high scalability is not a requirement.. ...

detecting when data has changed

Ok, so the story is like this: -- I am having lots of files (pretty big, around 25GB) that are in a particular format and needs to be imported in a datastore -- these files are continuously updated with data, sometimes new, sometimes the same data -- I am trying to figure out an algorithm on how could I detect if something has changed...

MOSS 2007 - Maximum number of views for one list?

Is there a maximum number of views you can create for a list in SharePoint? I mean views like the ones which are listed in the top right corner o the AllItems.aspx page: Are there performance issues which arise when you add a lot of views to one list, like 50-100? ...

Best practice for a java based distributed system

Dear friends, I need an advice for best practice for a distributed system architecture. I need to use Java and MS SQL server 2008. The main program flow I as follows: New data is loaded into the database, usually from external process or via ETL. A main process should monitor periodically for new data in the database. Once new data i...

Webservices performance best practices

All, I am working on creating a toolbar that looks at certain links on a page and injects some links of my own by getting them from a webservice, which I am writing too. There can be 100s of links on a page and there can be 100,000s of such toolbars installed. The question is, what are the best practices I should follow to make sure t...

How to simulate high traffic load on a web application?

Hi, I wrote a Python web API that may get large amounts of requests per day. I want to test load levels before I go any further. What is the best way to simulate large amounts of traffic on my localhost web application? Is there a (linux compatible) tool that will send large amounts of requests to a localhost URL? ...

Which option is more scalable?

I'm working on php, mysql on a project I'm planning to add a multilanguage option, usually I use single textfile for each php file, but I want to know if one of the followings is good or not and why. Using one single textfile for the whole site: This would make my life peacefully because I have to make changes in one place only, but I...

How to get a single file from a folder in java?

The idea is to take one single file, but I don't want to list all the files, I have the address of the specified folder, but not the name. Basically I want findFileInFolder(String folderName) --- this method returns a random filename or the oldest file created on the folder Does anybody ever tryied doing this? any Ideas to avoid listi...

Books for Building Scalable Web Applications? (DB Performance/Tuning, Networking, General Performance, etc.)

After finishing school in Computer Science and entering the "real world" as a software engineer working on web applications, I've become overwhelmed by the amount of information to be learned about scaling web applications properly. Some topics/questions that have recently popped up for me: RDBMS's vs. unstructured data storage. Advant...

What well known JavaScript libraries are located on CDN's, and what are the URLs'?

It's pretty common knowledge that JQuery is in both the Microsoft and Google CDN, but there are more and more I'm hearing about such as Yahoo YAPI and others. I'm a new web developer and am interested in hearing about what libraries are widely used, located on a CDN, and worth learning about. What libraries would you recommend? ...

What for sturtup to start with: complex systems (requiring big resourses) or simple and rewrite later for scalability or own "middle" solution?

Well, I've been searching for good DB solution for my startup idea. I won't create one more topic "Which DB is the best ever?!", but I'll ask one other thing. So, I haven't found any good horizontal-scalable DB written in C++. Why C++? Of course, there are Cassandra if you need document-store and Voldemort if you need key-value storage....

How to load balance (scale) a simple PHP application?

I constantly read on the Internet how it's important to correctly architect my PHP applications so that they can scale. I have built a simple/small CMS that is written in PHP (think of Wordpress, but waaaay simpler). I essentially have URLs like such: http://example.com/?page_id=X where X is the id in my MySQL database that has the pag...

What are the biggest advantages to moving from n-tier to SOA?

At my company we are currently using the classic n-tier architecture using NHibernate as our persistence layer with fat objects. Seeing many issues with this pattern, such as full hydration of the object graph when entities are retrieved from the database we have been looking in to other alternatives. In this process we have moved to a...

What should we use when initializing some values from DataTables

What should be more appropriate to use when you want to initialize class properties from datatable. i.e. name=dt.Rows[0][0] or name=dt.Rows[0]["Name"] Which approach is more scalable any easy to handle. Currently I uses 2nd approach but feels like if I use indexes rather than name that i only need to change stored procedures rather ...

dynamically increasing java heap space

I have written a java program that tests the speed of a couple of multi-threading algorithms on different machines with various numbers of processors. On some machines, merge sort* fails because it requires a sizable heap space to work on very large arrays. I can easily change the java heap space myself before running the program, but ...

Scaling a Ruby on Rails site

I am developing a Ruby On Rails application and would like to deploy in a production environment. I have multiple identically configured Ubuntu web servers I can use but I don't know how to scale the RoR app and db data across multiple hosts. I'd like to put both a web server and a db server on each host. On the web server/ruby middle...

How to make Dynamic Website High Scalable?

Hey How can we make a dynamic website or a website which is developed in PHP and backend as MySQL a Social Networking Site High Scalable? ...