Polling servers seems to be a theme that comes up for certain types of enterprise applications, particularly social networking web applications. From what I have read, people on the Unix side use memcache that can give you a few thousand requests per second. What options do Windows developers have since we don't have a memcache alterna...
We've built a social networking site for a client. It did very well and now they want to package it up and license multiple copies of the same site but branded for their client. Each site is fairly autonomous except that users on one site can access the content from users on another site, requiring that user profiles be centralized. W...
I've got a media-rich site that's going just beyond the what our server can handle in terms of storage. Estimate between 500 gigs and 2 terabytes. The media is uploaded through the website usually 500k to 30 megs at a time and are just videos and photos users have uploaded. Using the PHP FTP functions the media is then copied from the...
I'm new to using distributed caching solutions like Memcached on a large web site, I have a couple questions and could someone who has experience on these comment please. Obviously the amount of data I can put into cache depends on server RAM. Supposed I have big enough server farm and RAM, is there a max number of objects I can put i...
What searching algorithm/concept is used in Google? ...
I'm working on a PHP web interface that will receive huge traffic. Some insert/update requests will contain images that will have to be resized to some common sizes to speed up their further retrieval. One way to do it is probably to set up some asynchronous queue on the server. Eg. set up a table in a db with a tasks queue that would ...
Oracle DataGuard is a technique to replicate data stored in an Oracle RDBMS across several Oracle engine instances. I'm wondering whether DataGuard really provides a linear scalability for a RDBMS. Do you have any experiences with the DataGuard? How does it behave under heavy load conditions? ...
we are planning to implement sql server 2005 cluster in next few months. i wanted to know what steps / precautions need to be taken as a database developer when trying to achieve this? do we need to change any ado.net code (in front end) / stored procs etc etc? are there any best practices to be followed? reason i am asking this questio...
I'm working on a forum based website, the site also supports onsite messaging (ie. the users can send private messages to other users), what I'm trying to do is notify a member if they have new messages, for example by displaying the inbox link in bold and also the number of messgages, e.g. Inbox(3) I'm a little confused how this can be...
Hi I'm working on a Software-as-a-service (SAAS) application that allows companies to manage supplier information. What are the providers / vendors that can offer Billing services, including managing invoices, subscription, renewal and reminder for payment dues? I find that building this from scratch will take a lot of time. In addi...
I'm looking for a cloud computing service with the following requirements: no need to manage servers instant availability automatic scaling ability to run tasks for at least a couple of minutes Google App Engine seems to meet all of these requirements with the exception that processes can only run for 30 seconds. My application is a...
I am a total newbie to the world of SOA. As such, I am looking at some "SOA frameworks/technologies", and trying to understand how to utilize them to build a highly scalable (Facebook class) website. There are several "pains" I am trying to solve here: Composability (+ managing dependencies, Pub/Sub) Language-independence of services ...
Im trying to work out the best way scale my site, and i have a question on how mssql will scale. The way the table currently is: cache_id - int - identifier cache_name - nvchar 256 - Used for lookup along with event_id cache_event_id - int - Basicly a way of grouping cache_creation_date - datetime cache_data - varbinary(MA...
Are there well-known best practices for synchronizing tasks across a server farm? For example if I have a forum based website running on a server farm, and there are two moderators trying to do some action which requires writing to multiple tables in the database, and the requests of those moderators are being handled by different server...
I need to set up a MySQL environment that will support adding many unique databases over time (thousands, actually). I assume that at some point I will need to start adding MySQL servers, and would like my environment to be prepared for the case beforehand, to make the transition to a 2nd, 3rd, 100th server easy. And just to make it in...
What HTTP framework should I use for a simple application with implied scalability, priferable Pythonic? I would like to be able to smoothly add new features to my app when it has already been deployed. ...
I'm interested to comparison between various approaches to scalability & concurrency including CCR & DSS framework model. I would be especially interested with comparison with Hadoop and Erlang style concurency ...
Let me frame it this way.. "Say I have an application server running on a single core Intel processor & serving 200 concurrent users. Will moving the hardware to a dual core system enable my application server to now serve say 350 concurrent users" ? The base question I'm hoping to address is - "Can addition of extra processor cores h...
I am thinking about the best strategy to scale with a cluster of servers. I know there is no hard and fast rules, but I am curious what people think about these scenarios: cluster of combination app/db servers that are round robin (with failover) balanced using dnsmadeeasy. the db's are synced using replication. Has the advantage tha...
Hello, is there a scalable email service where you only pay for the emails that you send. I was thinking of a service like Amazon's AWS except for email. I have a web application that sends out email and I would the email provider to scale to the demand. Thanks. ...