performance

Filesystem seek performance with lots of tiny files

I'm looking to build a server with lots of tiny files delivered by an XML API. It won't be doing a whole lot of iterating over directories or blocks of sequential files--we're talking lots and lots of seeks for discontinuous data. Will seek time on BSD UFS degrade over time for requests for individual files? I understand that the files...

How do you maximize server performance?

I have been trying to get my head around to understanding performance and scalability and would like to know what developers/sysadmins are doing to juice their systems. To standardize the answers, it would help if you could take your best shot at responding to any of the following: Profile - Magazine publication on Joomla; Jobs board o...

Data driven design problem - data counting

I want to provide about 10 different 'statistics' to my users. Each stat represents the count returned by a different query of my database. Each stat/query is specific to the current user. What is going to be the most efficient way to achieve this? Am I right to think that running the stat queries, for each user on each page of my site (...

Performance impact of using aop

We have started to use spring aop for cross cutting aspects of our application (security & caching at the moment). My manager worries about the performance impact of this technology although he fully understands the benefits. My question, did you encounter performance problems introduced by the use of aop (specifically spring aop)? ...

Scalability and Performance of Web Applications, Approaches?

What various methods and technologies have you used to successfully address scalability and performance concerns of a website? I am an ASP.NET web developer exploring .NET remoting with WCF with SQL clustering and am curious as to what other approaches exist (such as the ‘cloud’). In which cases would you apply various approaches (for ...

Do SQL Views retain relationship information in terms of performance?

Consider the tables: (-> denotes a SQL defined relationship) USER (userid, username, imageid->IMAGE.imageid) EVENT (eventid, userid->USER.userid, description) IMAGE (imageid, location) Say I have a view (let's call it vw_UserInfo) defined as the following query. SELECT u.*, i.* FROM users u INNER JOIN images i ON i.imageid = u.imagei...

What have you used to test (functional/load/stress) your network service with its custom protocol?

I recently created a turn-based game server that can accept 10s of thousands of simultaneous client connections (long story short - epoll on Linux). Communication is based on a simple, custom, line-based protocol. This server allows clients to connect, seek for other players in game matches, play said games (send moves, chat messages, ...

Choosing adequate spec servers for ASP.NET application

Hi, I'm working on an application that's due to launch soon and could do with some advice on how to go about choosing servers of the appropriate configuration so everything performs well. The app is .NET 3.5, using SQL express edition for the DB. We currently have one low spec server being used as a staging environment for testing, it'...

What does MySQL do if you attempt to update a table that is being queried?

I have a very slow query that I need to run on a MySQL database from time to time. I've discovered that attempts to update the table that is being queried are blocked until the query has finished. I guess this makes sense, as otherwise the results of the query might be inconsistent, but it's not ideal for me, as the query is of much lo...

Does Google Analytics have peformance overhead?

To what extent does Google Analytics impact performance? I'm looking for the following: Benchmarks (including response times/pageload times et al) Links or results to similar benchmarks One (possible) method of testing Google Analytics (GA) on your site: Serve ga.js (the Google Analytics JavaScript file) from your own server. Upda...

Java Reflection Performance

Does creating an object using reflection rather than calling the class constructor result in any significant performance differences? ...

Is there any way to check if an iterator is valid?

For two threads manipulating a container map for example, what the correct way to test whether an iterator still valid (for performance reason) ? Or would be of only indirect way that this can be done. The sample code for this : #define _SECURE_SCL 1 //http://msdn2.microsoft.com/en-us/library/aa985973.aspx #define _SECURE_SCL_THROWS 1 ...

MySQL performance bottlenecks

I have a rather simple query SELECT col1 FROM table1 This command outputs about 300K+ entries per second, which sounds reasonable, yet other methods for mass decoding of saved data (e.g. array deserialization) works at the limit of what the hard drive enables, i.e. 40-50 MB/s, compared with 2-3 MB/s with MySQL. I see that my MySQL ma...

What does "Polling caught an exception, restarting polling." error mean?

We recently discovered the below error in our log which happened before our Reporting Services going down. Our servers have been very slow lately and wondering if this could be part of the problem. Error Message: "Polling caught an exception, restarting polling. Error Message System.Data.SqlClient.SqlException: Timeout expired." ...

Performance counter for "Largest free region"?

I'm debugging an out-of-memory exception. When I get the exception, the "virtual bytes" performance counter indicates plenty of addressable space. The problem, however, is that the addressable space is badly fragmented, and the "Largest free region" (returned from !address in WinDbg) is too small. To measure the memory fragmentation, ...

Simplest way to get the number of calls to an MSSQL2000 Server

Hi All, Does anyone know how one can get the total number of calls to an MSSQL2000 server during a specified time, let’s say 24 hours? We want figures of how many calls our production machine gets per day, but we can’t find any good tools/strategies for this. Best regards Fredrik ...

Is a View faster than a simple Query?

Is a select * from myView faster than the query itself to create the view (in order to have the same resultSet): select * from ([query to create same resultSet as myView]) ? It's not totally clear to me if the view uses some sort of caching making it faster compared to a simple query. Any help would be appreciated! ...

Highest Performance Database in Java

I need ideas to implement a (really) high performance in-memory Database/Storage Mechanism in Java. In the range of storing 20,000+ java objects, updated every 5 or so seconds. Some options I am open to: Pure JDBC/database combination JDO JPA/ORM/database combination An Object Database Other Storage Mechanisms What is my best opti...

Is there any reason for numeric rather than int in T-SQL?

Why would someone use numeric(12, 0) datatype for a simple integer ID column? If you have a reason why this is better than int or bigint I would like to hear it. We are not doing any math on this column, it is simply an ID used for foreign key linking. I am compiling a list of programming errors and performance issues about a product, ...

SQL Server: Query fast, but slow from procedure

A query runs fast: DECLARE @SessionGUID uniqueidentifier SET @SessionGUID = 'BCBA333C-B6A1-4155-9833-C495F22EA908' SELECT * FROM Report_Opener WHERE SessionGUID = @SessionGUID ORDER BY CurrencyTypeOrder, Rank subtree cost: 0.502 But putting the same SQL in a stored procedure runs slow, and with a totally different execution plan CR...