benchmarking

Dependency Injection Startup Performance

I recently was asked to troubleshoot some performance problems in an application built with Microsoft's Composite UI Application block - specifically that it was taking too long to load. This is built around Microsoft's ObjectBuilder dependency injection framework, which uses reflection/attributes to register classes. Profiling indicate...

Running a managed application 2nd time shows different performance than 1st

I have a benchmarking application to test out the performance of some APIs that I have written. In this benchmarking application, I am basically using the QueryPerformanceCounter and getting the timing by dividing the difference of QPC values after and before calling into the API, by the frequency. But the benchmarking results seems to v...

What machine learning benchmarks are out there?

What repositories for machine learning benchmarks do you know? ...

Looking for benchmarking code snippet (c++)

Some loading routines in my program takes to long to complete. I want a quick small snippet for checking how long a function took to execute. By small I mean "preferably without 3rd party libraries". Maybe something as simple as taking the system time? start = current_system_time() load_something() delta = current_system_time()-start l...

Efficiency, Benchmarking, Speed-testing, Performance

Hi, I am trying to write a script whose efficiency I am trying to measure. I have a couple of questions:- For small applications, is this kind of profiling required? Or am I getting paranoid? (assuming most code is decently efficient/no infinite loops) Against what should I benchmark this? What should I compare against? Below is the e...

Svnserve VS mod_dav_svn

We plan to install a Subversion repository in an environment where the network is quite slow on its own. The previous VCS used there was VSS, and it was a nightmare to use it (not only because of its "feature"). So, my question is the choice between Svnserve and the apache module. I know that the apache module will be slower due to the ...

How do I write a correct micro-benchmark in Java?

As the title says. How do you write (and run) a correct micro-benchmark in Java? I'm looking here for code samples and comments illustrating various things to think about. Example: Should the benchmark measure time/iteration or iterations/time, and why? Near Duplicate of: http://stackoverflow.com/questions/410437/is-stopwatch-benchmar...

How to accurately measure clock cycles used by a c++ function?

I know that I have to use: rdtsc. The measured function is deterministic but the result is far from being repeatable (I get 5% oscillations from run to run). Possible causes are: context switching cache misses Do you know any other causes? How to eliminate them? ...

How to benchmark virtual machines

I am trying to perform a fair comparison of XenServer vs ESX and one comparison I would like to make is performance with multiple VMs. Does anyone know how to go about benchmarking VM performance in a fair way? On each server I would like to run a fixed number of XP/Vista VMs (for example 8) and have some measure of how quickly each one...

Matrix implementation benchmarks, should I whip myself?

Hello. I'm trying to find out some matrix multiplication/inversion benchmarks online. My C++ implementation can currently invert a 100 x 100 matrix in 38 seconds, but compared to this benchmark I found, my implementation's performances really suck. I don't know if it's a super-optimized something or if really you can easily invert a 200 ...

Best practices for performance benchmarking test..

I have a J2EE web-application running on Sun hardware with OpenSolaris/Glassfish stack. We're starting our performance benchmarking tests, to prepare for our scalability requirements later. Any guidelines/best practices would be very useful.. ...

Tool for distributed HTTP benchmarking?

I would like to benchmark a website that our company is developing. It will consist of multiple web- and backend-servers. To be able to properly simulate a large amount of request, I was thinking about using our dev machines (approx 15 Xp/Vista) and a few spare Red Hat servers as benchmarking clients. Is there any tool that would let ...

file_get_contents VS CURL, what has better performance?

I am using PHP to build a web crawler to crawl millions of URLs, what is better for me in terms of performance? file_get_contents or CURL? Thanks. ...

What do 'real', 'user' and 'sys' mean in the output of time(1)?

$ time foo real 0m0.003s user 0m0.000s sys 0m0.004s $ What do 'real', 'user' and 'sys' mean in the output of time? Which one is meaningful when benchmarking my app? ...

Unix Command For Benchmarking Code Running K times

Hi, Suppose I have a code executed in Unix this way: $ ./mycode My question is is there a way I can time the running time of my code executed K times. The value of K = 1000 for example. I am aware of Unix "time" command, but that only executed 1 instance. ...

Drain the instruction pipeline of Intel Core 2 Duo?

I'm writing some micro-benchmarking code for some very short operations in C. For example, one thing I'm measuring is how many cycles are needed to call an empty function depending on the number of arguments passed. Currently, I'm timing using an RDTSC instruction before and after each operation to get the CPU's cycle count. However, I...

Load Testing with AB ... fake failed requests (length)

To do some load testing, for my own curiosity, on my server I ran: ab -kc 50 -t 200 http://localhost/index.php This opens up 50 keep-alive connections for 200 seconds and just slams my server with requests for index.php In my results, I get: Concurrency Level: 50 Time taken for tests: 200.007 seconds Complete requests: 3...

When are Schwartzian Transforms useful?

While going through the "Intermediate Perl" book I noticed a section on Schwartzian Transforms and tried the example in the exercise (9.9.2) but noticed that multiple runs resulted in the transform taking more time then the normal sort. The code here performs a simple sort of the files in the windows\system32 directory based on file size...

Why Jython behaves inconsistently when tested with PyStone?

I've been playing recently with Jython and decided to do some quick and dirty benchmarking with pystone. In order to have a reference, I first tested cPython 2.6, with an increasing numbers of loops (I thought this may be relevant as Jython should start to profit from the JIT only after some time). (richard garibaldi):/usr/local/src/pyb...

How do I get repeatable CPU-bound benchmark runtimes on Windows?

We sometimes have to run some CPU-bound tests where we want to measure runtime. The tests last in the order of a minute. The problem is that from run to run the runtime varies by quite a lot (+/- 5%). We suspect that the variation is caused by activity from other applications/services on the system, eg: Applications doing housekeepi...