benchmarking

Software for testing applications to increase performance.

Hi, I'm searching for software to do benchmarking, analysis, performance of code and apps. Something like Intel VTune. Can anyone give me some names, free or payed, targeting c# apps. thanks ...

Simple cross-platform code benchmarking

I'm aware of tools in the Xcode utilities for monitoring and benchmarking applications, but I'd like to test a few different (low level) implementations of library components, preferably across osx/linux/windows. Is there any framework for code benchmarking, similar to say unit tests? I'd just like some convenient api functions to accura...

Visual Studio add-in for performance benchmarking

I'd like to measure the performance of some code blocks in my c# winforms application. In particular I want to measure performance regression/improvement after some restructuring of the code. So long I've seen the System.Diagnostics.Stopwatch. However, I want to avoid writing measuring code into my classes, I would rather prefer to sepa...

Benchmarking a particular method in Objective-C

I have a critical method in an Objective-C application that I need to optimize as much as possible. I first need to take some easy benchmarks on this one single method so I can compare my progress as I optimize. What is the easiest way to track the execution time of a given method in, say, milliseconds, and print that to console. ...

Why does C# execute Math.Sqrt() more slowly than VB.NET?

Background While running benchmark tests this morning, my colleagues and I discovered some strange things concerning performance of C# code vs. VB.NET code. We started out comparing C# vs. Delphi Prism calculating prime numbers, and found that Prism was about 30% faster. I figured CodeGear optimized code more when generating IL (the ex...

How to benchmark functions in Clojure?

I know I can get the time take to evaluate a function can be printed out on the screen/stdout using the time function/macro. The time macro returns the value of the evaluated function, which makes it great to use it inline. However I want to automatically measure the runtime under specific circumstances. Is there a function which retur...

JVM performance test suite

Hi, I have just ported phoneME to our MIPS platform. I feel it runs not that fast; however, is there any performance test suite I can run against to get some quantitative measurement of the performance? I might need to pick some weak points for optimization. In addition, what are common criterions used to evalute a JVM ? ...

Benchmarks for Single and MultiThreaded programs

Hi I am trying to compare the performance of Single and Multithreaded Java programs. Are there any single thread benchmarks which are available which I could then use and convert to their multithreaded version and compare the performance. Could anybody guide me as to what kind of programs(not very small) are suitable for this empirical c...

How to measure productivity loss from slow PCs running Visual Studio?

Many PCs we have on the development team are out-dated and are very slow to run Visual Studio 2008. They should very much be replaced with newer machines. But there's a general reluctance on management/company to buy new machines. How do we come up with numbers and benchmarks to show that these slow PCs are causing a loss in productiv...

how can I Limit mysql to single cpu, to allow hardware benchmarking

I have a web application that seems to like to make mysql work hard (cpu wise), as a result i want to establish how the performance of our application scales as we transition to more modern hardware, the current system has 2 cpu, and we could move it onto a grid system, but to find out if this is worthwhile i want to benchmark our applic...

Why does it take so long to print "\n" in Perl?

Why does it take so long to print a newline? Is this just my machine, or do others see the same effect? With the newline: #!/usr/bin/perl use strict; use Benchmark; timethis(100000,'main();'); sub main { print "you are the bomb. \n"; } # outputs: # timethis 100000: 8 wallclock secs ( 0.15 usr + 0.45 sys =...

Clojure number crunching performance

I'm not sure whether this belongs on StackOverflow or in the Clojure Google group. But the group seems to be busy discussing numeric improvements for Clojure 1.2, so I'll try here: http://shootout.alioth.debian.org/ has a number of performance benchmarks for various languages. I noticed that Clojure was missing, so I made a Clojure ve...

Java profiling: java.lang.Object.hashCode takes half of the CPU time but never explictly called

I have been benchmarked my multihreaded program using -agentlib:hprof=cpu=samples and was surprised to find the following line in the results: rank self accum count trace method 1 52.88% 52.88% 8486 300050 java.lang.Object.hashCode I never explicitly call hashCode() in my program. What can be the reason for this? How can I ...

What are good test cases for benchmarking & stress testing substring search algorithms?

I'm trying to evaluate different substring search (ala strstr) algorithms and implementations and looking for some well-crafted needle and haystack strings that will catch worst-case performance and possible corner-case bugs. I suppose I could work them out myself but I figure someone has to have a good collection of test cases sitting a...

Clang vs GCC - which produces better binaries?

I'm currently using GCC, but I discovered Clang recently and I'm pondering switching. There is one deciding factor though - quality (speed, memory footprint, reliability) of binaries it produces - if gcc -O3can produce a binary that runs 1% faster or takes 1% less memory, it's a deal-breaker. Clang boasts better compile speeds and lower...

How to use clock() in C++

How do I call clock() in C++? For example, I want to test how much time a linear search takes to find a given element in an array. ...

Standard, open web application used for benchmarking

Anybody know any existing 'open' Web Applications with Source and Data that are used for Benchmarking (e.g. Shopping site with kart). Somebody is looking for something 'standard' that can be used as the subject of a performance tuning exercise. e.g. - as it stood, the XXXX application managed 2000 req/sec on Kit Y running in NetFx 2 an...

RabbitMQ message consumers stop consuming messages

Hi stackoverflowers, Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ. We made 2 little producer/consumer spikes sending an object message with an array of 16 strings, a timestamp, and 2 integers. The spikes are ok on our devs machines (messages are well consumed). Then came the benchs. We first noticed that somtime...

How do I measure variability of a benchmark comprised of many sub-benchmarks?

(Not strictly programming, but a question that programmers need answered.) I have a benchmark, X, which is made up of a lot of sub-benchmarks x1..xn. Its quite a noisy test, with the results being quite variable. To accurately benchmark, I must reduce that "variability", which requires that I first measure the variability. I can easily...

Fastest way to create random vectors for benchmarking.

So, I'm just playing around implementing some sorting algorithms in C++, but I'm finding it irritating to benchmark them at the moment, due to the length of time it takes to not run the algorithm, but to create the input data. I currently test each length of input (1000, 2000, ...) 10 times, to gain a somewhat averaged time. For each of ...