testing

Separate 'debug' and 'release' builds?

I think it's better to release the version of the software which your developers actually tested; I therefore tend to delete the 'debug' target from the project/makefile, so that there's only one version that can be built (and tested, and debugged, and released). For a similar reason, I don't use 'assertions' (see also http://stackoverf...

ISP Agnostic Speed Testing

What is the best way to test the speed of a LAMP based site, without factoring in the user's connection? In other words, I have a CMS and I want to see how long it takes for PHP and MySQL to do all their work. Additionally I do not have shell access to the server, it is in a shared hosting environment. ...

Do you trust code that works the first time?

I gave a coworker the man page for a C function he hadn't used before, as well as some of the parameters for it. It interacts with parts of the system external to the application he was writing, and he was surprised and pleased that it worked the first time. Then doubt set in. He now worries that though it's working now it will fail...

Differences between CruiseControl (original) and CruiseControl.NET

Are there any differences between the original CruiseControl and the .NET port? I've compared the 2, but can't find any big differences except the language it has been developed in. I want to use either one of them for (automated) testing of web applications, using Selenium and Subversion, perhaps even Groovy but don't know which to choo...

Selenium alternatives?

Selenium seems to be the mainstream tool for browser side testing and it isn't that horrible. But are there any alternatives hiding out there, even in beta phase? ...

How do you handle cross-browser compatibility testing?

Working for a small web design/development firm, we're sometimes tasked, by clients, who are unwilling to budge on their browser compatability list. Any given project could need to be tested against some combination of IE 6, 7 & 8, Firefox 2 & 3, Opera, Safari & Chrome running on OS X, Windows XP, Vista or Linux. Since the bulk of deve...

What is the value added from a smoke test?

Or maybe with our implementation of it. I'm new to the team that wants to go through the process and it seemed to confuse some of our members on the team including me. We were given what I would consider a user acceptance test or list of manual actions that you would click on through to see if everything was working. I was thinking it...

Testing Outlook VSTO Addins

I am trying to write a really simple Outlook VSTO add in that checks email that is being sent for a few simple properties. My problem is that I cannot seem to install/test the add in using Outlook. I have added unit tests that ensure the code I have written likely does what it should but that final level of integration eludes me. Any sug...

How does Microsoft's Entity Framework inhibit test driven development?

MS's entity framework is considered among developers in the agile community to inhibit test driven development. It was famously attacked by an influential group of .Net developers for not being a true reflection of the principles of the agile movement. What are the main drawbacks that an agile developer faces when using the entity fr...

How to convince management that QA is important?

I work for a small software company with less than 10 programmers. Our software is installed in dozens of places across the world. Our code base is huge, due mostly to poor design and massive amounts of duplication of code (IMO). We have roughly 30 different projects, each with a total of about 600 KLOC with about 200 KLOC of that bei...

What is the best mechanism for testing applets?

I'm trying to effectively build a functional test suite for an applet, and I'm trying to find a good framework for it. In the past, when I wanted to design a test suite that would serve as both functional and load testing on an application, it has always been a web-based application, or at least some kind of service-based application, a...

What have you used to test (functional/load/stress) your network service with its custom protocol?

I recently created a turn-based game server that can accept 10s of thousands of simultaneous client connections (long story short - epoll on Linux). Communication is based on a simple, custom, line-based protocol. This server allows clients to connect, seek for other players in game matches, play said games (send moves, chat messages, ...

Is there a test suite for PDF files?

Is there a test suite for PDFs, preferably in Perl? What I want is some function to test positioning and existence of some text (and if possible a name of a grapic) in a PDF file. Is this theoritically possible with PDF markup? Thank you for your help. ...

Why does this simple Rails unit test fail when the actual is the same as the expected?

I have an extremely simple unit test. I'm not sure why it fails when the expected is the same as the actual! Here is the method I am testing: def calibration_constant big_decimal = self.coefficient * (10**self.exponent) return big_decimal.to_f end Note, that coefficient is "6.1" and exponent is "1" Here is the relevant test lin...

Can someone help explain Fit Testing to me?

So this is something that has been at the back of my mind for a while. I've seen mentions of it, I've read the fitness web page and I still don't quite grok it. It seems like Fitnesse is yet another testing framework like NUnit or MbUnit or any of the others because you define inputs and outputs that you want to see but it seems to b...

What's your choice for testing your program in a virtual machine?

When testing our software on several different systems (98-XP-Vista-Seven-Linux-etc), I think that the best choice is to use virtualized systems. What's your choice: VMware, Virtual Box or MS Virtual PC/Server? and why? ...

Rails unit tests fail because of unique constraint on schema_migrations

I'm trying to run rake test:units and I keep getting this: Mysql::Error: Duplicate entry '2147483647' for key 1: INSERT INTO `ts_schema_migrations` (version) VALUES ('20081008010000') The "ts_" is there because I have ActiveRecord::Base.table_name_prefix set. I'm confused because there is no value '20081008010000' already in the tabl...

What technology is suitable for this application?

Right now at work, the an application we have is being tested by QA guys and the app sends requests to a server. The downside of this is that the client can only request and cannot modify the files on the server for testing different test cases without contacting one of the programmers. I've been tasked with researching an implementati...

Faking time without changing Windows system clock

Does anybody know of a Windows tool to report fake dates/times to a process? Apparently there are Linux programs that can be used to test how the software will react in the future / in a different timezone or to trigger scheduled tasks without actually modifying the system clock. Are there such programs for Windows? ...

Where does Rails store data created by saving activerecord objects during tests?

Where does Rails store data created by saving activerecord objects during tests? I thought I knew the answer to that question: obviously in the _test database. But it looks like this is not true! I used this system to test what's happening to saved ActiveRecord data during rspec tests: $ rails -d mysql test $ cd test $ nano config/d...