I have 357 tests (534 assertions) for my app (using Shoulda). The whole test suite runs in around 80 seconds. Is this time OK? I'm just curious, since this is one of my first apps where I write tests extensively. No fancy stuff in my app. Btw.: I tried to use in memory sqlite3 database, but the results were surprisingly worse (around 83...
Is anyone out there aware of any good or even reasonable tools for automated testing on the Windows CE / mobile platforms. Potential tools that I am aware of include TestQuest, Countdown, SOTI pocket controller, and Eggplant. Are there any more that I have missed? Alternatively, is anyone aware of a VNC or remote display tool for Wind...
I've been using the RestFixture in Fitnesse to test a REST service which is running under Tomcat. When Fitnesse is run on Linux (Redhat to be precise) the fixture doesn't pass any querystrings to Tomcat (the log entries prove this). However, the exact same fixture running through Fitnesse on a Windows machine works as expected. Has anyo...
I have been building IMO a really cool RIA. But its now close to completion and I need to test it to see if there are any bugs or counter-intuitive parts or anything like that. But how? Anytime I ask someone to try to break it, they look at it for like 3 minutes and say "it's solid". How do you guys test things? I have never used a UnitT...
Hi, I'm puzzled with this test script: #!perl use strict; use warnings; use encoding 'utf8'; use Test::More 'no_plan'; ok('áá' =~ m/á/, 'ok direct match'); my $re = qr{á}; ok('áá' =~ m/$re/, 'ok qr-based match'); like('áá', $re, 'like qr-based match'); The three tests fail, but I was expecting that the use encoding 'utf8' would u...
I'm taking a grad class on software testing and we spent a whole class on the difference between faults, errors, and failures. I was dissatisfied by the definition of a software fault in testing. What's your definition? ...
Can someone here tell me if there is something similar to LD_PRELOAD on recent versions of AIX? More specifically I need to intercept calls from my binary to time(), returning a constant time, for testing purposes. ...
If one has a project that has tests that are executed as part of the build procedure on a build machine, if a set tests fail, should the entire build fail? What are the things one should consider when answering that question? Does it matter which tests are failing? Background information that prompted this question: Currently I am w...
Are there any free SMTP servers that just accept the mail sent through them, and save it to your hard disk, without sending it to the recipient. I would like to use this for testing my applications. Instead of just waiting around for the mail to go through, it would be nice if all emails could just be dropped in a folder, so that I ca...
I've been writing tests for my domain objects for some time now, but I'm still not quite sure how to go about testing for security in my web project. Certain users in certain environments can access certain properties of my models etc, but how would you go about testing this? Right now, I'm basing it on the current authenticated user, ...
My agile team will be adding new features to a existing realty website. As we add the features we want to have a better handle on the site's overall performance as well as the performance of particular pages. I would like to automate the gathering of performance metrics on a request/response basis for each page (e.g. what sub requests...
I would like to implement the method User.calculate_hashed_password. I'm trying to use the Shoulda testing library which works with Rails's built-in testing tools, so an answer related to Test::Unit would be just as good as one related to Shoulda (I think). I'm trying to figure out what I need to test and how I should test it. My initia...
I'm building a test harness for my Delphi 2009 app. Testing the logic is fairly simple. Making sure the forms work properly is proving a bit more complicated. I'd like a way to simulate real user input, to open a form, make it think there's a user typing certain things and clicking in certain places, and make sure it reacts correctly....
I've messed with Virtual Machine software before and for me it works very well for multi-platform testing. My question is what virtual machine systems out there that are free are available that can do things like cloning, state saving and branching, and have low overhead in terms of modifying the host system. For right now I'm using Vir...
I have been doing some OO Perl programming and I was wondering: which is the best way to perform unit tests? So far I have been using the Test::Simple module to perform tests, but it feels insufficient for what I want. Can you point me to some nice modules for that? ...
I am currently developing a small project of mine that generates SQL calls in a dynamic way to be used by an other software. The SQL calls are not known beforehand and therefore I would like to be able to unit test the object that generates the SQL. Do you have a clue of how would be the best approach to do this? Bear in mind that ther...
Hi, I developed one application, and starting the testing phase soon, While I'm trying to setup a testing plan, I have one question! Shall I start by testing the actual application functionality, or the installation procedure first? (Please note that the installer is an actual project we have) Thanks, ...
Possible Duplicate: How do you stress test a web application? Currently I have configured a project with cc.net, watin and nunit and now I want to do stress, load, and performance testing of my .net projects. Any idea which opensource tool should I use or cani achive it with same working tools and if yes then how? ...
I'm reading about Rails fixtures in this guide (thanks, trevorturk). It appears you define classes in a Yaml file and they're automatically loaded into the test DB -- cool. But if you want to specify that this recipe belongs to that cookbook (or whatever) how do you do that? Are you supposed to specify the values for cookbook.id and re...
I develop a network based, multi-component software system that's designed to run on an arbitrary number of machines. I'm assuming a typical setup of 1 to 4 machines. I want to be serious about testing the system, and I have set up a network of virtual machines on a strong PC that I can use to simulate the network interaction. However, ...