testing

Windows Forms: Screen capture when running non-graphically (i.e. screensaver is active)

I've got an application that is very graphics intensive and built on DirectX and Windows Forms. It has an automation and replay framework around which is built an automated testing system. Unfortunately, when the tests run unattended during a nightly build, the display is inactive or tied up with the screensaver, and our IT security poli...

Forking subprocesses in Perl unit tests stops prove; Test::Harness exiting

Hi, I have been trying to use the Perl utility/module "prove" as a test harness for some unit tests. The unit tests are a little more "system" than "unit" as I need to fork off some background processes as part of the test, Using the following... sub SpinupMonitor{ my $base_dir = shift; my $config = shift; my $pid = fork(); ...

Best concrete "how-to manual" on MANAGING Test Driven and/or Agile development?

Obligatory up-front clarification: I have a great boss. Very smart guy. Respectful towards all. Dude is awesome. Seriously. Now for my question: I am looking for an easily digestible book to possibly present to my boss/team. Background info: More and more of our meetings at work involve my boss/team pondering how to implement ...

How to get the most out of being a manual tester

As a student, I have just got my first co-op job as a manual tester. I know it is as intellectual and demanding a job as a coder, but I cannot help thinking the other way around. I love being a coder but it is my first job. So I am asking you for any advice on how I can get the most out of the manual black-box testing job, i.e how can I ...

How to keep automated tests fast?

Automated tests MUST be fast to reflect real time project state. The idea is that: after any commit to repository automated build is performed (as fast as it can be done). if build succeeded automated tests are started. MUST be fast. This is the best way i know to find out if your changes break anything. At first it seemed that maki...

ASP.NET Session Timeout Testing

I'm a doing some blackbox testing of a ASP.Net website and I need to test different session timeout scenarios. I'm not sure they fully encapsulated session timeouts. Other then leaving a page open for 20 minutes is there an easier way to force a session timeout? ...

How do you organize your release tests?

In the company where I work we have major releases twice every year. Extensive testing (automated and manual) is done the weeks before. The automated tests produce logfiles, the results of the manual tests are written down in test plans (Word documents). As you can imagine this results in a lot of different files to be managed and inter...

Design for test OR Stop designing for test

Hi! So which is better. Do we start letting Tests design our code. Do we start introducing constructor injection for dependencies just to make code testable? or do we use the "override" protected method & sub class the class under test. ...

How to organize C++ test apps and related files?

I'm working on a C++ library that (among other stuff) has functions to read config files; and I want to add tests for this. So far, this has lead me to create lots of valid and invalid config files, each with only a few lines that test one specific functionality. But it has now got very unwieldy, as there are so many files, and also lots...

automated system testing approaches for combination of PC + embedded SW

The system consists of a hardware device and a PC. The PC runs a GUI that controls the hardware device. To test the device various test hardware is used that can be controlled by RS232 or GPIB. To automate this testing the test software would have to control the test hardware and interact with the PC GUI. What is the best way you know o...

What is your "generic" web application testing plan ?

Like, testing for : invalid inputs (strings containing "'"s) giving random id's in url parameters to access "unauthorized" pages prevent sql injection ... ...

How to make junit testing to stop after first failing test

Is there a way to make running junit test to stop after a test fails? ...

Automagic unit tests for upholding Object method contracts in Java?

When developing Java applications, I often override Object methods (usually equals and hashCode). I would like some way to systematically check that I'm adhering to the contract for Object methods for every one of my classes. For example, I want tests that assert that for equal objects, the hash code is also equal. I'm using the JUnit...

How will you categorise the various software testing methods?

Would this be right?? Black Box 1.1 Functional 1.1.1 Equivalence 1.1.2 BVA 1.1.3 Use case 1.1.4 Regression 1.1.5 UAT 1.2 Non Functional 1.2.1 Testing the System Design White box 2.1. Functional 2.1.1 Unit 2.1.2 Integration 2.1.3 System Do the above fall under the right categories?...

Are there any good open source BDD tools for C/C++?

I love the Ruby RSpec BDD development style. Are there any good tools for doing this with C/C++? ...

In agile like development, who should write test cases?

Our team has a task system where we post small incremental tasks assigned to each developer. Each task is developed in its own branch, and then each branch is tested before being merged to the trunk. My question is: Once the task is done, who should define the test cases that should be done on this task? Ideally I think the develope...

What is Code Coverage and how do YOU measure it?

What is Code Coverage and how do YOU measure it? I was asked this question regarding our automating testing code coverage. It seems to be that outside of automated tools it is more art than science. Anyone have any real world examples of how they use code coverage? ...

Writing Quality Tests

we know that code coverage is a poor metric to use when gauging the quality of test code. we also know that testing the language/framework is a waste of time. on the other hand, what metrics can we use to identify quality tests? are there any best practices or rules of thumbs that you've learned to help you identify and write higher qu...

How to best write an RSpec custom matcher to test access control in a Rails app

OK, so instead of writing a whole bunch of access control specs, and duplicating them across many of my spec files, I'm looking to create a custom matcher. So instead of this: describe "access control" do it "should prevent access by non-logged-in users" it "should prevent access by normal users" it "should prevent access by edito...

How do you test running time of VBA code?

Is there code in VBA I can wrap a function with that will let me know the time it took to run, so that I can compare the different running times of functions? ...