automated-tests

What is the most mature BDD Framework for .NET?

We have been using BDD (from Dan North's perspective) as a mechanism to record user acceptance tests and drive development on a couple of projects, with decent success. To date though we have not actually automated the tests themselves. I am now looking in to automating the tests, but I am not sure which behaviour framework to back. So ...

Isolation level of automated BDD scenarios?

What isolation level should you be aiming for when automating your scenarios? Should they be completely isolated, as with proper unit tests (ie using mocks etc), or are they more akin to integration tests? ...

Good book or other resource on integration testing?

There are enough books on how to do unit testing. Do you know any good books (or other good resources) on integration testing? What I am particularly interested in is Define scope (unit testing < integration testing < automated func. testing What is a good and bad integration test Data access Service layers Configuration Spring or ...

Compare equality between two objects in NUnit

I'm trying to assert that one object is "equal" to another object. The objects are just instances of a class with a bunch of public properties. Is there an easy way to have NUnit assert equality based on the properties? This is my current solution but I think there may be something better: Assert.AreEqual(LeftObject.Property1, RightO...

When not / to write tests before implementation?

Title says it all (mostly). I'm not sure how "tests first" works and I'd like to hear arguments about when and why one would take this approach. I hear that it's often recommended to write tests and mock things before writing a single line of implementation. However, I can't help but think that it doesn't fit every situation. For insta...

What interesting/novel/surprising uses have you found for automated tests?

I am working on JUnitMax, a project to increase the utility of automated tests. I'm looking for novel, unexpected ways tests prove valuable. For example, I use tests in responding to defects--one at the system level that fails, reproducing the defect and another at the unit level so I know what code to change (perhaps derived using the S...

Book recommendations for automated testing

We got a lot of untested code but we want to change this, so we started writing unit and Selenium tests. But of course these tests have to be run sometimes. I know it's possible to run tests automatically. Do you know good pratice-oriented books or websites dealing with this problem? Thanks for any recommendations! ...

How can I implement TDD in Perl?

We're using mod_perl to produce data in XML and later to be converted into HTML via XSLT, and the database is in MySQL. Our OS is Unix. So I've been reading about how cool and powerful TDD is in .NET, Java with all the available frameworks. I've even tested NUnit before and I kind of like it. You can write the test once and use it prett...

Code Coverage generic functions/parameters?

I am working on some code coverage for my applications. Now, I know that code coverage is an activity linked to the type of tests that you create and the language for which you wish to do the code coverage. My question is: Is there any possible way to do some generic code coverage? Like in, can we have a set of features/test cases, whic...

Best Test Automation Tool

Currently I am working at a company that does all of its development work using VS2003, 2005, and 2008 and we have them integrated with Team Foundation Server. We do mostly Windows Apps and Websites. What is the best testing automation software that would work with our currently programs. ...

Automated testing .NET (Gallio?)

I am working on a software development project that uses code written primarily in C and C#. Currently, the responsibility of testing falls mostly on developers as they change the code. I am interested in implementing an automated testing framework to help us improve the quality of our code. In particular, it would be great to have ...

c++ continuous integration with performance metrics

I want to set up a continuous integration and test framework for my open source C++ project. The desired features are: 1. check out the source code 2. run all the unit and other tests 3. run performance tests (these measure the software quality - for example how long does it take the system to complete the test) 4. produce a report base...

Stress testing web services - best approach

Hey, I have several web services I need to create for them some testing mechanism and to use it as a tool for stress testing. What's the best way to tackle this? ...

When should you not use automated testing for a web application?

Assume I'm using an interpreted language to power a medium or large application, and that the application is tested by hand (no unit tests, not integration tests, etc). Support for said product will not be dropped any time in the foreseeable future, and new development happens daily. Are there some situations in which it would not be be...

Best tool/framework for testing a RESTful service

I'm looking for a framework or tool for testing RESTful services. This seems like it shouldn't be hard, but the tools that I've found thus far assume things about my service that they probably shouldn't. What would be great is something that could make a request (like, HTTP POST) and then compare the result with an expected result. I ...

WatiN or Selenium?

I'm going to start building some automated tests of our presentation soon. It seems that everyone recommends WatiN and Selenium. Which do you prefer for automated testing of ASP.NET web forms? Why did that product work better for you? As a side note, I noticed that WatiN 2.0 has been in CTP since March 2008, is that something to be conc...

What is the best mechanism for testing applets?

I'm trying to effectively build a functional test suite for an applet, and I'm trying to find a good framework for it. In the past, when I wanted to design a test suite that would serve as both functional and load testing on an application, it has always been a web-based application, or at least some kind of service-based application, a...

Is there a test suite for PDF files?

Is there a test suite for PDFs, preferably in Perl? What I want is some function to test positioning and existence of some text (and if possible a name of a grapic) in a PDF file. Is this theoritically possible with PDF markup? Thank you for your help. ...

How to unit-test a file writing method with Visual Studio's built-in automated tests?

I use Visual Studio 2008 Professional automated tests. I have a function that writes to a file. I want to unit test the file writing function. I have read somewhere that I would have to mock a file somehow. I don't know how to do it. Can you help? How to unit-test a method that downloads a page from the Internet? ...

Embedded (ASP.NET) web server

I am looking for a light-web embeddable web server for .NET. I need it to fake a SOAP web-service for automated testing, so it is a big plus if it supports ASP.NET web-services or another easy way to create SOAP web-services. Extra bonus points for quick startup and shutdown and multiple simultaneous instances on different ports. A Goo...