automated-tests

Can apache-jmeter check the return value of a URL for a correct response?

The set up for apache-jmeter allows for a URL to be sent to a web-server on multiple threads. I'm interested in first determining if the response codes are 200-500 and then whether the returned content is the expected content. Is this detailed configuration possible? ...

Favorite .NET Unit Testing framework

I've been using NUnit for a few years. I've tried MBUnit for a short while as well as Zenebug and XUnit but I keep coming back to NUnit. What is your favorite/most used Unit test Framework? Can you explain why you're using it? ...

Easy acceptance testing with specification

I look for a tool/framework to make automatic acceptance-testing. The interface to create new tests should be so easy, that a non-programmer (customer, boss) will be able to add specifications for which will be tested automatically. It should be some way to execute the tests from command-line, to include a run of the tests in automatic ...

How do you create tests for "make check" with GNU autotools

I'm using GNU autotools for the build system on a particular project. I want to start writing automated tests for verifcation. I would like to just type "make check" to have it automatically run these. My project is in C++, although I am still curious about writing automated tests for other languages as well. Is this compatible with pre...

Test automation using batch files:

I have the following layout for my test suite: TestSuite1.cmd: Run my program Check its return result If the return result is not 0, convert the error to textual output and abort the script. If it succeeds, write out success. In my single .cmd file, I call my program about 10 times with different input. The problem is that the pro...

Do you use WaTiR?

Is there a better unit testing tool than WaTiR (tag) for Ruby web testing? Or is the defacto standard? What unit testing tools do you use? ...

Buying a machine for continuous integration - key factors?

I'm planning to propose to my (very small) company that we buy a computer to run continous integration on. If they say yes, the task of actually buying the machine will probably fall on me, so my question is: What do I look for in a computer that will be used for continuous integration for a very small (3 people) php team? What "stuff"...

What is the single best book on Automated Testing of Websites

I am looking for the one good book to read for Automated Testing in general of a website. ...

Auto-generation of .NET unit tests

Is there such a thing as unit test generation? If so... ...does it work well? ...What are the auto generation solutions that are available for .NET? ...are there examples of using a technology like this? ...is this only good for certain types of applications, or could it be used to replace all manually written unit testing? ...

Unit testing in flex

Are there any unit testing solutions for Flex? or actionscript 3? If so, what are their features? Any UI testing abilities? Functional testing? Any pointers, examples, libraries or tools that you can share? ...

How to be successful in web user interface testing ?

We are setting up a Selenium test campaign on a big web application. The first thing we've done was to build a framework which initialize SQL data in database before the test, launch the test, archive results and then clear data. We've integrate that in a Maven 2 process, run every day by TeamCity on a dedicated database. We've set up ...

How to initialize ConnectionStrings collection in NUnit

I want to test ASP.NET application using NUnit, but it seems WebConfigurationManager.ConnectionStrings collection is empty when running from NUnit GUI. Could you tell me how to initialize this collection (probably in [SetUp] function of [TestFixture])? Should I copy Web.config somethere? Thank you! ...

performance testing for web services (Microsoft web application stress tool?)

Hi, We need to provide a solution to do performance testing for our Web Services residing in our development environment. We were planning to create the test scripts using the object model of Microsoft Web Application Stress Tool. I have researched and not been able to find any examples. Can anyone, who may have perhaps used this same...

How do you handle unit/regression tests which are expected to fail during development?

During software development, there may be bugs in the codebase which are known issues. These bugs will cause the regression/unit tests to fail, if the tests have been written well. There is constant debate in our teams about how failing tests should be managed: Comment out failing test cases with a REVISIT or TODO comment. Advantag...

Stop MSVC++ debug errors from blocking the current process?

Any failed ASSERT statements on Windows cause the below debug message to appear and freeze the applications execution. I realise this is expected behaviour but it is running periodically on a headless machine so prevent the unit tests from failing, instead waiting on user input indefinitely. Is there s a registry key or compiler flag I ...

Starting external process during integration testing in maven

I want completely automated integration testing for a Maven project. The integration tests require that an external (platform-dependent) program is started before running. Ideally, the external program would be killed after the unit tests are finished, but is not necessary. Is there a Maven plugin to accomplish this? Other ideas? ...

How to do something to each file in a directory with a batch script

How do you iterate over each file in a directory with a .bat or .cmd file? For simplicity please provide an answer that just echo's the filename or file path. ...

string symbol manipulation in batch files?

Is there a way to take substrings of a string with .bat/.cmd files? For example given the string "hello.txt" is there a way to strip the .txt? EDIT: Also is there a more general way to do this, not under the assumption that it is a file name or file path? ...

Best free resource for learning advanced batch-file usage?

What are the best free resources for learning advanced batch-file usage? ...

Converting a home-brew test application to a standard unit test framework

I've got a LOT of tests written for a piece of software (which is a GREAT thing) but it was built essentially as a standalone test in C#. While this works well enough, it suffers from a few shortcomings, not the least of which is that it isn't using a standard testing framework and ends up requiring the person running the test to commen...