Validating number of failing Junits in ANT

Question

I would like to run a JUnit regression Test Suite from within an ANT build script. The test suite has a known number of failures which we are working towards fixing. I want the build to fail if the number of failing tests increases (or changes at all if that's easier to code) - this value can be hard coded in the ANT script.

I'm looking for details on how to implement this.

Answer 1

The junit task creates and XML file with the failing tests. There's no reason you couldn't use XMLTask to count the number of failures and have a conditional fail if that value is too high.

Answer 2

Even though I'm a bit late to the party:

Another option would be to use JUnit 4 and annotate the failing tests with @Ignore.

That way they will not run, and not count as failures, but the number of ignored tests will still be printed, reminding you there is work left to do.

If a test fails for the first time, you'll get a regular failure; then you can decide whether to fix or to ignore it.

More information:

http://www.devx.com/Java/Article/31983/1954