Does VS2010 Code Coverage support nUnit?

Question

According to this schema VS2010 Premium and Ultimate has a tool for checking Code Coverage - together with a few other testing tools. Does this support nUnit too, or just MS test?

Answer 1

To my knowledge it doesn't. Our TestMatrix tool does though.

Answer 2

Theoretically, it should. There is even documentation for it on MSDN. Basically, you need to set up a "generic test project" which wraps the NUnit test. In practice, I've been trying to get it to work for almost three hours now and it still doesn't. The assembly is instrumented, but there are no coverage results.

I always get this message: "Empty results generated: none of the instrumented binary was used. Look at test run details for any instrumentation problems.", but no problems are reported in that file.

Also, a VSPerf error in the event log pops up. I submitted this as a bug to Microsoft. However, this might be related to my machine. Since I submitted that bug just now, I don't know yet whether others can reproduce the issue or not.

Answer 3

It's doable, but requires a bit of setup. I just got it working with xUnit. Presumably the below will work with NUnit too.

For this to work, you'll need three projects

• The System Under Test -- SUT
• A testing project using your favorite unit testing framework -- xUnitTest

• A VS Test Project -- VSTest

  1. Create the VSTest project (breath easy)
  2. Delete the default UnitTest1.cs file
  3. Add a "Generic Test" to VSTest
  4. Specify the full path to the win32 version of the console runner for your testing framework, such as xunit.console.x86.exe
  5. Specify the full path to the xUnitTest dll
  6. Under the VS Test Menu->Edit Test Settings->Local->
  7. Data & Diagnostics "Tab"
  8. Make sure only Code Coverage is enabled
  9. Select Code Coverage row, then click the "Configure" button above (yes, this is a well designed UI :)
  10. In the "Code Coverage Detail" dialog
  11. Select both the dlls for SUT and xUnitTest
  12. Enable "Instrument assemblies in test"

Now when you run the VS2010 test, it'll correctly instrument the test dlls, run the code runner and gather the info into Visual Studio.

Answer 4

After fiddling with this for a little over an hour, I could not get it to work properly. I was able to get the generic test running properly with instrumentation for NUnit 2.5.5 using nunit-console.exe. Although the NUnit console runner ran my test successfully via the generic VSTest, I was never able to generate code coverage results.

Although the test features of VS2010 sound great when reading about them, the implementation seems overly complex and very heavy. I've been using NUnit for years with great success and very low friction.

I decided to try out JetBrains dotCover beta and within 5 minutes I downloaded it, installed it, and was able to configure and use it very successfully. It integrates seemlessly into ReSharper 5 and just worked for my NUnit tests. The code highlighting is a great visual tool to quickly locate blocks of code that were not executed by the tests.

Answer 5

You need to turn off shadowcopy in NUnit to get it to work

Answer 6

I tried every method I found on Google to enable that and then decided to give TestDriven.NET a try. It worked brilliantly: right-clik on the solution, test with coverage and done. Seriously, it couldn't be any easier.