Visual Studio 2010 Does not allow F5 debugging when pointed to an IIS 7 web site when an IP address is specified on the website

Question

I have two custoerms I work on. I have one development machine (Win 7 Ultimate and Visual Studio 2010 Ultimate). For both customers I have developed websites using ASP.NET MVC. All that is cool until I try to have both website set up in IIS 7 and want to have them both F5 debuggable. Oh and did I mention both sites require that I develop under ssl to test the secure parts of the app.

I can get IIS debugging setup for 1 web site with no problems. F5 debugging only works when the website bindings are set to "All Unassigned" (for some silly reason). If I assign a specific ip address to the bindings I get errors when I try to debug but it only seems to happen when ssl is involved.

Any thoughts or points in the right direction would be great!

Thanks!