SVN is great, particularly if using the TortoiseSVN windows explorer plugin. This will let you see which files you've changed via explorer. You can allow access via svnserve which is included if you are working from the same local network. Otherwise you are better off using Apache. There are instructions on this included with SVN.
As far as using 2 flavors of Visual Studio, it is unlikely to work as a long term solution. The issue is that the project files are incompatible, so that you will be unable to share them, potentially leading to code trouble. Furthermore, Visual Studio 2010 contains extensions to C# and C++ that are not available to 2008, and if your partner uses any of them it won't be obvious until you try to compile.
On a good note, Visual Studio 2010 is free to use until April(?) at which point you can upgrade. Otherwise a copy of VS2008 standard is ~$200.