We did this type of work for over 20 years now, and the story doesn't change at all.
As you see you haven't got much choice..
The truth is with the entire reluctance and work in graphics vendor wars where you will see for example NVidia cards horribly slow down all GDI+/WinForms code, requiring double-buffering hacks, and what not.
Not only is NVidia or MSFT 'reluctant' to address acceleration or fix issues, they insist on leaving them as is and introducing even slower and horribly painted ListViews, Grids, and much more.. They also sell lots of 'half-technical garbage' on their blogs and support on this issue for over 5 years now.
WPF sucks trunks, it bloats so fast and acts like an Atari pushing Unreal Tournmaent 3. As for approaching ironically-native focus and acceleration (as they should have understood from the beginning/doh!), MILCore is supposed to help a lot with Silverlight and slimmed down CLR. But nope, it doesn't, the browsers now feel like C64.
SlimDX and TAO are probably an overkill and for XNA you'll need widget and toolkits that are starting to spring up. If you even consider doing D2D and Windows 7 say goodbye to much of your audience that simply runs XP because it is around c20% faster and about 300% faster in GDI (classic, most hardware accelerated apps) and nothing WinForm/WPF can even compare close to it...
What you are getting involved in is a dirty part of the industry and one that is littered with politics, perf problems, bugs, stories and silence/reluctance when alternatives are presented. You can still interop into partially accelerated GDI bits, but the mixing of GDI+ and GDI causing other issues as well as bring further complication that has no good workarounds.
But to answer and in hope the above saves you time as it is a long history of it.. If you want good portability, 30 times better perf than WPF or WinForms, the best way forward is to use OpenGL and OpenTK and aim at 2D. You will still see the pathetic JIT-er drag itself at times and you will have some interop work cut out, but the difference in performance is astonishing (because if someone didn't hear, we got 300 times faster hardware, yet 50 times slower apps on .NET these days).
Lastly, use good algo-s not to overload that WPF or WinForms/GDI+ crap with too many points as it chokes so hard and fast on large data sets that kids smash it by 3x faster perf even on ARM/iPhone devices.
[piece to Seattle bloating camp]