You don't need to know C# to use WPF, but there seem to be more tutorials and blogs geared towards C#. The Microsoft documentation for WPF is provided in both VB and C#.
As for dealing with a CSV file, parsing it is fairly straight-forward. What most people (in WinForm land) seem to do is parse the CSV and drop each "Column" into a DataTable. Then, a grid control was dropped on a form and populated from (or data-bound to) the DataTable. Then, after edits, the changed DataTable was read row by row and spit out again as a CSV file (I'm sure there are plenty of caveats, especially when quoting commas in strings, as just one example).
So, the difference in WPF land is that you probably don't want to take this approach. You're choosing WPF because you want to present each "row" of the CSV file in a more interesting way. Maybe you want an animated, scrolling rolodex, if each CSV row represented a contact, for example. I would start by checking out this walkthrough, because it illustrates a good design for a WPF application.
Update:
There is a DataGrid for WPF provided in the toolkit on Codeplex, but it's typically not the best choice for what WPF is designed to work with.