Was there a reason that the answer with this link was deleted?
Sam Holder
2010-05-06 14:48:56
QuickGraph is really good general purpose graph library. It has some implementations for walking Markov Chains. I recommend checking out the source code.