Which kind of diagram for parallel code documentation?

Question

I have some parallel code (implemented using MPI) that needs to be documented. I'd like to have a flow-diagram describing it's high-level strategy.

What kind of diagram do you use to describe send, receive, broadcast, gather, reduction and other operations?

(EDIT: I'm equally interested in Linux/LaTeX software to do them)

Answer 1

I think it's safe to say that there are no widely-used de jure or de facto standard diagrams and diagram types in use for what you want. I tend, when I have to, to use MS Visio. On Linux I'd look first at GraphViz and, perhaps, PGF & TiKZ.

As for how to draw diagrams, I'd generally start with the nearest approximation I could find in one of the textbooks or papers knocking about my office. Introduction to Parallel Computing by Grama et al has some nice diagrams. You might learn by Googling around for terms such as 'algorithm animation' or 'visualization of algorithms'.