Thursday, July 17, 2008

Parallel Computing with MPI - Roundup

Here's a roundup of the topics discussed on parallel computing with MPI. This was illustrated using the 2D heat equation, MPICH2, and Microsoft Visual Studio.
  1. Introducing the Heat Equation
  2. Discretization of the Heat Equation
  3. Stability Analysis and the Courant-Friedrichs-Lewy Criterion
  4. Programming the Heat Equation in C using Visual Studio
  5. MPICH2 and Visual Studio
  6. Parallel Computing in a Nutshell
  7. Measuring Parallel Performance
  8. Essential Ingredients of Message Passing
  9. MPI Warmup
  10. Parallelizing the Heat Equation

Cite as:
Saad, T. "Parallel Computing with MPI - Roundup". Weblog entry from Please Make A Note.


  1. I read your post on parallel computing, it was very useful. Thanks.

  2. can you release Part 10 please?

  3. How do you put LaTeX into your blogger posts?

  4. Hey, I was wondering if you had any idea of an ETA on part X of this series. As a high school intern, i found it really helpful, as I am writing some simulations for a cluster. I would really like to see the MPI implementation of a more complicated program like the BioHeat Equation solver.

  5. Glad you found these tutorials helpful. I will post the heat equation on July 14, 2010. You should be able to easily extend this to the bioheat equation. I don't know the specifics of your model, but with an explicit time marching scheme, you merely need to calculate the right hand side at the previous time step. I'd suggest that you first program your solver sequentially, validate your results, and then attempt to parallelize it.