CME5232, Cluster and Grid Computing Technologies for Scientific Computing, Summer 2009

INSTRUCTORS: Drs Wang Jian-Sheng (first part), Murali Damodaran (second part), and Alan Edelman (additional lectures)

REFERENCE BOOKS: ``Using MPI'', 2nd edition, W Gropp, E Lusk, A Skjellum, MIT press, 1999; ``Parallel Programming with MPI'', P S Pacheco, Morgan Kaufmann, 1997.

TAs: Nguyen Van Bo ( and Dominic Denver John Chander

Lectures for the first part is at E4-04-07, Wed 10:00-11:30 and Friday 1:00-2:30, except that on 3rd week Friday it is morning 10:00-11:30. Venue for labs is Engineering Smart Classroom (E1A-04-02), Friday afternoon from 2:30. See detail schedule here.


lecture 1, Wed 1 July, survey of computer architecture and parallel programmings

lecture 2, Fri 3 July, introduction to MPI, MPI send and receive

lab 1 and help notes, 1:00-4:00 Fri 3 July, linux, serial programs

lecture 3, Wed 8 July, broadcast and reduce, and other collective communications

lecture 4, Fri 10 July, a master-slave example

lab 2 and help notes, 1:00-4:00 Fri 10 July, simple MPI, ping-ping

lecture 5, Wed 15 July, group data communication, communicators

lecture 6, Fri 17 July, Fox algorithm, topology

lab 3 and help notes, 1:00-4:00 Fri 17 July, matrix multiplication

Some sample MPI programs hello.c, messg.c, sum.c, masterslave.c, gfox.c. It is helpful to print them out and bring to class. We'll discuss them in class in detail.

SMA course website is at See also for more online resouces.