Multiprocessors, February 2015

 

This site concerns a lecture given as part of the course multiprocessors. This lecture, given by prof. dr. J.J. Lukkien address the software issues around multiprocessors. Specifically, the following topics are discussed.

ˇ        Abstraction, through the operating system

ˇ        Parallel program design aspects

ˇ        Language and middleware support for mapping

ˇ        Performance analysis

 

Books: there are many books on the subject. Two fairly recent ones that are quite good are the following.

 

ˇ        Structured Parallel Programming: Patterns for Efficient Computation, by McCool, Reiner and Robison, 2012.

ˇ        Parallel Programming: for Multicore and Cluster Systems, by Rauber and Rünger, 2010

Somewhat older:

ˇ        Introduction to Parallel Computing, 2nd edition, Grama, Gupta et.al., ISBN 0-201-64865-2, Benjamins/Cummings publishing, 2003.

ˇ        Fundamentals of Parallel Processing, Jordan, Alaghband, ISBN 0-13-901158-7, Prentice Hall, 2003.

ˇ        A.S. Tanenbaum, M. van Steen, Distributed Systems, Principles and Paradigms, Prentice-Hall, 2002, and 2007

An article that discusses measuring communication link performance through the ping-pong benchmark is

ˇ        Comparison of communications on the Intel iPSC / 860 and Touchstone Delta, Parallel Computing 18 (1992), pp.1067-1072.

A site with a tutorial, similar in content as the above slides

ˇ        https://computing.llnl.gov/tutorials/parallel_comp/