COMPUTER ENG 709
Parallel and Distributed Computing
Academic year 2017-2018, term 2
Instructor: Xiaolin Wu, ITB-A315
Extension: 24190
Email: xwu@ece.mcmaster.ca
Office hours: Tuesdays 2pm~4pm
ITB-A103
Office hours: 14:00~15:00 Tuesdays, 11:00~12:00
Thursdays.
Lectures: 3 hours/week
Assignment 1: 709\Assignment 1 (MPI).pdf; MPI setup
Course Notes: MPI part I; MPI Part 2
Course Outline£º
Contents
¡¤ Parallel computers
¡¤ Simple parallel computations
¡¤ Message-passing in distributed and parallel computations
¡¤ Partitioning and divide-and-conquer methodology
¡¤ Pipelined computations
¡¤ High parallelism in image processing and computer vision
¡¤ Synchronous computations
¡¤ Introduction to GPU and CUDA
¡¤ Programming with shared memory
¡¤ Distributed shared memory systems
¡¤ Load balancing
¡¤ Applications of scientific computing
¡¤ Applications of image processing
Evaluation Scheme
¡¤ Assignments/projects
50%
¡¤ Final exam
50%
Recommended textbooks
Parallel Programming - techniques and applications, 2nd ed., Barry Wilkinson, Michael Allen, Prentice Hall ISBN: 0-13-140563-2.
Parallel Programming with MPI, Peter Pacheco, Elsevier, ISBN: 9781558603394.