COMPUTER ENG 709

Parallel and Distributed Computing

Academic year 2017-2018, term 2

Instructor: Xiaolin Wu, ITB-A315

Extension: 24190

Email: xwu@ece.mcmaster.ca

Office hours: Tuesdays 2pm~4pm

ITB-A103

Office hours: 14:00~15:00 Tuesdays, 11:00~12:00 Thursdays.

Lectures: 3 hours/week

Assignment 1: 709\Assignment 1 (MPI).pdf; MPI setup

Course Notes: MPI part I; MPI Part 2

Course Outline：

Contents

· Parallel computers

· Simple parallel computations

· Message-passing in distributed and parallel computations

· Partitioning and divide-and-conquer methodology

· Pipelined computations

· High parallelism in image processing and computer vision

· Synchronous computations

· Introduction to GPU and CUDA

· Programming with shared memory

· Distributed shared memory systems

· Load balancing

· Applications of scientific computing

· Applications of image processing

Evaluation Scheme

· Assignments/projects

50%

· Final exam

50%

Recommended textbooks

Parallel Programming - techniques and applications, 2nd ed., Barry Wilkinson, Michael Allen, Prentice Hall ISBN: 0-13-140563-2.

Parallel Programming with MPI, Peter Pacheco, Elsevier, ISBN: 9781558603394.