COMPUTER ENG 709

Parallel and Distributed Computing

Academic year 2017-2018, term 2

 

 

Instructor: Xiaolin Wu, ITB-A315

Extension: 24190

Email: xwu@ece.mcmaster.ca

Office hours: Tuesdays 2pm~4pm

 

ITB-A103

Office hours: 14:00~15:00 Tuesdays, 11:00~12:00 Thursdays.   

Lectures: 3 hours/week

 

Assignment 1: 709\Assignment 1 (MPI).pdf;  MPI setup

 

Course Notes: MPI part I; MPI Part 2

 

 

 

Course Outline

 

Contents

       Parallel computers

       Simple parallel computations

       Message-passing in distributed and parallel computations

       Partitioning and divide-and-conquer methodology

       Pipelined computations

       High parallelism in image processing and computer vision

       Synchronous computations

       Introduction to GPU and CUDA

       Programming with shared memory

       Distributed shared memory systems

       Load balancing

       Applications of scientific computing

       Applications of image processing

 

Evaluation Scheme

       Assignments/projects

50%

       Final exam

50%

 

 

Recommended textbooks

Parallel Programming - techniques and applications, 2nd ed., Barry Wilkinson, Michael Allen, Prentice Hall ISBN: 0-13-140563-2.

Parallel Programming with MPI, Peter Pacheco, Elsevier, ISBN: 9781558603394.