Simon Fraser University
Engaging the World

Course Outlines

Fall 2026 - CMPT 479 D300

Special Topics in Computing Systems (3)

GPU ARCH and Programming

Class Number: 6550

Delivery Method: In Person

Overview

  • Course Times + Location:

    Sep 9 – Dec 6, 2026: Wed, 9:30 a.m.–12:20 p.m.
    Burnaby

  • Prerequisites:

    CMPT 201 or CMPT 300 or ENSC 351, with a minimum grade of C-.

Description

CALENDAR DESCRIPTION:

Current topics in computing systems depending on faculty and student interest.

COURSE DETAILS:

This course teaches the principles of Graphics Processing Units (GPUs) Architecture and Programming.

The course is being taught for the first time, so please expect some changes in covered topics and grading guidelines.

In addition to textbook reading, students will be required to read original research papers, complete a few homework assignments and a large programming project. The course is cross-listed with a graduate course: CMPT 982 G400.

Topics

  • Architecture of Modern GPUs including threads, warps, synchronization, SIMD hardware, thread block and warp scheduling, control divergence
  • GPU memory hierarchy and architecture 
  • GPU architecture performance optimizations
  • Heterogeneous data-parallel computing using CUDA
  • Examples of CUDA programs and optimizations for convolution, reduction, sorting, and matrix multiplication. 
  • Time-permitting: Graph operations, convolutional neural networks, and Attention in Large Language Models

COURSE-LEVEL EDUCATIONAL GOALS:

Students should expect to achieve the following: 

  • Learn the basics of GPU compute and memory architecture
  • Ability to write programs for GPUs using CUDA
  • Ability to read, review and present research papers
  • Collaborate on a large programming project using CUDA

Grading

NOTES:

Tentative Grading Guidelines: Exams and Quizzes: 40%. Homework Assignments: 20%. Project: 40%. 

Students must attain an overall passing grade on the weighted average of exams in the course in order to obtain a clear pass (C- or better).

REQUIREMENTS:

Pre-requisites: CMPT 295 and CMPT 431 or equivalents, both with a grade of C- or better.
Programming experience in C++.

Materials

REQUIRED READING:

Wen-mei W. Hwu, David B. Kirk, Izzat El Hajj, "Programming Massively Parallel Processors: A Hands-On Approach," 5th Edition, Morgan-Kaufmann, 2026.
ISBN: 978-0443439001

RECOMMENDED READING:

NVIDIA Corp., "CUDA C++ Programming Guide, Release 13.3," Available online: https://docs.nvidia.com/cuda/pdf/CUDA_C_Programming_Guide.pdf

Selected Research Papers on GPU Architecture and Programming (TBD)

Department Undergraduate Notes:

The following are default policies in the School of Computing Science. Please check your course syllabus whether the instructor has chosen a different policy for your class, otherwise the following policies apply.

  • Students must attain an overall passing grade on the weighted average of exams in the course in order to get a D or higher.

 

  • All student requests for accommodations for their religious practices must be made in writing by the end of the first week of classes, or no later than one week after a student adds a course. After considering a request, an instructor may provide a concession or may decline to do so. Students requiring accommodations as a result of a disability can contact the Centre for Accessible Learning (caladmin@sfu.ca).

 

  • Use of AI tools by students for completing graded scholarly activities and course submissions that has not been explicitly authorized by the instructor  will be considered as plagiarism under SFU’s Code of Academic Policy (http://www.sfu.ca/policies/teaching/t10-02.htm).  Following this policy, instructors will report all instances of plagiarism to the academic integrity board.  

Registrar Notes:

ACADEMIC INTEGRITY: YOUR WORK, YOUR SUCCESS

At SFU, you are expected to act honestly and responsibly in all your academic work. Cheating, plagiarism, or any other form of academic dishonesty harms your own learning, undermines the efforts of your classmates who pursue their studies honestly, and goes against the core values of the university.

To learn more about the academic disciplinary process and relevant academic supports, visit: 


RELIGIOUS ACCOMMODATION

Students with a faith background who may need accommodations during the term are encouraged to assess their needs as soon as possible and review the Multifaith religious accommodations website. The page outlines ways they begin working toward an accommodation and ensure solutions can be reached in a timely fashion.