Overview

Description

CALENDAR DESCRIPTION:

Current topics in artificial intelligence depending on faculty and student interest.

COURSE DETAILS:

Special Topics Title: Trustworthy Machine Learning

Deep learning, represented by large language models, is revolutionizing human lives. However, trustworthiness threats in deep learning widely exist, posing great challenges to AI safety, security, and reliability. This course introduces state-of-the-art frontiers on deep learning research for a wide range of trustworthiness issues, including threat discovery, mitigation, and certification methods through seminar-style presentations and hands-on projects.

This is a seminar-style course for trustworthy deep learning. The first half of the course is an overview of deep learning and preliminaries for trustworthy AI methods, including training of neural networks, common neural network architectures, large language models, the definition of AI attacks, defences, and certification and verification in the context of AI. The second half of the course visits representative and recent research papers in the field through student presentations, covering topics like evasion attacks and defences, robustness certification, differential privacy, membership inference attacks, watermarks, detection of AI-generated contents, machine unlearning, prompt injection attacks, model stealing, and finetuning attacks. The course will be tentatively graded by 30% paper presentation, 20% lecture notes, and 50% course project. The course project is the implementation and improvement of a simple neural network verifier under a given framework.

There are no formal pre-requisites; however, we recommend that student complete CMPT 310 & CMPT 410 prior to taking this course. Background in algorithms, calculus, linear algebra (e.g., MATH 151, MATH 152, MATH 232, CMPT 225), CMPT 410/726 strongly recommended.

COURSE-LEVEL EDUCATIONAL GOALS:

Students will gain exposure to the following state-of-the-art research topics:

1. Deep learning basics
2. Language model basics
3. Deep learning safety and security basics
4. Robustness: Evasion attacks, data poisoning attacks, defences, and certifications
5. Privacy: Differential privacy, membership inference attacks, machine unlearning, watermarking, model stealing, and AI content generation
6. Alignment: Fine-tuning from human feedback, finetuning attacks, prompt injection attacks
7. Implementation of neural network verifier

The course will aim to develop the following skills:
- reading and summarizing the latest research papers in trustworthy and responsible AI
- advanced application of deep learning frameworks (e.g., PyTorch), especially for neural network verification
- presentation skills of professional research topics

Grading

Materials

MATERIALS + SUPPLIES:

Materials will be provided by the instructor. There will be no primary reference material -- rather, we will read an assortment of research papers, book chapters, etc.

Before the course, the Deep Learning (https://www.deeplearningbook.org/) book by Ian Goodfellow, Yoshua Bengio, and Aaron Courville is recommended. 
Also available via SFU Library: https://sfu-primo.hosted.exlibrisgroup.com/primo-explore/search?vid=SFUL

Please note: This version of the textbook is approved for student use and is provided free of charge for personal viewing and educational use. All copyrighted materials should be used in accordance with the terms of use set out by the relevant rights holders.

REQUIRED READING NOTES: