Spring 2023 - CMPT 461 D100

Computational Photography and Image Manipulation (3)

Class Number: 6729

Delivery Method: In Person

Overview

  • Course Times + Location:

    Jan 4 – Apr 11, 2023: Mon, 12:30–1:20 p.m.
    Burnaby

    Jan 4 – Apr 11, 2023: Thu, 12:30–2:20 p.m.
    Burnaby

  • Exam Times + Location:

    Apr 24, 2023
    Mon, 3:30–6:30 p.m.
    Burnaby

  • Prerequisites:

    CMPT 361, (MACM 201 or CMPT 210), and MACM 316, all with a minimum grade of C-.

Description

CALENDAR DESCRIPTION:

Computational Photography is concerned with overcoming the limitations of traditional photography with computation: in optics, sensors, and geometry; and even in composition, style, and human interfaces. The course covers computational techniques to improve the way we process, manipulate, and interact with visual media. The covered topics include image-based lighting and rendering, camera geometry and optics, computational apertures, advanced image filtering operations, high-dynamic range, image blending, texture synthesis and inpainting. Students with credit for CMPT 451 may not take this course for further credit.

COURSE DETAILS:

This is a complex course consisting of multiple stages. In the first 2 weeks, we have an overview of fundamental image processing followed by fundamental computational photography topics in mathematical modeling and also in real-world film production environments through guest lectures. The latter part of the course follows a research-heavy curriculum. 2 hours of each week is dedicated to deep dives to fundamental topics in image manipulation including edit propagation and soft segmentation, and computational photography including monocular depth estimation and intrinsic decomposition, relating multiple papers on each topic with each other in terms of mathematical modeling. 1 hour each week is reserved for all-together open-ended discussions on term projects and research papers. Students form project groups and each projects develops their own photography project through discussions with the instructor. Each student also prepares a detailed video presentation of a selected research paper, which is watched and discussed together in class at the end of the semester. Flipped classroom setup in overview weeks allows for covering any open questions of students on fundamental topics, and also discussing the research field in general, introducing coding tools for photography etc. This is done in an open environment where every student participates in the discussion. In the research-focused lectures, we go over very detailed formulations directly from pdf's of papers. In the discussion hours, the students casually talk about their plans for their project or bring up problems they came across. The students define and create unique applications in project groups. The collaboration is enhanced through weekly check-ins and discussions during lecture hours.

Grading

  • Group project 50%
  • Paper discussion and video 30%
  • Programming assignments 20%

REQUIREMENTS:

Background on image processing and computer vision (CMPT 361)

Materials

REQUIRED READING NOTES:

Your personalized Course Material list, including digital and physical textbooks, are available through the SFU Bookstore website by simply entering your Computing ID at: shop.sfu.ca/course-materials/my-personalized-course-materials.

Registrar Notes:

ACADEMIC INTEGRITY: YOUR WORK, YOUR SUCCESS

SFU’s Academic Integrity website http://www.sfu.ca/students/academicintegrity.html is filled with information on what is meant by academic dishonesty, where you can find resources to help with your studies and the consequences of cheating. Check out the site for more information and videos that help explain the issues in plain English.

Each student is responsible for his or her conduct as it affects the university community. Academic dishonesty, in whatever form, is ultimately destructive of the values of the university. Furthermore, it is unfair and discouraging to the majority of students who pursue their studies honestly. Scholarly integrity is required of all members of the university. http://www.sfu.ca/policies/gazette/student/s10-01.html