Fall 2021 - IAT 432 D100

Design Evaluation (3)

Class Number: 4857

Delivery Method: In Person

Overview

  • Course Times + Location:

    Sep 8 – Dec 7, 2021: Wed, 9:30 a.m.–12:20 p.m.
    Surrey

  • Prerequisites:

    IAT 334 with a minimum grade of C- and completion of 60 units. Recommended: IAT 201 and 235.

Description

CALENDAR DESCRIPTION:

Examines evaluation concepts and methods for designers. Introduces a range of evaluation approaches including informal usability studies, lab experiments, field studies, and analytically-based evaluations. Students will explore techniques for feedback including usability tests, observation, interviews, heuristic reviews, and discursive evaluations. Underlying concepts of evaluation including scientific experimentation, ethnography, phenomenology, and aesthetics will be discussed. Students will learn how to design and implement appropriate evaluation studies for a range of design projects.

COURSE DETAILS:


Topics
This course examines evaluation concepts and methods for interaction designers. Evaluation in Interaction Design is challenged by the breadth of issues to be evaluated.  For this reason, evaluation spans a range of approaches including interpretive analysis, empirical studies, and scientific analysis.  This course will enable students to design appropriate evaluation studies for a range of design situations and user experiences.   The course analyzes a range of evaluation approaches including informal evaluation, usability studies, heuristics, controlled experiments, query-based evaluation, observational studies and field studies. Students will explore techniques for generating feedback including observation, interviews, expert reviews, and quantitative and qualitative analysis.  Underlying concepts of evaluation including scientific observation, ethnography, and phenomenology will be discussed. Students will learn how to design and implement appropriate evaluation studies for a range of computing environments.

COURSE-LEVEL EDUCATIONAL GOALS:

Learning Outcomes
Students will be able to:

  1. Understand foundational concepts and be able to differentiate between different approaches and methods that can be considered when undertaking evaluation during interaction design
  2. Analyze aspects of evaluation within a design situation including the goals, users, stakeholders, ethical considerations, context and desired outcomes
  3. Apply selected evaluation techniques such as controlled experiments, questionnaires, video evaluations, field studies, and analytically-based evaluations for single-user and/or collaborative systems for a particular design evaluation problem
  4. Critically analyze and document the results from a range of design evaluation techniques for different stakeholders
  5. Plan and work with an external client (e.g. industry, community group, NGO, government organization) to conduct a design evaluation to address the client's user research pr product evaluation problem, including the selection of an appropriate evaluation technique and critical assessment of the chosen method. 

Grading

  • Individual Assignments 35%
  • Group Assignments 40%
  • Exam 25%

NOTES:

Your total course grade will consist of the following percentage breakdown:

  • 35% Individual Assignments 
  • 40% Group Assignments (Client Project)
  • 25% Exam
Students must get at least 50% in each of the above components of the course in order to pass.  

In the case of team / group assignments, they must be completed as a group with your respective team members or you will receive 0 marks for them.  All individual components must be completed individually or you will receive 0 marks for them.  

Your TA and Instructor will have final say over who are your group/team members.

At the discretion of the current instructor, you can earn up to 2% bonus by participating in designated research studies within SIAT or if studies are not available, conduct a paper review (from a pre-selected/approved evaluation paper) as a learning experience to broaden your understanding of research in interactive arts and technology.  This includes 1% per study (or paper review) that you participate in.

Materials

MATERIALS + SUPPLIES:

Technology: You will need a stable internet connection, a web browser that can run Zoom (Google Chrome works well, you do not need the Zoom application), Microsoft Office available to SFU students  (Word and Excel), and the Slack application (download WinAndroid or Mac). 


REQUIRED READING:

“Handbook of Usability Testing: How to Plan, Design & Conduct Effective Tests” (2008) by Jeffrey Rubin, Dana Chisnell, Jared Spool; 2nd Edition; Wiley.

Note: this is available as an ebook in the library.


ISBN: 9780470185483

“Doing Psychology Experiments” (2007) by David Martin; 7th Edition; Nelson ISBN: 9780495115779. 

Note: This book will be available for purchase online through SFU bookstore.

Registrar Notes:

ACADEMIC INTEGRITY: YOUR WORK, YOUR SUCCESS

SFU’s Academic Integrity web site http://www.sfu.ca/students/academicintegrity.html is filled with information on what is meant by academic dishonesty, where you can find resources to help with your studies and the consequences of cheating.  Check out the site for more information and videos that help explain the issues in plain English.

Each student is responsible for his or her conduct as it affects the University community.  Academic dishonesty, in whatever form, is ultimately destructive of the values of the University. Furthermore, it is unfair and discouraging to the majority of students who pursue their studies honestly. Scholarly integrity is required of all members of the University. http://www.sfu.ca/policies/gazette/student/s10-01.html

TEACHING AT SFU IN FALL 2021

Teaching at SFU in fall 2021 will involve primarily in-person instruction, with approximately 70 to 80 per cent of classes in person/on campus, with safety plans in place.  Whether your course will be in-person or through remote methods will be clearly identified in the schedule of classes.  You will also know at enrollment whether remote course components will be “live” (synchronous) or at your own pace (asynchronous).

Enrolling in a course acknowledges that you are able to attend in whatever format is required.  You should not enroll in a course that is in-person if you are not able to return to campus, and should be aware that remote study may entail different modes of learning, interaction with your instructor, and ways of getting feedback on your work than may be the case for in-person classes.

Students with hidden or visible disabilities who may need class or exam accommodations, including in the context of remote learning, are advised to register with the SFU Centre for Accessible Learning (caladmin@sfu.ca or 778-782-3112) as early as possible in order to prepare for the fall 2021 term.