Overview

Description

CALENDAR DESCRIPTION:

Course can be repeated for credit. Students may not take this course for further credit if similar topics are covered. See Psychology department website for course description.

COURSE DETAILS:

Psyc 402/715 - Test Theory

Test Theory is that branch of psychometrics that deals with quantitative approaches to the adjudication of the performance of a test/inventory. In this course, students will learn the true meanings of fundamental test theory concepts such as dimensionality, reliability, and validity, as well as the logic inherent to each of classical and modern test theory. Additionally, they will learn how to carry out test analyses using relevant software packages (notably, SPSS, R: Lavaan, R: ltm, IRTPro, Maple), and, on the basis of these analyses, render coherent adjudications.

 

Psyc402/715 will be comprised of three parts:

 

i. Fundamentals/background

 

•  Introduction [tests, compositing rules, composites, classical test theory, modern test theory]
•  Random variables, random vectors, multivariate distributions
•  Expectation algebra, covariance algebra
•  Matrix Algebra

 

ii. Classical test theory

 

•  classical true-score framework
•  classical results
•  classical notions of validity

 

iii. Modern test theory

 

•  sequential nature of test analysis
•  dimensionality
•  optimal test composites
•  modern estimation of reliability
•  analysis of tests with particular theoretical structures

 

Undergraduates in the 402 section receive letter grades; graduates in the 715 are graded as successful/unsuccessful.

COURSE-LEVEL EDUCATIONAL GOALS:

Note: The aim of the course will be to bring everyone to a high level of understanding. Although I will have to do a fair bit of lecturing, what I will be aiming for in class is a relaxed, conversational, and graduate seminar-like feeling. I do not want this course to feel rushed and high-pressured. I would like everyone to be able to relax and come to a very high level of mastery of this essential material. We will move through the material at a pace that will allow everyone to master it.

Components of course

This course is a face-to-face, in-person, offering supported by materials available to the student through weekly access to Canvas modules.

 

Lectures and lecture notes

Lectures, and the lecture notes on which they are based [available on Canvas], are the primary means by which will be covered, the materials of which the course is comprised. The lectures are structured sequentially in accordance with the lecture notes, and proceed through the course materials in a linear fashion. In each lecture, I will be referring directly to the accompanying lecture notes. However, the notes comprise but a sketch. Accordingly, elucidation, fleshing out, and expanding upon will be the standard order of business.

Readings

Assigned on an as-needed basis [available on Canvas]

Assignments

Each of the four assignments will be constituted of some number of parts, the parts made available to you- on Canvas- as the semester unfolds. A given assignment- all of its parts- will be due- uploaded to Canvas- on the date and time specified on the schedule, below. Of course, these dates are provisional, and I am always open to rejigging them if, to do so, serves class aims. Individual students may request an extension if they find themselves under pressures which are militating against the possibility of optimal learning.

Computer Software

Test analyses will be conducted with the assistance of various computer programs, notably, the R packages Lavaan [structural equation models] and ltm [item response models], IRTPro [item response models], and Maple [post-processing of irt analyses]. Microlab computers will come equipped with R studio and Maple, and there will be a single microlab computer on which is installed irtPRO. It is strongly advised that, if it is not already installed, students install R studio on their laptop and/or home computer.

Workouts

There will be a number of “workouts”, computational/theoretical exercises, each of which you will undertake on your own, some in class and some outside of class. Though it is highly recommended that you complete each and every workout (for they are designed to help you consolidate theoretical knowledge and master practical application), they are not for marks and will not be submitted.

 

Office hours

There will be weekly office hours [RCB4202; Thursday 10:00-11:00a.m.]. Though optional, regular participation in the office hours is highly recommended. It is

expected that, among other things, students will use this time to discuss matters related to the filmed lectures, the readings, workouts, and assignments. That is to say, anything whatsoever related to test theory and analysis.

Grading