Simon Fraser University
Engaging the World

Course Outlines

Spring 2019 - EDUC 822 G001

Evaluation of Educational Programs (5)

Class Number: 1223

Delivery Method: In Person

Overview

  • Course Times + Location:

    Jan 3 – Apr 8, 2019: Tue, 4:30–9:20 p.m.
    Burnaby

Description

CALENDAR DESCRIPTION:

Processes used in program evaluation; including test and other measurement devices; and political, social and philosophical issues relating to the evaluation of educational programs.

COURSE DETAILS:


This is an elective course for students interested in evaluation of people and programs, application of research methods to solve problems of policy and practice, and the underlying complexities involved in assessment, evaluation, and change.

The course considers the processes used in program evaluation; including testing and other measurement devices; research methods; and the political, social and philosophical issues relating to the evaluation of educational programs.

COURSE-LEVEL EDUCATIONAL GOALS:


Knowing (Research)
Goal: Familiarity with data collection tools and procedures. 
Measure: Completion of course readings and in class participation and use and application of tools through in-class activities and course assignments.  

Thinking and Being (Theory)
Goal: Familiarity with data analysis tools and procedures.
Measure: Statistics workbook and in class participation during statistics exercises, program evaluation proposal and reflective essay on evaluation theory.

Doing (Practice)  
Goal: Ability to find, evaluate, interpret, and summarize relevant academic research, ability to design a program evaluation, demonstrated ability to work collaboratively in a professional environment and demonstrated ability to work independently in a professional environment. 
Measure: Posting of online research briefs, contribution to small group projects and activities, completion of program evaluation proposal, participation in large and small group course-based activities and participation in course activities and timely completion of assignments.   

      

Grading

  • Participation: You are expected to complete the required readings prior to each class session. Think critically about what you read and consider the connections between the readings. Your active and thoughtful participation in class discussions will be part of your grade. You should submit two questions or observations regarding the readings to the professor by the Monday before each class meeting. These questions and observations will form the basis of our discussion each meeting. Attendance is expected at every class meeting. You should contact the instructor before class if you will be unable to attend for some important reason. When possible, alternate assignments may be negotiated (for example, if you are required to miss class for an education event, credit may be awarded for a brief report from the event). 10%
  • Research Summaries: You are to post two summaries of a research article through Research Briefs (http://researchbriefs.org). The summaries should be of a peer reviewed research article that you found to be particularly valuable. These articles will be discussed in class. Please be aware that these briefs are a publicly accessible record of your scholarship, and as such should be carefully written and of high quality. You may wish to work with a colleague and peer-edit each other’s essays. 20%
  • Tool Design: You will demonstrate an understanding of two of the major tools used in program evaluation, Focus Groups and Surveys through creation of one of these tools, which may also be applied in the group project or action research project. a) Interview/Focus Group: you will design and pilot an interview or small focus group protocol, including content analysis of the results. Write a reflection on the process of designing the focus group activity, running the actual session and the content analysis. OR b) Survey/Questionnaire: you will design a survey and/or questionnaire and pilot with several stakeholders. Write a reflection describing the process of design, sampling, and analysis of the pilot findings. 20%
  • Statistics Workbook: You are to keep a research notebook where you record possible evaluation questions, methods, problems to solve, etc. As part of this you should also include the Salkind exercises you complete. This journal will be graded based on completion. 20%
  • Program Evaluation Design and Presentation: You will design your own program evaluation, either independently or in small groups within the class. This should be a full evaluation proposal of a researchable problem. If created by a group, care should be given to ensure each group member is able to identify his/her contribution to the evaluation. Part of this assignment includes a reflective essay by each student examining your own dispositions toward evaluation theory. 30%

Materials

MATERIALS + SUPPLIES:

Resources

Guides

Bowen, S. (undated). A Guide to Evaluation in Health Research. Ottawa, ON: Canadian Institutes of
Health Research.
Online availability:
http://www.cihr-irsc.gc.ca/e/45336.html (html)
http://www.cihr-irsc.gc.ca/e/documents/kt_lm_guide_evhr-en.pdf (pdf)  

Fretchling, J. (2002). The 2002 User Friendly Handbook for Project Evaluation. Washington, DC:
The National Science Foundation.
Online availability:
http://nsf.gov/pubs/2002/nsf02057/nsf02057.pdf (pdf)

Standards

Yarbrough, D. B., Shulha, L. M., Hopson, R. K., and Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.
Link: http://www.jcsee.org/program-evaluation-standards (html)
Summary standards: http://www.jcsee.org/program-evaluation-standards/program-evaluation-standards-statements (html)   Student Evaluation Standards https://us.corwin.com/en-us/nam/the-student-evaluation-standards/book220804

Evaluators’ Associations

Canadian Evaluation Society: https://evaluationcanada.ca
American Evaluation Association: https://www.eval.org

REQUIRED READING:

Salkind, N. J. (2017). Statistics for People Who (Think They) Hate Statistics. Fourth Edition Using Microsoft Excel 2016. Thousand Oaks, CA: Sage Publications. ISBN: 9781483374086. Online availability through Vital Source: https://www.vitalsource.com/products/statistics-for-people-who-think-they-hate-neil-j-salkind-v9781483374093?term=9781483374109 Study site: https://edge.sagepub.com/salkindexcel4e    

Evaluation Readings: to be Assigned Weekly

Summary Standards for Program Evaluation. http://www.jcsee.org/program-evaluation-standards/program-evaluation-standards-statements (html)

RECOMMENDED READING:

Yarbrough, D.B., Shula, L.M., Hopson, R.K., Caruthers, F.A. (2010).The Program Evaluation Standards: A guide for evaluators and evaluation users (3rd. Ed). Thousand Oaks, CA:Corwin Press.  

Gullickson, A.R., Howard, B.B. (2009).The Personnel Evaluation Standards: How to assess systems for evaluating educators (2nd Ed.). Thousand Oaks, CA: Corwin Press.   

Klinger, D.A., McDivitt, P.R.,Howard, B.B., Munoz, M.A., Rogers, W.T., & Wylie, E.C. (2015).The Classroom Assessment Standards for PreK-12 Teachers. Kindle Direct Press.  

Gullickson, A. R. (2002). The Student Evaluation Standards: How to Improve Evaluations of Students. Thousand Oaks, CA: Corwin Press.

Graduate Studies Notes:

Important dates and deadlines for graduate students are found here: http://www.sfu.ca/dean-gradstudies/current/important_dates/guidelines.html. The deadline to drop a course with a 100% refund is the end of week 2. The deadline to drop with no notation on your transcript is the end of week 3.

Registrar Notes:

SFU’s Academic Integrity web site http://www.sfu.ca/students/academicintegrity.html is filled with information on what is meant by academic dishonesty, where you can find resources to help with your studies and the consequences of cheating.  Check out the site for more information and videos that help explain the issues in plain English.

Each student is responsible for his or her conduct as it affects the University community.  Academic dishonesty, in whatever form, is ultimately destructive of the values of the University. Furthermore, it is unfair and discouraging to the majority of students who pursue their studies honestly. Scholarly integrity is required of all members of the University. http://www.sfu.ca/policies/gazette/student/s10-01.html

ACADEMIC INTEGRITY: YOUR WORK, YOUR SUCCESS