Syllabus for PTC 610 – Evaluation of Programs and Practice
Spring 2016
Instructor: Lynnette Ronkowitz

This is a topical survey of evaluation for professionals whose responsibilities may include the evaluation of programs and practice. The course will distinguish research from program evaluation. It highlights the steps of the evaluation process while expanding the scope and use of relevant design tools. This allows for more diversity in the presentation or incorporation of information not only as required in an evaluation assignment, but across all professions. The emphasis on communication skills applicable to evaluation such as questioning techniques, written reports, note taking, e-journals and team building will also enhance professional qualifications for team management and mentoring. Activities include case applications and hands-on evaluation tools using industry standards.

Contact
This course is fully online and uses NJIT’s Moodle learning management system http://moodle.njit.edu.  Additional readings, assignments and submissions will be done in Moodle. Since I do not have office hours on campus, I recommend that you use the internal Moodle messaging system to contact me about personal course issues or anything not relevant to the entire class. If you really need to use my NJIT email, please include 610 in the subject line so that your mail is filtered properly.

I may hold optional synchronous sessions during the semester using WebEx about topics or assignments.

Textbooks: (required)

The ABCs of Evaluation: Timeless Techniques for Program and Project Managers,
by John Boulmetis and Phyllis Dutwin, 2011, ISBN-13: 978-0470873540  
e-text book
Program Evaluation: A Step-by-Step Guide
by Nancy F. Barrett, PhD, Aug 6, 2013
ASIN: B00EDDCFHQ Kindle Edition
(both available on Amazon.com electronic version and print version)


Course Outcomes and Objectives
Outcomes:  
Upon successfully completing the course, students will be able to:
1. Identify the roles of the participants in an evaluation.
2. Outline the components of a program evaluation.                                                                                                                                                                                   3. Design evaluation tools based on data that needs to be conveyed.
4. Apply evaluation concepts to case applications.
5. Formulate questions based on varied techniques. 
6. Outline the components of a written evaluation report.
7. Produce a portfolio of evaluation tools.
8. Discuss current technology and evaluation as a transdiscipline as it serves as a tool for project management in the province of other professions.
               
Objectives:        
Upon successful completion of the course, students will be able to:
• Interpret the results of a program evaluation.
• Create evaluation tools based on needs assessment, program theory and evaluation use.
.
Course Topics/Sessions (subject to change based on composition and dynamics of the class)

Although the course is structured by topics or sessions, within Moodle, I will use a weekly session checklist to help you manage the current readings and assignments. The course is designed so that the sessions/topics can be covered in any order.
Taking into account that most graduate students are part-time and working during the week, our course week will start on Mondays with the release of any new content and most assignments will be due on Sunday night.

Course Preview:
Students will cover a brief history of evaluation and complete a graded worksheet.
Assignment: Email

Course Structure: Students cover expectations for the semester and preview the format for each session. Students will contrast everyday, informal evaluation with formal definitions of program evaluation.
Assignments: Mind Maps and Rubrics

Comparing Evaluation and Research: Students will discuss how evaluation differs from research.
Assignment: Tables

Stakeholders and Integrity: Students will focus on identification of stakeholders. They will analyze the importance of developing relationships and partnerships, and working with outside subject matter experts (SME).
Assignment: Flowcharts (read one-narrative; narrative-create one)

Evaluability: Students will focus on what it means to look at the world through the eyes of an evaluator and use questions that distinguish the way an evaluator thinks from ordinary ways of looking at the world. Formulation of Questions Part 1
Assignment: Road Map: Questioning Techniques

Describing the Program:
Assignment:  Conceptual Framework, Mapping (backward mapping, concept mapping, mind mapping)

Planning: How Program theories are developed
Assignment: Needs Assessment; Template

Designing the Evaluation: Models of evaluation and circumstances under which each is used.
Assignment: Program Logic Models

Collecting Information:
Assignment: TBD (focus groups, surveys, checklists, pre-tests/post-tests, observational analysis)

Formulation of Questions Part 2: Exposure to other types of questioning techniques useful for communication skills across all professions and where they might fit into the evaluation process.  
Assignment: Interview
OR
Emerging issues in evaluation: Having addressed the design and theory phases, we will examine current and emerging issues in evaluation such as gender, governmental requirements, social concerns and disabilities. We will explore implementation strategies and components that need to be in place in order for the evaluation process not to be in violation of these considerations.
Assignment: Reference Articles

Measures and Data Analysis:
Assignment: Document Review Guideline

Managing the Evaluation:
Assignment: Personal Electronic Journal

Communicating and Reporting: Components of a complete evaluation report and determining how it will be distributed
Assignment:  Components of a complete written report; Presentation

Technology: Summary of Evaluation Tools related to displaying information and doing an evaluation

Assignment: Students should be completing their Final Project

Final Evaluation Tool Portfolio Submission

Requirements:

Late assignments are NOT accepted and will receive a failing grade. As per NJIT policy, students seeking validation of an absence or missed assignment/exam must have such information verified by the Dean of Students Office. Faculty will then be notified if it is validated.

Forum postings are required of all students. Being engaged in online class discussions is a necessary part of any online course. This is also a way to build a personal community of practice with classmates and other participants in the degree/certificate program. 

Students are expected to not only initiate posts, but also provide meaningful comments on peer postings and work. An effective forum post:
• addresses the topic, questions or prompt
• responds directly to previous posts with original thoughts
• brings in additional relevant information from course materials or from outside resources (any online sources used are cited via a hyperlink) 
• furthers the conversation
Posts have a point value and are a part of the final grade.

Final Project or Course Portfolio of Evaluation Tools
Each course session/topic correlates with an Evaluation Tool. Working on a different evaluation tool in each session should make putting together the course portfolio (final project) more manageable. The final project will be a compilation of the tools from each session along with several other components. Revisions on all evaluation tools will be accepted at any time throughout the course. However, if the original assignment was turned in late, there will be no opportunity for revision, but it must be included in the final project.

Grades: Grades will be calculated using a system of points. There will be multiple opportunities to earn extra points.

Assignments: 40%
Forums: 30%
Project Portfolio of Evaluation Tools: 30%

Academic Integrity
Any evidence of cheating in any form, including plagiarism, will be dealt with according to the honor code of NJIT. Papers submitted may be checked using turnitin.com for proper citation and originality.  See ist.njit.edu/teaching/turnitin/  and njit.edu/academics/integrity.php  for additional information

 

NJIT Graduate Final Grading Legend


Grades

GPA

Significance

A

4.0

Excellent

B+

3.5

Good

B

3.0

Acceptable

C+

2.5

Marginal Performance

C

2.0

Minimum Performance

F

0.0

Failure

I

 

Incomplete

W

 

Approved Withdrawal

AUD

 

Audited (no academic credit)

S or U

 

Satisfactory or Unsatisfactory

P

 

Pass - Final Grade for Completed Master's Thesis or Doctoral Dissertation

Unlike undergraduate courses, there is no D grade for graduate courses. Assigned grades must be consistent with the level of the course and not the matriculation level of the student in the course.