The State Professional Development Grantees must describe how the SEA will assess, on a regular basis, the extent to which the strategies implemented have been effective in meeting the prescribed performance goals. Below are journal articles, resources and tools developed by SPDG evaluators to assist projects in evaluating initiatives.
- Participatory Evaluation
- Assessments / Instruments/ Checklists
- Logic Models
- Response to Intervention and Multi-Tiered Models of Intervention
- Working with Third Party Evaluators
“Participatory Evaluation: Theories and Methods for Remote Work” from Evaluation + Learning Consulting : Parent Participatory Evaluation , from the Minnesota Department of Education. I like this idea (from the attached) for our webinars: Agree/Disagree – Use as an icebreaker in the beginning of a session, or to stimulate participants by challenging them to think and encouraging their direct participation. A moderator sends a poll to the group with a series of provocative but non-divisive questions phrased in an agree/disagree format. All those who agree with the question can be asked to click agree and those who disagree can click disagree. Explanation for the varying views can be solicited from members of each respective group. It is important that the moderators keep the tone light throughout this activity so that participants feel safe expressing their views. See Participatory Evaluation Theories and Methods .
Assessments / Instruments / Checklists
CIPP Three-part series on Conducting High-Quality Customer Surveys:
First Webinar Slides: This webinar outlines the varied purposes of customer surveys, walks participants through the process of planning a high-quality customer survey, identifies some of the common problems related to planning customer surveys, and highlight the benefits of a well-designed customer survey. This webinar is accompanied by Resources on Planning, Designing, and Conducting Customer Surveys.
Second Webinar Slides: This webinar walks participants through key aspects of survey design, identifies some of the common problems associated with designing customer surveys, and discusses how to carry out pilot testing to improve the quality of the survey. This webinar is accompanied by a Sample Item Formats for Customer Surveys.
Third Webinar Slides: This webinar outlines the different modes of survey data collection, walk participants through the process of collecting high-quality survey data and ensuring data security, identify some of the common problems associated with conducting customer surveys, and offer suggestions for improving response rates and managing the data that have been collected. This webinar is accompanied by a Checklist for Planning, Designing, and Conducting Customer Surveys.
Measuring the quality of professional development training . Amy S. Gaumer Erickson, Patricia M. Noonan, Jennifer Brussow & Kayla Supon Carter. (2017). Professional Development in Education Vol. 43 , Iss. 4.
Observation Checklist for High-Quality Professional Development Instructions : Individual(s) should complete the checklist while observing the delivery of professional development. For each item, check whether that indicator was present in the professional development and provide evidence from the training to support that assessment. See Gaumer Erickson, A.S., Noonan, P.M., Ault, M., Monroe, K., & Brussow, J. (2020). Observation checklist for high-quality professional development [Version 3]. Center for Research on Learning, University of Kansas.
CIPP Performance Measures Documents:
Step-by-step Grantee Guide to Performance Measurement for developing high quality, interesting project measures (PDF)
Excel files to accompany the Step-by-step Grantee Guide
Step 2 Template and Step 3 Template A (xls)
Measuring Project Performance: Tips and Tools to Showcase Your Results . CIPP used this ppt. during the workshop at the 2018 PD meeting (PPT)
Logic Models The Center for Evaluation and Education Policy (CEEP) created these two Voice-Over PowerPoints for OSEP on: (1) How to create and use logic models and (2) How to create high quality objectives and performance measures.
Response to Intervention and Multi-Tiered Models of Intervention
National Center on Response to Intervention Website (NCRTI) RtI Screening, Progress Monitoring and Other Tools. Use their advanced search function for best results.
Keywords: RtI, response to intervention, progress monitoring, screening
Working with Third Party Evaluators
CENTER TO IMPROVE PROJECT PERFORMANCE (CIPP): Guidelines for Working with Third-Party Evaluators
The Guidelines for Working with Third-Party Evaluators is written to assist grantees and their OSEP Project Officers in planning for, finding and hiring, and working with third-party evaluators to design, implement, and complete a project evaluation. The document presents a discussion of the benefits, drawbacks, and limitations of using a third-party evaluator and practical guidelines for creating a third-party evaluation scope of work, developing a Request for Proposals, soliciting bids for and contracting with a third-party evaluator, and monitoring and managing the work of the third-party evaluator.
Center to Improve Project Performance
Guidelines for Working with Third-Party Evaluators – Evaluation Project Management Tools