9:Evaluation of Training Effectiveness
- 1. 9. Evaluation of Training Effectiveness Evaluate Training Outcomes Define Training Needs Provide for Training Monitor Design and Plan Training Evaluate Training Outcomes
- 2. Evaluation of Training Effectiveness So you’ve developed the learning objectives, qualified your trainers, designed and delivered one or more courses, and implemented a system to manage it all. Now, how do you measure the bottom line: Is it working? You’ll need to consider this at two levels: How well is a specific course working? How well is your overall program working? Evaluation of Training Effectiveness
- 3. Evaluation of Course Effectiveness So how well is a specific course working? You can look at it from two dimensions, both important in the context of social auditing and adult learners: Evaluation of Training Effectiveness Perceived Learning This is what the students think they’ve learned, and how the course has met their expectations Demonstrated Learning This is what the students can show they’ve learned, through test results or performance in the field, etc. In the next few slides, we'll go over some ways to measure both dimensions.
- 4. Perceived Learning Here are some ways to measure what students think they’ve learned and how the course met their expectations: Post-course questionnaire/survey In-class Online Phone interviews with sample of students Student testimonials Debriefing sessions with trainer after the exam Student evaluations of trainer Peer grading – students assess each others’ performance © SAI 2009 - draft for review Evaluation of Training Effectiveness
- 5. Demonstrated Learning Here are some ways to measure what the student actually learned: Compare pre- and post- course questionnaire and quizzes (should be the same questions on each, for comparison) External evaluation methods (already covered) Take-home exams or projects (to give time to synthesize material) Follow-up surveys to test knowledge retention and attitude (such as cultural sensitivity) change over time Witness or shadow audits to measure performance of auditor in the field and the long-term impact of the training on operational knowledge, skills and behavior Evaluation of Training Effectiveness
- 6. Effectiveness of Overall Program So how well is your overall training program working? You need to pick some key performance indicators to measure. Here are some to consider as baseline measurements: Average Student Performance in course Trainer and course ratings by students and observers Number of returning students If possible, field performance measurement or achievement of available or relevant certification Evaluation of Training Effectiveness Click on the notes tab to get a Student Survey you can use.
- 7. Effectiveness of Overall Training Program (continued) These key performance indicators may become important as your program grows: Number of trainers qualified Number of languages in which courses offered Number of countries in which courses offered Average student performance from region to region Average student course evaluation from region to region Number of courses per year Number of students Number of new courses developed Evaluation of Training Effectiveness