This Tip describes predictive questions related to Kirkpatrick’s levels 2-4 that we can include in a predictive level 1 evaluation.
“The real goal of classroom assessment is to improve student performance, not merely audit it.” David Sousa and Carol Ann Tomlinson
Kirkpatrick’s Level 1 evaluation has often been characterized as the “feel good” evaluation. This is because it measures participant satisfaction with a training program. Unfortunately, it is the most used, most subjective, and least useful gauge of a program’s effectiveness.
A Predictive Level 1 Evaluation
Ken Phillips suggests that incorporating predictive questions is a way to gain greater value from Level 1 evaluations. Although the predictive data collected can’t provide proof that certain outcomes will occur, he believes it will forecast likely results.
The following Level 1 evaluation incorporates Phillips’ predictive questions for Level 2 learning, Level 3 training transfer, and Level 4 business results.
New and Improved Level 1 Evaluation Questions
Learning-Level 2:
On a scale of 1 to 7, with 1 being no knowledge and 7 being thorough knowledge:
- How much knowledge did you have about the materials before attending the program?
- How much knowledge do you have about the material after participating in the program?
Training transfer-Level 3:
- On a scale of 1 to 7, with 1 being not at all relevant and 7 being extremely relevant, how relevant was this program to you and the tasks and requirements of your work?
- On a scale of 1 to 7, with 1 being not at all confident and 7 being extremely confident, how confident are you in your ability to apply the new information you learned in this program back on the job?
- On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely are you to have an immediate opportunity to apply the new information you learned in this program back on the job?
- What obstacles, if any, may keep you from applying what you learned?
- On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely is your manager to actively engage you in discussing your use of the new information you learned in this program?
Business results- Level 4:
- On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely are any of your department’s tracked crucial business metrics to improve as a result of you applying the information you learned in this program?
- How confident are you in your response to the previous question, where 0 percent equals no confidence and 100 percent equals high confidence?
Question: Do you agree that these Level 1 questions can provide great value concerning a training program’s effectiveness?
May your learning be sweet- and safe.
Deborah
#improvedleveloneevaluation #predictiveleveloneevaluationquestions
