Tip #1006:  How to Evaluate if Learning Transfer Occurred

There is a new model of evaluation in town: the eight-level Learning-Transfer Evaluation Model (LTEM) developed by Dr. Will Thalheimer. It is designed to help organizations and learning professionals determine if their evaluation methods are effective in validating learning success.

[Note: I’ve added the loose comparison to Kirkpatrick’s Model.]

The Four Ineffective Evaluation Methods

Level 1:  Attendance.  Butts in Seats

The learner signs up, starts, attends, or completes a learning experience.

[Learners may attend but not learn.]

Level 2:  Activity. Class Participation

The learner engages in activities related to learning, such as attention, interest, and participation. [Learners may do these things but not learn.]

Level 3:  Learner Perceptions. ~ Reaction

  1. The learner answers questions that reveal insights regarding learning effectiveness, such as learner comprehension, realistic practice, learner motivation to apply, and after-learning support. [This can hint at outcomes but should be augmented with objective outcome measures.]
  2. The learner answers questions that do NOT reveal insights regarding learning effectiveness, such as learner satisfaction, course reputation, etc. [These are not related to learning results.]

Level 4:  Knowledge. ~ Learning

The learner answers questions about facts/terminology.

  1. Knowledge recitation during or right after the learning event.
  2. Knowledge retention after several days or more.

[Knowing or remembering facts or terminology does not fully enable performance.]

The Four More Effective Evaluation Methods

Level 5:  Decision Making Competence.

The learner makes decisions given relevant realistic scenarios.

  1. Decision making competence during or right after the learning event. [Learners may forget decision making competencies.] ~ Learning
  2. Remembered decision making competence after several days or more. [Adequate to certify decision making competence.] ~ Behavior

Level 6:  Task Competence.

The learner performs relevant realistic actions and decision making.

  1. Task competence during or right after the learning event. [Learners may forget task competencies.] ~ Learning
  2. Remembered task competence after several days or more. [Adequate to certify task competence.] ~ Behavior

Level 7: Transfer. ~ Behavior

The learner uses what was learned to perform work tasks successfully, as clearly demonstrated through objective measures.

  1. Assisted transfer: when performance is substantially prompted/supported.
  2. Full transfer: when the learner demonstrates full agency in applying the learning. [Both are adequate.]

Level 8: Effects of Transfer. A much broader version of Results, somewhat idealistic

When transfer outcomes affect learners, coworkers/family/friends, organization, community, society, and the environs. [Certification requires certification of transfer plus a rigorous method of assessing transfer’s causal impact, including positive and negative effects.]

Question: Could you use this evaluation approach?

May your learning be sweet.

Deborah

#learningtransfer #trainingevaluation #laurelandassociatesltd #competence #transfer #evaluation

Comment: Dr. Thalheimer explains his model at https://www.worklearning.com/wp-content/uploads/2018/02/Thalheimer-The-Learning-Transfer-Evaluation-Model-Report-for-LTEM-v11a-002.pdf

Related Posts

Get New Blog Posts in Your Inbox Weekly.

Learn at your own pace with these online learning courses

It doesn’t have to be difficult to Deal with Difficult People.

 

How to Manage Change in Your Business for Smooth Transitions

 

Share This Post

Get New Blog Posts in Your Inbox Weekly.