Skailit - Training & Development Strategies

🎯 Purpose

This course equips you to strategically plan, execute, and evaluate effective training programmes that align with organisational goals and enhance workforce capabilities.

🚀 Outcome

By the end of this course you will confidently conduct needs analyses, design instructionally sound programmes, facilitate engaging learning experiences, leverage digital tools, and build a culture of continuous learning.

📊 Module 8: Evaluating Training Effectiveness

Training evaluation answers the critical question: Did the training work? Without evaluation, organisations cannot demonstrate return on investment, identify what needs improvement, or justify continued investment in learning and development.

8.1 The Kirkpatrick Four-Level Model

The Kirkpatrick Model, developed by Donald Kirkpatrick, is the most widely used framework for evaluating training effectiveness. It measures four progressively deeper levels:

Level 1: Reaction

What it measures: How did participants feel about the training? Did they find it relevant, engaging, and well-facilitated?

Tools: Post-training feedback surveys (often called "Happy Sheets" or smile sheets). Rate: content, facilitator, pace, relevance, venue/platform.

When to use: Immediately after every training session.

Sample Level 1 Survey Questions:
• "The training content was relevant to my job." (1–5 scale)
• "The facilitator explained concepts clearly." (1–5 scale)
• "I would recommend this training to a colleague." (Yes/No + reason)
• "What was the most valuable thing you learned today?"
• "What could be improved in future sessions?"
Limitation: A positive reaction does not guarantee that learning has occurred. Participants may enjoy training without retaining or applying anything. Level 1 data alone is insufficient.

Level 2: Learning

What it measures: What knowledge, skills, or attitudes did participants actually acquire during the training?

Tools: Pre- and post-assessments (knowledge tests), skills demonstrations, practical tasks, observation checklists.

How to calculate learning gain:

Pre-test average score: 45%
Post-test average score: 82%
Learning gain: 82% − 45% = 37 percentage points improvement

When to use: Pre-test before training begins; post-test at the end of the programme.

Level 3: Behaviour

What it measures: Are participants applying what they learned back in the workplace? Has behaviour actually changed on the job?

Tools: Manager observation checklists, 360-degree feedback, follow-up interviews with participants and managers, performance data review.

When to use: 30, 60, and 90 days after the training programme.

The Transfer Problem: Research shows that on average only 10–20% of what is learned in training is actually applied on the job. Factors that improve transfer include: manager reinforcement, practice opportunities, job aids, and spaced follow-up sessions.

Level 4: Results

What it measures: Has the training produced tangible, measurable improvements in organisational outcomes?

Tools: Business KPIs before and after training (sales figures, error rates, customer satisfaction scores, staff turnover, productivity metrics, safety incident rates).

When to use: 60–180 days after training, when business data has had time to reflect the change.

Examples of Level 4 Results:
• Customer satisfaction scores increased from 72% to 88% following customer service training
• Safety incidents reduced by 40% in the quarter following health and safety training
• Sales revenue increased by 18% in the two months following product knowledge training
• Staff turnover in the first year reduced from 35% to 18% after improved onboarding

8.2 Return on Investment (ROI) — Level 5

Jack Phillips added a fifth level to Kirkpatrick's model: Return on Investment. This converts the value of training outcomes into a financial figure and compares it to the cost of the training.

ROI Formula:

ROI (%) = [(Programme Benefits − Programme Costs) / Programme Costs] × 100

Example:
Training cost: R50,000
Productivity improvement value: R180,000
Error reduction savings: R40,000
Total benefit: R220,000

ROI = [(220,000 − 50,000) / 50,000] × 100 = 340%

An ROI of 340% means the organisation received R3.40 back for every R1 invested in the training. Even modest, well-targeted training programmes commonly achieve 100–300% ROI.

8.3 Creating an Evaluation Plan

Plan evaluation before training begins — not after. Include in your Training Blueprint:

LevelWhat to MeasureToolTiming
1 – ReactionSatisfaction, relevance, facilitator qualityFeedback surveyEnd of training
2 – LearningKnowledge gain, skills achievementPre- and post-testBefore and after
3 – BehaviourOn-the-job application of skillsObservation, 360 feedback30–90 days after
4 – ResultsBusiness KPI improvementBusiness data review60–180 days after

8.4 Improving Training Transfer

Evaluation often reveals a transfer gap. Use these strategies to close it:

  • Pre-training manager briefing – Managers must know what training their team attended and what to reinforce. Brief them in advance and give them coaching questions to use after.
  • Action plans during training – Have learners write 2–3 specific, time-bound commitments during the session. Send these to their managers.
  • Post-training follow-up sessions – Schedule a group or 1:1 follow-up 2–4 weeks after training to review what has been applied and address barriers.
  • Job aids and reference materials – Provide quick reference cards, process guides, or checklists that support on-the-job application.
  • Peer accountability pairs – Pair learners to check in with each other on progress against their action plans.
  • Microlearning reinforcement – Send follow-up emails, videos, or quizzes in the weeks after training to maintain memory.

8.5 Quick Self-Check

Q1: What are the four levels of the Kirkpatrick Model?

✓ Level 1: Reaction, Level 2: Learning, Level 3: Behaviour, Level 4: Results

Q2: Why is Level 1 (Reaction) data alone insufficient for evaluating training?

✓ A positive learner reaction does not guarantee that learning occurred or that behaviour will change. Participants can enjoy training without retaining or applying it.

Q3: Training cost R50,000. Total measurable benefit was R200,000. What is the ROI?

✓ ROI = [(200,000 − 50,000) / 50,000] × 100 = 300%

Q4: Name three strategies to improve training transfer to the workplace.

✓ Manager briefing, action planning during training, follow-up sessions, job aids, peer accountability pairs, microlearning reinforcement (any three)

✓ Module 8 Complete

  • The Kirkpatrick Four-Level Evaluation Model: Reaction, Learning, Behaviour, Results
  • Evaluation tools for each level and when to apply them
  • ROI calculation (Phillips' Level 5)
  • How to build an evaluation plan into your Training Blueprint
  • The transfer problem and six strategies to overcome it

← Back to All Modules