TRAINING EVALUATION TOOLKIT

Complete practical guide to measuring the effectiveness
of training programs in organizations

TABLE OF CONTENTS

1  Introduction 1

1.1 Applying the Measuring Stick to Training 1

1.2 Who Will Benefit from This Book 4

2  Evaluating Training Programs 6

3  Measuring Reaction 10

3.1 Gathering Reaction Data 10

3.2 Analyzing and Reporting Results 12

4  Measuring Learning 14

4.1 Trainee Assessment or Program Evaluation? 14

4.2 Selecting an Assessment Method 15

4.3 Conducting an Assessment 19

4.4 Selecting the Assessor and Location 21

4.5 Analyzing and Reporting Results 22

5  Measuring Behavior 24

5.1 Setting the Scene 24

5.2 Selecting Data Sources and Gathering Data 25

5.3 Selecting the Timing and the Evaluator 33

5.4 Analyzing and Reporting Results 34

6  Measuring Results 36

6.1 Why Measure Results? 36

6.2 Isolating the Effects of Training 37

6.3 Trend Line Method 42

6.4 Control Group Method 49

6.5 Matched Pairs Method 55

6.6 Selecting a Method 58

6.6.1 Method Selection Table 58

6.6.2 Isolating Psychological Factors 58

6.6.3 Measuring Intangibles 59

6.7 Estimating the Impact of Training 61

6.8 When Not to Isolate the Impact of Training 64

7  Measuring Return on Investment (ROI) 69

7.1 What Is ROI and Why Calculate ROI? 69

7.2 Converting Benefits to Monetary Amounts 70

7.3 Determining the Benefit Period 72

7.4 Calculating Training Program Costs 74

7.5 Is Training Really an Investment? 76

7.6 Other Methods for Calculating Financial Return 78

7.6.1 Benefit to Cost Ratio 78

7.6.2 Payback Period 78

7.6.3 Net Present Value 79

7.7 Measuring Financial Returns in Context 81

8  Program Evaluation Planning and Reporting 83

8.1 Planning for Evaluation 83

8.2 Reporting Evaluation Results 86

9  In Conclusion 89

10 Appendices 90

10.1  Guide to Appendices 90

10.2  Additional Resources 92

10.3  Appendix A – Certificate of Completion 94

10.4  Appendix B – Training Evaluation Data Collection Plan 95

10.5  Appendix C – Evaluation Report Communication Plan 96

10.6  Appendix D – Training Participant Feedback Form 97

10.7  Appendix E – Skill Assessment Form – Individual 100

10.8  Appendix F – Training Transfer Survey Form 102

10.9  Appendix G – Training Transfer Interview Form 105

10.10 Appendix H – Organizational Results Survey Form 110

10.11 Appendix I – Training ROI Survey Form 113

10.12 Appendix J – Training Program Evaluation Report 116

11  Bibliography 122

12  Index 124