Product Reviews

Training Evaluation Toolkit

On this page, you will find reviews by our customers and other independent reviewers.

First Impressions

On opening, I was surprised at the extent of the content, in particular the range of templates that are included in the package (16 in total). A quick read of the introduction described the evaluation model that this tool kit is built around; the very well known and extensively used Donald Kirkpatrick’s training evaluation model.

On further review

I like this model for evaluating training programs as it sits well with OJT training and classroom delivery alike. Leslie explains each of the four levels in great detail, living up to his promise of delivering a ‘practical guide’ to training evaluation. He spends a chapter on each level, detailing the process of assessing training with a significant amount of background detail and considerations for the evaluator. It is an outstanding explanation of Kirkpatrick’s model. The chapter on measuring results is particularly noteworthy, explaining how results are often difficult to isolate and can be affected by non-training matters.

I did find the second last chapter, measuring the ROI on training, to be what I would consider as ‘theory heavy’, most probably because it falls outside the scope of my particular niche. Although it is still approached from a practical angle, the depth is too extensive for the front line trainer, low level training manager and possibly even the small business owner. Don’t get me wrong, I do see the need to ensure that the reward for you efforts is worth the resources committed, but if it is too complex, the options are to outsource or overlook.

This is bought quickly back into focus with the last chapter titled “Program Evaluation and Reporting”. Although short, it is an invaluable inclusion that clearly outlines the importance of reporting on your training activities.

The templates are excellent. Included in the package are blue prints for training data collection and presentation, participant evaluation and feedback, a certificate of completion and training report. If this is your first time evaluating training, then this book will give you the building blocks that you need to gather feed back, complete the assessment, analyse the results and record your findings.

Conclusion

The Training Evaluation Tool Kit is a one-stop tool box for evaluating your training programs, regardless of the size of your organisation. It feels more suited to a medium to large organisation with a regular training schedule, but that’s not to say that any benefit would be lost to the small business owner or sole trainer. At a cost of $50 USD, it is priced very reasonably with comparable products (and even some less comparable in quality).

Would I buy it? Yes, for the templates and the explanation of Kirkpatrick’s model alone.

Duane Davis
Author of Controlling Training

Source: http://trainingtools.wordpress.com/

Companies spend a lot of effort, time and money training their employees, but how can they be sure that the training has been successful and effective?

Manager, consultant and trainer Leslie Allan’s toolkit is a helpful way to measure and report the effectiveness of a training program. The toolkit consists of an eBook and several customizable Microsoft Word forms and Excel calculation worksheets, including certificate templates for trainees. These forms are fully re-usable.

From evaluating your training impact to measuring learning and behavior, and on to analysing results and return on investment, the author discusses these topics and more.

Resources include:

• planning and stakeholder communication templates
• data collection forms for each evaluation level
• participant skill assessment forms
• charting and analysis worksheets for both financial and non-financial data
• reporting templates for reporting results persuasively and professionally

I found the book well-structured, focused and informative, while Allan’s writing is straightforward and to the point. His list of subjects is pretty comprehensive. I found the forms to be practical, helpful and easy to use.

This toolkit is aimed at both novice and experienced professionals, from learning and human resource managers to development consultants and instructional designers.

Think of this toolkit as a step-by-step guide to measuring training programs. If you’re a trainer, you’ll definitely want to consider purchasing this toolkit.

Mayra Calvani
MyShelf.Com

Source: www.myshelf.com/miscellaneous/09/trainingevaluationtoolkit_ebook.htm

On opening the Toolkit, I was initially put off by the 136 pages my page counter stated that it contained. However, I ploughed into it thinking that I had committed to reviewing it so I had to get on with it... I needn't have worried: the book is very readable, easy to understand and is presented in a very logical format. Topic areas are 'chunked' to aid the reader as well as to enable sections to be explored individually. There is a very comprehensive index that allows the reader to find what they are looking for at a glance - very important and sometimes missing from other books I find. The appendices are very thorough and provide the reader with everything s/he could need to be able to conduct a professional and methodical evaluation of training.

If I had one complaint (more of a personal niggle to be honest) it would be that the statistically heavy sections do take a bit of perseverance to get through - but I put this down to my own 'resistance to the maths' rather than the content, as Leslie Allan explains everything very well. I feel that the author has provided everything that the trainer-evaluator could require, including template certificates that link to mail merge - handy. So, in summary, I would say that, for the internal trainer wanting to ensure a systematic appraisal of delivery is conducted, they could do much worse than buy this book, which I would rate as a 4.5 out of 5 - very good.

Jane Barker
Drug Training Coordinator
Wolverhampton Drug Training Unit

Source: www.trainingzone.co.uk/group/trainingzone-book-club/training-evaluation-
toolkit-review

To call this just a book is a slight injustice; as the title states it’s a toolkit and once you understand the book and appendices it really does become a comprehensive evaluation toolkit suitable both for the trainer or those in the organisation responsible for understanding what the training spend is really doing for the bottomline.

I found the focus of the book very much on measurement, analysis and process which might put some people off – especially if you don’t like lots of stats and forumula. The clarity of explanation does allow understanding making it worth any feeling of having to keep ‘plodding’ through.

Throughout there is strong linkage with Kirkpatricks 4 levels of evaluation, perhaps fitting as that model is now 50 years old. Despite the strong reference to Kirkpatricks it was welcoming to see the focus on the higher levels, often the ones organisations struggle with and hence don’t really truly understand the value of training delivered. Again the format of the book and the examples helped with clarity of understanding.

The book makes good reference to the appendices which are basically you’re working templates in terms of how to put what the book is teaching into practice.

So if you want to demonstrate bottomline impact of your training its worthwhile taking the time to understand and apply what the book is sharing.

My last point could be classed as personal preference since I find it slightly annoying to read something that is full of American type spelling (z instead of s and not enough m’s in programme)!!

Score : I’d give it 4 out of 5

Dawn Brown, FCIPD
People Consultant
People Development Coaching Limited

Source: www.trainingzone.co.uk/group/trainingzone-book-club/training-evaluation-
toolkit-ebook-needs-reviewing

I'm always being asked about evaluation and whether I have examples of materials. Although there is already a lot written in this field, including toolkits like the CIPD's, another contribution is always welcome. The style is accessible and practical. The materials straightforward and easily adaptable. The content is mainstream and of the 'how to' variety. I think it will be helpful for those new to evaluation who have been tasked with pulling together an approach to measurement and who would rather not start with a blank sheet.

In some respects the toolkit reminds me of the work of the late Leslie Rae with its sound reasoning and unfussy materials. But quickly the text moves into the higher levels of evaluation and the complexities of measurement. Isolating the effects of training and putting numbers on performance change is not everyone's cup of tea but it certainly has its place. In this respect it is more like Terence Jackson's Evaluation: Relating Training to Business Performance. I don't think this toolkit is better than what has gone before but it is handy having it in an e-book format.

Intangibles and the longer term benefits from things like leadership development do get a mention. But the toolkit is at its strongest in looking at quantitative methods. Personally I have my doubts about whether the investment of time and effort in most RoI exercises are worth it in terms of the value they offer back (how can you set out to measure the value of the training and then not weigh up the cost and value of the evaluation exercise itself). No one ever got a pig fat by weighing it. But if you need to do such an exercise, this toolkit may be as good a start point as anything offered by Jack Phillips.

This book hasn't excited me - that is not what it is about - but I am sure there are many a trainer out there that will be keen to 'borrow' the materials and follow the tips provided. For me, it gets a 3.5 out of 5.

Graham O'Connell
Head of Organisational Learning and Standards
National School of Government

Source: www.trainingzone.co.uk/group/trainingzone-book-club/training-evaluation-
toolkit-ebook-needs-reviewing

“Clearly Mr Allan’s 20 plus years of professional experience in Training and Development comes through crystal clear as he identifies the real world challenges that Training and Development professionals experience in providing effective programs that enhance the organization’s performance. He even provides tools for measuring ROI; the measurement of training that continues to grow in importance to prove it’s own worth in many organizations.”

Amy Peters
Corporate Training Manager
Automated Packaging Systems, Inc.

“I looked at many different training evaluation resources and yours was the best by far. I found the Training Evaluation Toolkit very informative and useful. As a trainer and consultant I want to increase my ability to be competitive and demonstrate effectiveness. The Toolkit did provide me with the information I needed. Thanks so much!”

Dawn Rannie-White
Consultant
DCR Consulting

“The Training Evaluation Toolkit provides a complete and comprehensive vision of training and its evaluation. The tools featured in the package are well built, simple to use, easy to implement and really get the job done. The Training Evaluation Toolkit allowed me to move to the next step of training evaluation and to perfect the tools already in place at my workplace. This toolkit really met my expectations and I highly recommend it to all potential customers.”

Mary Gervais
HR Coordinator

“Les Allan's Evaluation Toolkit is one of the best resources I ever encountered. It's comprehensive and you can gear it to your convenience. I highly recommend it.”

Diederick Stoel
Chief Executive Officer
ProfitWise International
www.profitwise.info

“I am very happy with the products that I bought from your company last year (Training Evaluation Tool Kit and Writing Learning Outcomes). The concept/process is uncomplicated, hence I was able to immediately use them in developing and designing a training program as well as measuring the program's effectiveness.”

Lorenzo I. Sales
Training & Development
Boehringer Ingelheim (Phil.), Inc.

“Training Evaluation Toolkit is a comprehensive toolbox for trainers. It has lots of useful and practical training assessment ideas and templates. If you are looking to improve your post training assessment, I suggest you check out Training Evaluation Toolkit immediately.”

Hanzo Ng
Sales Ninja Grandmaster
Sales Ninja Training
www.SalesNinja.com