Before providing some explanation, let me first say that implementing effective evaluation is as my dad Don Kirkpatrick says - much an art as it is a science. I will do my best to explain the science of it – how it works.

The initial circle – Step 1 – assumes that discussions have occurred between learning professionals and business partners to determine that, yes, training is indicated to at least be part of the solution to the business need or opportunity.  Once the program has been developed with those needs and desired outcomes in mind, and delivered to the desired audience, it is time to look to evaluation.  Note that evaluation starts even before the end of the program, as good facilitators and teachers find many ways to ensure that their work is effective even as they deliver it.

Once the program (instructor-led, self-study, on-line, etc) is completed, it is time for Level 1 evaluation to take place – reaction. Note that here is where the feedback loop begins. If the program was effective – as determined through content, facilitation, facilities, etc. in Step 2, on you go to Level 2 evaluation (Step 5). If it wasn’t, it is imperative to loop back to the design and delivery of the program to make necessary improvements (Step 4). If targeted learning has been determined to have occurred (Step 6), then it is time for the all-important Level 3 – the application of knowledge and skills to the job (Step 7). If it hasn’t, again you must loop back and fix what is wrong (Step 4). Level 3 evaluation is critical in that, if effectively administered, it will tell you whether the transfer is occurring, and if not, why not. You then either loop back to Steps 9 and 10, or proceed to the finish line – Step 11. It is our contention at SMR, and the contention of my father Don and me that then, and only then, is it time to address another of Don’s purposes of evaluation – to demonstrate the value of training/learning to the business!!

Well, there is a brief look at the science. Unfortunately, many organizations understand the science, but still are far from successful with evaluation. That is because they do not understand the art of it, and consequently fail to execute it. I challenge you not to be one of them.

SMR Events
There are two upcoming SMR events that I would like to direct your attention to.

1)	The Kirkpatrick Evaluation Summit at Training USA 2008 First, we are co-sponsoring a Kirkpatrick Evaluation Summit with Training Magazine. This event, to be held in Atlanta, Georgia, USA, will take place the first week in February, 2008. This will be a cutting edge, 2-day event! The first day consists of Don and Jim delivering an exciting, practical program featuring the implementation of the four levels. The second day will expose you to some of the most famous and brilliant evaluation specialists in the world. You will hear from them first hand how their particular models address the critical business partnership model – how to not only evaluate programs, but how to create value for and demonstrate the value of your entire learning function!!! If that isn’t enough, it will also feature six learning professionals from major US corporations who will share the secrets of how they made these theories successfully come to life. Please CLICK HERE for more details.
2)	The Asia HRD Congress 2008 Not to be outdone by US conferences, the Asia HRD Congress 2008 promises to be better than ever. Please check out www.hrdcongress.com for more details. We will have training and evaluation experts from Asia, the US, and Europe to add to the other experts in all aspects of Human Resource Development.

Finally, for those who celebrate the joys of the season – we wish you the best of holidays and a terrific New Year. Feel free to contact me for information on any of our consulting services.

Best regards,
Jim Kirkpatrick, PhD
VP Global Training and Consulting
SMR USA, Inc.