Monthly Archives: November 2014

They liked the coffee; now what?

kirkpatrick2Several years ago I went to a conference for training professionals and got a chance to attend a session with Donald Kirkpatrick.  A well-known expert in training evaluation, he developed a widely-used model that includes four levels of evaluation:

  1. Reaction of the student – what did they think and feel?
  2. Learning – what skills or capability did the student gain?
  3. Behavior – how has the student used what they learned?
  4. Results – what effect has the student’s performance had on work outcomes or the business environment?

Any training professional will tell you that it’s very tempting to stop with a level one survey that shows whether the participants enjoyed the session, whether the materials were accurate and easy to use, and whether they liked the coffee.  It’s much harder to assess whether the training had any lasting impact on the way we do business.

In the same way, assessing a change effort needs to go beyond stakeholders’ initial thoughts and feelings.  The real question is how the change contributed to achieving the organization’s goals.  This requires much more thought and effort.

One of Dr. Kirkpatrick’s key points is that evaluation needs to be planned up front, and this is as true for change efforts as it is for training activities.  If the first questions is “what do we want to accomplish with this change?”  then it should be followed by “and how will we know that we’ve accomplished it?”  Conversations should occur early in the process about what sort of data needs to be collected, who needs to be consulted, and what sort of reporting will be done.

I’ve been part of several teams that have neglected this step.  When we reached the end of the project, it was too late to go back and get baseline data or mid-term status checks that would have informed evaluation reports.  On the other hand, asking evaluation questions at the beginning can help guide a team’s communication plans and implementation activities.

What methods have you used to build evaluation into the start of a change process?

Dee Anne Bonebright

 

 

Evaluate results!

“One of the great mistakes is to judge policies and programs by their intentions rather than their results”   –  Milton Friedman

resultsThe same is true of any change effort. It’s easy to be committed to (and even fall in love with) the intent of a change effort, but it’s incumbent upon leaders to hold themselves and others accountable by evaluating actual results. What has changed or improved?

This year we have been blogging about the phases of leading change. During November, Todd, Dee Anne, and I will focus on the last phase of change: evaluate results. We’ll cover methods to evaluate results, such as measuring return on investment and assessing stakeholder satisfaction. We’ll also discuss why it is important to evaluate results and who should be involved in the process. And we’ll explore ways to communicate those results in ways that continue to reinforce the change and make it part of your organization’s DNA.

We hope you will join in the conversation this month to share some of your evaluation strategies, along with your successes and challenges.

Anita Rios