AEE 577: Evaluation in Agricultural and Extension Education

NC STATE UNIVERSITY

 People use models to better understand and explain complex and dynamic situations. Evaluators do the same to better understand programs and plan the process of evaluation.

Class III:  Evaluation Approaches and Models
 

There are many different evaluation approaches and models and this week we are going to review some of those evaluation approaches and models.

There are models that help us conceptualize the task of evaluation. This week we will review some evaluation models and how those models relate to Extension work including the TOP Model.  The review of evaluation models is helpful for us to better understand their potentials and limitations in planning evaluations.

Use the following instructional objectives for this class as a guideline as you work through the various types of evaluations.  You should be able to address each one.

Instructional Objectives:

Upon completion of this lesson, students should be able to:

1. Discuss the differences between independent (expert) evaluations, participatory (collaborative) evaluations and empowerment evaluations.

2. Describe Goal-Free and Goal-Based evaluations.

3. Describe the steps of the TOP model and components of each step.

4. Discuss the linkage between program planning and evaluation in relation to the TOP model.

5. Describe the foundational concepts of criteria, evidence and judgment as they relate to evaluation.

6. Describe and discuss the following Evaluation models and approaches:

   a.    Bennett's Hierarchy

   b.   Jacob's Five-Tier Approach

   c.    Kirkpatrick's Training Evaluation Model

   d.    United way Model

   e.    Provus's Discrepancy Model

   f.    Stake's Responsive Approach

   g.    Centers for Disease Control (CDC) Model

   h.    CIPP Model

7. Choose the right evaluation model for a given situation.
8. Express how various evaluation issues influence their personal philosophy of evaluation and its role in extension programming.

Required Instructional Activities

1. View the Power Point presentation. It provides an overview of the class content.

2. Read Developing a Concept of Extension Program Evaluation by Douglah for an overview of the various evaluation concepts and terms.

3. Read “Choosing An Evaluation Model” pp. 73-82 from The ABCs of Evaluation.  

4. Read Claude Bennett's "Up the Hierarchy" from the Journal of Extension to understand Bennett's hierarchy of extension events.

5. Read A Hierarchy for Targeting Outcomes and Evaluating Their Achievement  (TOP Model) by Rockwell and Bennett. This is several pages and you need to follow all the primary links.

6. Read about the CIPP model this is a 12 page article, if you want to read the 68 page article read the Stufflebeam article listed below in suggested instructional activities.

7. Read Making Evaluation Manageable from the Journal of Extension where Constance McKenna discusses Discrepancy Model by Provus and how it fits with Extensionese.

8. Read Kirkpatrick's Learning and Training Evaluation Model posted on this web site.

9. Read United Way Evaluation Model posted on this web site.

Suggested Instructional Activities

1. Read Evaluating International Agricultural and Extension Education by Rama Radhakrishna. This article explains application of different evaluation models.   

2. Write a draft of your personal philosophy of program evaluation and its role in extension programming.  This will benefit you as you begin developing your evaluation plan.  It does not have to be submitted.

3. View David Fatterman's interview about empowerment evaluation. David Fatterman is the leading empowerment evaluator.

4. Print off the study guide for use while reading The CIPP Model for Evaluation by Daniel Stufflebeam (item 5 below).

5. Read The CIPP Model for Evaluation by Daniel Stufflebeam. Presented at the 2003 Annual Conference of the Oregon Program Evaluators Network.

6. View this Goal-Free and Goal-Based evaluation Power Point presentation by Brandon W. Youker.

Required Assignments

All items, unless otherwise noted, are due by 12:00 noon on Monday following the week of the class.

1. Post your questions or comments on the Web CT Vista discussion board and post questions and/or reply to at least two postings submitted by your classmates.

2. Second reading assignment due by January 26: Open this first reading assignment, complete and e-mail as an attachment to the instructor (jay_jayaratne@ncsu.edu). Remember to type your name and save your completed assignment before you e-mail it.

3. You should be giving serious thought to select a program for your evaluation term project. You may select an educational/extension program or an activity for the evaluation term project. Please discuss your idea with the potential group mate before you finalize it.

4. Evaluation Model Assignment due by January 28:Select an evaluation model from the list and prepare a report about it. Go to WebCT Vista for evaluation model sign-up sheet and enter your name in front of the model that you would like to prepare your report.

References

Bennett, C. (1975). Up the hierarchy. Journal of Extension, 75 (2). Available: http://www.joe.org/joe/1975march/1975-2-a1.pdf

Boulmetis, J. & Dutwin, P. (2000).  The ABCs of evaluation: timeless techniques for program and project managers.  San Francisco: Jossey-Bass. 

Douglah, M.  (1998).  Developing a concept of extension program evaluation. University of Wisconsin, Cooperative Extension.  Available: http://learningstore.uwex.edu/pdf/G3658-7.PDF

McKenna, C. (1981).  Making evaluation manageable. Journal of Extension, 81(5). Available: http://www.joe.org/joe/1981september/81-5-a1.pdf

Radhakrishna, R. Evaluating international and agricultural extension education projects: Problems, challenges, and strategies. Association for International Agricultural and Extension Education.            Available at: http://www.aiaee.org/2001/pa42.pdf

Rockwell, K. & Bennett, C. A hierarchy for targeting outcomes and evaluating their achievement.  Available at: . http://citnews.unl.edu/TOP/english/

Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2004). Handbook of practical program evaluation (2nd edition).  Jossey-Bass, San Francisco, California.