AEE 577: Evaluation in Agricultural and Extension Education

NC STATE UNIVERSITY

"Focusing an evaluation means dealing with several basic concerns. What is the purpose of the evaluation? How will the information be used? What will we know after the evaluation that we don't know now? What actions will we be able to take based on evaluation findings? These are not simply rote questions answered once and then put aside. The utilization-focused evaluator keeps these questions front and center throughout the design process."

 Michael Quinn Patton

(Utilization Focused Evaluation, pp.189-190, 1997, Sage Publications, Inc.)

Class IV:  Using the Logic Models to Plan and Focus the Evaluation
 

While there is no blueprint or recipe for conducting a good evaluation, you can enhance the value of the information gathered if you give sufficient forethought and planning to the evaluation process.  You must decide what you will evaluate, for what purpose and who will use the information and how. The topic for this week is why planning is important and how to plan and focus an evaluation. The logic model is the best tool to plan and focus evaluations. You will explore how to use the logic model for planning and focusing evaluations in this class.

Instructional Objectives:

Upon completion of this lesson, students should be able to:

1. Discuss the Logic Model in planning program evaluations

2. List the components of the Logic Model.

3. Describe and discuss considerations that should guide evaluation planning;

4. Describe aspects of the evaluation plan that must be tailored; and

5. Identify the key questions which must be addressed in order to focus the evaluation.

Required Instructional Activities

1. Read "Meeting the Need" (pages xxxiii-xliv) in the course text, Handbook of Practical Program Evaluation by Wholey, Hatry, and Newcomer (2004).

2. Read "Using Logic Models" (pages 7-32) in the course text, Handbook of Practical Program Evaluation by Wholey, Hatry, and Newcomer (2004).

3. Read an overview of the Logic Model.

4. Complete Module 1: Logic Model Basics.

5. Time spent planning an evaluation is time well spent, read pp. 2-10 of Planning a Program Evaluation by Taylor-Powell, Steele and Douglah for how they suggest you focus your evaluation. Pg. 2 – 10 You will read this entire document by the end of the class, but we will cover sections as appropriate to each weeks topics. (See also the accompanying worksheet listed below).

6. The article Practical Benefits of Evaluation: An Example from the Journal of Extension, Vol.22, No.1, January1984, presents how one group recognized the benefits of evaluation incorporated throughout a program.

7. View the Power Point presentation.

1. Read pp. 35-48 "The W.K. Kellogg Foundation Logic Model development Guide " to learn how to use the logic model for planning and focusing an evaluation.

Required Assignments

All items, unless otherwise noted, are due by 12:00 noon on Monday following the week of the class.

1. Post your questions or comments on the Web CT Vista discussion board and post comments or reactions to at least two postings submitted by your classmates.

2. Reading Assignment #3 from class IV is due by February 2: Open this reading assignment, complete and e-mail as an attachment to the instructor (jay_jayaratne@ncsu.edu). Remember to type your name and save your completed assignment before you e-mail it.

3. At this time, please consider whom you want to work with and what program you might focus on for your term group project.  Go to Web CT Vista and form your group of two members. The first stage of your project is to be submitted on February 4 .  Discuss the type of project you want to select for the term project. The article "Planning a Program Evaluation: Worksheet" by Taylor-Powell, Steele and Douglah is a good learning resource for planning evaluations..

References

Patton, M.Q. (1997). Utilization focused evaluation, 3rd Ed. Sage Publications, Inc. Thousand Oaks, California.

Smith, M. F., Barber, L., & Walker, K. (1984). Practical benefits of evaluation: an example. Journal of Extension, 22:1.  Available: http://www.joe.org/joe/1984january/a1.html

Taylor-Powell, E., Steele, S. & Douglah,M. (1996). Planning a program evaluation. University of Wisconsin, Cooperative Extension.  Available: http://learningstore.uwex.edu/pdf/G3658-1.PDF .

Wholey, J. S., Hatry, H. P., and Newcomer, K. E. (2004). Handbook of practical program evaluation (2nd edition).  Jossey-Bass, San Francisco, California.

W. K. Kellogg Foundation. (2004). Logic model development guide. Available at : http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf