AEE 577: Evaluation in Agricultural and Extension Education

NC STATE UNIVERSITY

"Collecting data is a major part of any evaluation, but keep in mind that method follows purpose.”

Ellen Taylor-Powell and Sara Steele

(Collecting Evaluation Data: An Overview of Sources and Methods, 1996)

Class IX: Methods (Techniques) of Data Collection: Role Playing and Focus Groups

This lesson will examine using focus groups and role playing as methods of collecting evaluation data.  This is the second lesson on methods of data collection.

Instructional Objectives:

Upon completion of this lesson, students should be able to:

1. Describe a focus group and how it might be used to evaluate a program.

2. Describe the three phases to a focus group interview.

3. Develop a set of questions to be used in conducting a focus group or interview.

4. Discuss sources for selecting candidates to participate in focus groups.

5. Describe role playing as a method of evaluation.

6. Discuss the three critical sampling issues as related to role playing for evaluation

7. Discuss reasons for varying qualifications of role players.

Required Instructional Activities

1. Read "Using Focus Groups" (pages 340-362) in the course text, Handbook of Practical Program Evaluation by Wholey, Hatry, and Newcomer (2004).

2. Read "Role Playing" (pages 310-337) in the course text, Handbook of Practical Program Evaluation by Wholey, Hatry, and Newcomer (2004).

3. Read the following articles on data collection methods:

Israel, G. D. (1994). Using focus group interviews for evaluating Extension programs. Gainesville, FL: University of Florida, Cooperative Extension Service. Available: http://edis.ifas.ufl.edu/pdffiles/PD/PD03600.pdf.

Taylor-Powell, E., & Steele, S.  (1996).  Collecting Evaluation Data: An Overview of Sources and Methods.  University of Wisconsin, Cooperative Extension.  Available: http://learningstore.uwex.edu/pdf/G3658-4.pdf

Suggested Instructional Activities

You may be interested in the following articles:  These will not be on the test, but for your own use as a resource. 

1. Grudens-Schuck, N., Lundy-Allen, B. & Larson, K. (2004, May) Focus group fundamentals.  Ames, IA:  Iowa State University Extension.  Available at http://www.extension.iastate.edu/Publications/PM1969B.pdf

2. Nordstrom, P. A., Wilson, L. L., Kelsey, T. W., Maretzki, A. N., & Pitts, C. W. (2000). The use of focus group interviews to evaluate agriculture educational materials for students, teachers, and consumers. Available: http://www.joe.org/joe/2000october/rb2.html.

Required Assignments

All items, unless otherwise noted, are due by 12:00 noon on Monday following the week of the class.

1. Post your questions or comments on the Web CT Vista discussion board and reply to at least two postings submitted by your classmates.

2. Reading Assignment # 7 is due by March 16: Open this reading assignment, complete and e-mail as an attachment to the instructor (jay_jayaratne@ncsu.edu). Remember to type your name and save your completed assignment before you e-mail it.

References

Grudens-Schuck, N., Lundy-Allen, B. & Larson, K. (2004, May) Focus group fundamentals.  Ames, IA:  Iowa State University Extension.  Available at http://www.extension.iastate.edu/Publications/PM1969B.pdf

Israel, G. D. (1994). Using focus group interviews for evaluating Extension programs. Gainesville, FL: University of Florida, Cooperative Extension Service. Available: http://edis.ifas.ufl.edu/pdffiles/PD/PD03600.pdf.

Nordstrom, P. A., Wilson, L. L., Kelsey, T. W., Maretzki, A. N., & Pitts, C. W. (2000). The use of focus group interviews to evaluate agriculture educational materials for students, teachers, and consumers. Available: http://www.joe.org/joe/2000october/rb2.html.

Taylor-Powell, E., & Steele, S.  (1996).  Collecting evaluation data: An overview of sources and methods.  University of Wisconsin, Cooperative Extension.  Available: http://learningstore.uwex.edu/pdf/G3658-4.pdf

Wholey, J. S., Hatry, H. P., and Newcomer, K. E. (2004). Handbook of practical program evaluation (2nd edition).  Jossey-Bass, San Francisco, California.