Off-campus UNL users: To download campus access dissertations, please use the following link to log into our proxy server with your NU ID and password. When you are done browsing please remember to return to this page and log out.

Non-UNL users: Please talk to your librarian about requesting this dissertation through interlibrary loan.

TESTING AND EVALUATING A FLOW CHART FOR IDENTIFYING PROGRAM IMPACT WITH IMPLICATIONS FOR EVALUATION

SHIRLEY KAY ROCKWELL, University of Nebraska - Lincoln

Abstract

This was a study from social science theory that applies when conducting systematic program evaluation. The purpose of the study was to develop, utilize and evaluate a flow chart for identifying program impact in the Cooperative Extension Service; and to identify implications for impact methodology in program evaluation. A flow chart was designed with focused on five steps in an evaluation process to identify program impact in terms of clientele utilization. The five steps were: (a) collecting qualitative data from clientele, (b) converting the qualitative data into a quantitative data collection instrument, (c) collecting quantitative data from clientele, (d) documenting direct and indirect costs of the program, and (e) correlating the results of three data collection phases. The flow chart was tested on a pilot project in the Cooperative Extension Service which was a television series called "Farm and Ranch Report." By using the flow chart, the evaluation (a) looked at the television program as it actually functioned in Nebraska and provided results which were generalized to the entire population; (b) focused on collecting information from the target audience in both qualitative and quantitative forms which were supportive of each other, provided insights that one method alone would not have supplied, and helped formulate logical conclusions and interpretations; and (c) established a cost-effectiveness index but no economic consequences for the program users. A goal-free process limited the study to four variables which were related to two levels of program impacts and were broad in scope. These variables provided a basis for additional follow-up for more specific information. The report about the pilot project used to test the flow chart was appraised to judge how the study met evaluation standards. The "Standards for Appraising Studies in the Cooperative Extension Service" were reconstructed into an instrument which allowed reviewers to judge the study report and provide written feedback about how the study did or did not meet each standard. It was concluded the overall concept outlined in the flow chart was acceptable as a process to apply theoretical concepts from existing evaluation models and research designs to a specific evaluation situation. It suggested that concepts from various approaches could be correlated to obtain a more valid and reliable picture of the impact a program is having on the target audience.

Subject Area

Adult education|Continuing education

Recommended Citation

ROCKWELL, SHIRLEY KAY, "TESTING AND EVALUATING A FLOW CHART FOR IDENTIFYING PROGRAM IMPACT WITH IMPLICATIONS FOR EVALUATION" (1984). ETD collection for University of Nebraska-Lincoln. AAI8423823.
https://digitalcommons.unl.edu/dissertations/AAI8423823

Share

COinS