Using Program Evaluation Workshop with Len Bickman




Using Program Evaluation Workshop with Len Bickman

14 of the 18 faculty that attended completed evaluations.

Dr. Bickman is coeditor of two handbooks on social research methods and a social research methods series for Sage Publications. He has published more than 15 books and monographs, and 200 articles and chapters. With a track record of external funding throughout his full-time academic career, Dr. Bickman has been designated among the top 5% in productivity nationally among faculty in Developmental Sciences. He has received numerous awards recognizing the contributions of his research, including the American Evaluation Association’s Outstanding Evaluation Award and the Association’s Alva and Gunnar Myrdal Evaluation Practice Award. Dr. Bickman is a past president of the American Evaluation Association and the Society for the Psychological Study of Social Issues.

Program evaluation is the systematic assessment of the processes and/or outcomes of a program, usually with the intent of furthering its development and improvement. This introductory lecture will describe the basics of program evaluation methods and theories including design, assessment, implementation analyses, and program theory. The barriers and incentives for conducting evaluations in our society will also be discussed. The talk will illustrate how many of the unique techniques developed in program evaluation can be utilized in areas of research.

Some practical tips that faculty learned from Dr. Bickman included the "importance of context in evaluation process and barriers to evaluation." The participants also felt that "it was refreshing to learn that others experience the same barriers to program evaluation that I do in my research." Different models such as the logic model and range model were also discussed.

Faculty attending the workshop enjoyed the information that Len Bickman presented. They even mentioned that information presented was very informative and will be useful for future projects, such as a dissertation. One faculty mentioned that the lecture was a "good high level view of evaluation."

Questions & Responses

The overview of program evaluation methods and theories was informative.
N=14 Mean=4.57 SD=0.65 Range= 1 (strongly disagree)- 5 (strongly agree)

I learned information in this workshop which will impact my approach to program evaluation activities.
N=14 Mean=4.57 SD=0.51 Range= 1 (strongly disagree)- 5 (strongly agree)

As a result of this workshop, I am more knowledgeable about unique techniques of program evaluation of value to research projects.
N=14 Mean=4.14 SD=0.95 Range= 1 (strongly disagree)- 5 (strongly agree)

I am glad I took the time to participate in this presentation.
N=14 Mean=4.79 SD=0.43 Range= 1 (strongly disagree)- 5 (strongly agree)

Questions & Answers:

Please give a specific example of at least one thing you learned and will definitely take from the presentation to use in your work.

  • Remember the components to evaluation.
  • Logic model.
  • Importance of context in evaluation process. The barriers to evaluation.
  • Questions to be asked about program evaluations, prior knowledge to be known, what to expect.
  • It was refreshing to learn that others experience the same barriers to program evaluation that I do in my research.
  • The importance of program evaluation and the challenges that there can be.
  • Use of the range model, different forms of evaluation.
  • Have evaluation data as well as research data to answer the research questions.
  • Evaluator may seek unintended negative outcomes.

Is there anything that could have been improved about this session?

  • Detail instead of overview.
  • More information on how to actually program evaluate.
  • No.

General Comments about the overall workshop?

  • At right level. Interesting.
  • Very informative, will be helpful for dissertation research.
  • Wonderful, thanks for rescheduling this!
  • Very informative.
  • Thank you for the lovely room and also the refreshments.
  • Good high level view of evaluation. Some more practice hands-on techniques would be useful.
  • Thank you.