Books by Evaluation Center Faculty

Follow

• 

  The Mainstreaming of Evaluation: New Directions for Evaluation

  J. Jackson Barnette and James R. Sanders

  1. Mainstreaming Evaluation (James R. Sanders) The concept of mainstreaming evaluation is defined, and the question of why mainstreaming is not more prevalent is addressed.

  2. Mainstreaming Evaluation or Building Evaluation Capability? (Three Key Elements Paul Duignan) An overview of three approaches to mainstreaming evaluation that have been used in New Zealand, particularly in human services programs that serve both European and Maori populations, is presented.

  3. The Rigidity and Comfort of Habits: A Cultural and Philosophical Analysis of the Ups and Downs of Mainstreaming Evaluation (Nancy Grudens-Schuck) This chapter describes frameworks for understanding the meanings of evaluation mainstreaming based on anthropological research in Indonesia.

  4. PIE à la Mode: Mainstreaming Evaluation and Accountability in Each Program in Every County of a Statewide School Readiness Initiative (Abraham Wandersman, Paul Flaspohler, April Ace, Laurie Ford, Pamela S. Imm, Matthew J. Chinman, Jeffrey Sheldon, Arlene Bowers Andrews, Cindy A. Crusto, Joy S. Kaufman) This chapter describes the framework and implementation of a program accountability system in a statewide initiative that was developed to enable practitioners to provide evaluation information required by legislative mandate and to develop the capacity of practitioners to systematically plan their program, implement with quality, and self-evaluate.

  5. Helping Evaluators Swim with the Current: Training Evaluators to Support Mainstreaming (J. Jackson Barnette, Anne Baber Wallis) This chapter proposes approaches to evaluation training that aim to seed the field with practitioners who are able work with organizations in an overtly participatory manner.

  6. Issues and Practices Related to Mainstreaming Evaluation: Where Do We Flow from Here? (David D. Williams, Mark L. Hawkes) This chapter summarizes Presidential Strand and other selected sessions from the 2001 annual meeting of the American Evaluation Association.

• 

  Models for Evaluating Scientific Research: A Comparative Analysis of National Systems

  Chris L. Coryn

  Due to its very nature, the evaluation of research permeates nearly every aspect of the work of researchers. They evaluate the work of others or have their own work evaluated. They evaluate hypotheses that come to mind, the previous literature, the quality of data, the explanatory power of theories, or the design of experiments or instruments. However, deciding when someone is or has become a first-rate or world-class researcher is an evaluation at a somewhat different level. It is a complex synthesis of judgments about how well the researcher does each of the constitutive types of evaluation, usually as evidenced in the work they are producing.In the last few decades the evaluation of research has become a high-stakes enterprise. With increasing political governance and federal budgets often in the billions, the livelihood of individual researchers, research groups, departments, programs, and entire institutions often swing in the balance. In this book, the author systematically analyzes and compares the quality of the models used to fund and evaluate scientific research in sixteen countries.

  *description from amazon.com

• 

  International Handbook of Educational Evaluation: Part One: Perspectives / Part Two: Practice

  Thomas Kellaghan, Daniel L. Stufflebeam, and Lori A. Wingate

  Thomas Kellaghan Educational Research Centre, St. Patrick's College, Dublin, Ireland Daniel L. Stufflebeam The Evaluation Center, Western Michigan University, Ml, USA Lori A. Wingate The Evaluation Center, Western Michigan University, Ml, USA Educational evaluation encompasses a wide array of activities, including student assessment, measurement, testing, program evaluation, school personnel evalua­ tion, school accreditation, and curriculum evaluation. It occurs at all levels of education systems, from the individual student evaluations carried out by class­ room teachers, to evaluations of schools and districts, to district-wide program evaluations, to national assessments, to cross-national comparisons of student achievement. As in any area of scholarship and practice, the field is constantly evolving, as a result of advances in theory, methodology, and technology; increasing globalization; emerging needs and pressures; and cross-fertilization from other disciplines. The beginning of a new century would seem an appropriate time to provide a portrait of the current state of the theory and practice of educational evaluation across the globe. It is the purpose of this handbook to attempt to do this, to sketch the international landscape of educational evaluation - its conceptual­ izations, practice, methodology, and background, and the functions it serves. The book's 43 chapters, grouped in 10 sections, provide detailed accounts of major components of the educational evaluation enterprise. Together, they provide a panoramic view of an evolving field.

• 

  Evaluation Models: Viewpoints on Educational and Human Services Evaluation

  George F. Madaus, M. Scriven, and D. L. Stufflebeam

  Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro­ duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the ten evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization.

• 

  International Perspectives on Evaluation Standards

  Craig Russon and Gabrielle Russon

  Prior to 1995, there were fewer than half a dozen regional and national evaluation organizations around the world. Today there are more than fifty, attesting to a growing interest in the practice of program evaluation internationally. Many of these new organizations have undertaken efforts to develop their own standards or to modify existing sets--most typically, the Program Evaluation Standards of the Joint Committee on Standards for Educational Evaluation--for use in their own cultural context. Following two introductory chapters, one a conceptual overview and the second a history of the development and revisions of the Program Evaluation Standards, this issue documents standards development efforts in three different settings: Western Europe, Africa, and Australasia. In addition, because nongovernmental organizations and governments have entered the standard-setting business, other chapters describe standards development activities by the European Commission and CARE International. The content points to the challenge of formalizing standards for program evaluation given cross-cultural differences in values and to the continuing challenges related to implementing voluntary standards.

  This is the 104th issue of the quarterly journal New Directions for Evaluation.

• 

  Evaluation Theory, Models, and Applications

  Daniel Stufflebeam and Chris L. S. Coryn

  Now in its second edition, Evaluation Theory, Models, and Applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. With new evaluation designs and the inclusion of the latest literature from the field, this Second Edition is an essential update for professionals and students who want to stay current. Understanding and choosing evaluation approaches is critical to many professions, and Evaluation Theory, Models, and Applications, Second Edition is the benchmark evaluation guide.

  Authors Daniel L. Stufflebeam and Chris L. S. Coryn, widely considered experts in the evaluation field, introduce and describe 23 program evaluation approaches, including, new to this edition, transformative evaluation, participatory evaluation, consumer feedback, and meta-analysis. Evaluation Theory, Models, and Applications, Second Edition facilitates the process of planning, conducting, and assessing program evaluations. The highlighted evaluation approaches include:

  • Experimental and quasi-experimental design evaluations
  • Daniel L. Stufflebeam's CIPP Model
  • Michael Scriven's Consumer-Oriented Evaluation
  • Michael Patton's Utilization-Focused Evaluation
  • Robert Stake's Responsive/Stakeholder-Centered Evaluation
  • Case Study Evaluation

  Key readings listed at the end of each chapter direct readers to the most important references for each topic. Learning objectives, review questions, student exercises, and instructor support materials complete the collection of tools. Choosing from evaluation approaches can be an overwhelming process, but Evaluation Theory, Models, and Applications, Second Edition updates the core evaluation concepts with the latest research, making this complex field accessible in just one book.

• 

  Evaluation Models: New Directions for Evaluation

  Daniel L. Stufflebeam

  The author of this issue identifies, analyzes and judges twenty-two evaluation approaches thought to cover most program evaluation efforts, providing unique assistance to evaluators faced with choosing an appropriate and valid approach for a particular situation. He describes each approach-its orientation, purpose, typical questions being addressed and methods, and rates them in each of the four areas previously defined by the Joint Committee Program Evaluation Standards: utility, feasibility, propriety and accuracy. Controversially, he concludes that there are only nine methods that merit continued use and development. The standards-based metaevaluation checklist used by the author is included so that readers can judge the validity of his process and conclusions, or use the checklist themselves. This is the 89th issue of the quarterly journal New Directions for Evaluation.

• 

  Evaluation Theory, Models, and Applications

  Daniel Stufflebeam and Anthony Shinkfield

  Evaluation Theory, Models, and Applications is designed for evaluators and students who need to develop a commanding knowledge of the evaluation field: its history, theory and standards, models and approaches, procedures, and inclusion of personnel as well as program evaluation. This important book shows how to choose from a growing array of program evaluation approaches.

  In one comprehensive resource, the authors have compiled vital information from the evaluation literature and draw on a wide range of practical experiences. Using this book, evaluators will be able to identify, analyze, and judge 26 evaluation approaches. The authors also show how to discriminate between legitimate and illicit approaches based on application of the Joint CommitteeProgram Evaluation Standards.

• 

  Improving Formative Assessment Practice to Empower Student Learning

  E. Caroline Wylie, Arlen R. Gullickson, Katharine Cummings, Paula E. Egelson, Lindsay A. Noakes, Kelley M. Norman, and Sally A. Veeder

  Teachers routinely ask and answer a series of three questions with and for students: Where are my students headed? Where are they right now? How can I close the gap between where they are and where I want them to be? This text suggests that teachers also ask these parallel questions of themselves:
  Where am I going?
  What can formative assessment practice look like?
  Where am I currently in my formative assessment practice?
  How do I close the gap?

  Readers are then encouraged to select a specific aspect of formative assessment to investigate, explore relevant personal practice relevant to that aspect, implement necessary changes, reflect on those changes, and continue the change process. This practical guide can be used by individual teachers or collaboratively as a study guide for a learning community. The authors describe an effective four-step process for improving teachers' formative assessment practices that provides opportunities to reflect, consider alternative instructional approaches, and apply what they have learned. Case studies provide examples of formative assessment in practice, along with examples of teacher-implemented changes. A companion website includes an array of tools and templates for organizing, gathering, and systematically using information to strengthen formative assessment skills. This practical guide can be used by individual teachers or collaboratively as a study guide for a learning community. Case studies provide examples of formative assessment in practice, along with examples of teachers implementing changes in their practice. A companion website includes an array of tools and templates for organizing, gathering, and systematically using information to strengthen formative assessment skills. [Foreword by W. James Popham.]