Growing the Knowledge Base in Evaluation


Book Description

Evaluation use was identified by Henry and Mark (2003) as being the single most studied area in the field of evaluation. They refer with a sense of nostalgia to the ‘golden age’ of research on use perhaps almost implying that it came and went. Professor J. Bradley Cousins has had a longstanding and continuing commitment to advancing theory and practice regarding use through empirical research on evaluation, and through the professional development of students and practitioners within North America and internationally. The important influence and impact of the contributions of Cousins and associates is the focus of this edited book. This book brings together a distinguished, international group of authors, to reflect on the areas of contribution of Professor Cousins, and situate his work within contemporary areas of evaluation research and practice. Each chapter describes how the study and practice of evaluation has weaved its way through our understanding of organizational learning, participatory evaluation, and evaluation capacity building. The book concludes with a reflection by Professor Cousins himself on what these insights mean for the field of evaluation, and what future areas of research and contribution can be planned for and anticipated.




Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice


Book Description

Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity-based focus is rapidly becoming an historical artifact. Therefore, culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators. The continued amplification of racial, ethnic, linguistic, and cultural diversity and awareness among the populations of the U.S. and other western nations insists that social science researchers and evaluators inextricably engage culturally responsive approaches in their work. It is unacceptable for most mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that do not attend to CRE. Our global demographics are a reality that can be appropriately described and studied within the context of complexity theory and theory of change (e.g., Stewart, 1991; Battram, 1999). And this perspective requires a distinct shift from “simple” linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches. The development of policy that is meaningfully responsive to the needs of traditionally disenfranchised stakeholders and that also optimizes the use of limited resources (human, natural, and financial) is an extremely complex process. Fortunately, we are presently witnessing developments in methods, instruments, and statistical techniques that are mixed methods in their paradigm/designs and likely to be more effective in informing policymaking and decision-making. Culturally responsive evaluation is one such phenomenon that positions itself to be relevant in the context of dynamic international and national settings where policy and program decisions take place. One example of a response to address this dynamic and need is the newly established Center for Culturally Responsive Evaluation and Assessment (CREA) in the College of Education at the University of Illinois at Urbana-Champaign. CREA is an outgrowth of the collective work and commitments of a global community of scholars and practitioners who have contributed chapters to this edited volume. It is an international and interdisciplinary evaluation center that is grounded in the need for designing and conducting evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity so as to be actively responsive to culturally diverse communities and their aspirations. The Center’s purpose is to address questions, issues, theories, and practices related to CRE and culturally responsive educational assessment. Therefore, CREA can serve as a vehicle for our continuing discourse on culture and cultural context in evaluation and also as a point of dissemination for not only the work that is included in this edited volume, but for the subsequent work it will encourage.




Impact Evaluation in Practice, Second Edition


Book Description

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.




Evaluation for an Equitable Society


Book Description

Governments and organizations of all shapes and sizes espouse values of equity and social justice. Yet, there are many examples of unfair social arrangements and employment conditions, dysfunctional government practices, and growing income inequality in both developed and developing countries worldwide. The profession and transdiscipline of evaluation is well equipped to address issues of inequality and social injustice, but until recently has been much more focused on primary stakeholder and donor satisfaction (being as useful as possible to funders of interventions and evaluations) and accountability concerns. The authors in this volume challenge the field of evaluation to become more concerned about using evaluation to develop more equitable organizations, governments, and societies. Leading evaluation theorists and practitioners including Michael Scriven, Jennifer Greene, Thomas Schwandt, Emily Gates, Sandra Mathison, Karen Kirkhart, Saville Kushner, Lois-Ellin Datta, Ernest House, Robert Stake, Patricia Rogers, Robert Picciotto and Stewart Donaldson, provide a range of visions for how evaluation can play a much larger role in facilitating social justice across the globe. Evaluation for an Equitable Society will be of great interest to evaluation practitioners, students and scholars. It will be of interest to those teaching and taking introductory evaluation courses, as well as advanced courses focused on improving evaluation theory and practice.




Introduction to Theory-Driven Program Evaluation


Book Description

Introduction to Theory-Driven Program Evaluation provides a clear guide for practicing evaluation science, and numerous examples of how these evaluations actually unfold in contemporary practice. A special emphasis is placed how to conduct theory-driven program evaluations that are culturally responsive and strengths-focused. In this thoroughly revised new edition, author Stewart I. Donaldson provides a state-of-the art treatment of the basics of conducting theory-driven program evaluations. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. The initial chapters discuss the evolution and popularity of theory-driven program evaluation, as well as step-by-step guide for culturally responsive and strengths-focused applications. Succeeding chapters provide actual cases and discuss the practical implications of theory-driven evaluation science. Reflections, challenges, and lessons learned across numerous cases from practices are discussed. The volume is of significant value to practicing evaluators, professors of introductory evaluation courses and their students, advanced undergraduate and graduate students, and serves as a text or a supplementary text for a wide range of evaluation and applied research courses. It is also of great interest to those interested in the connections between work and health, well-being, career development, human service organizations, and organizational improvement and effectiveness.




Outcome Harvesting


Book Description

Are you a grant maker, manager or evaluator who must assess your work to improve as well as be accountable for the use of resources and results? Does the project, program or organization you fund, manage or evaluate contend with substantial uncertainty about what to do and what will be the results? Do you thus experience constant change and unexpected and unforeseeable actors and factors in your intervention? Do you need to know what you are achieving and how in real time? And therefore, do you seek an alternative to conventional monitoring and evaluation of social change results? If yes, then you are the audience for this book. Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cutting–edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents. Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others. In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features.




A Practical Guide to Teacher Education Evaluation


Book Description

J. T. Sandefur Western Kentucky University American's ability to compete in world markets is eroding. The productivity growth of our competitors outdistances our own. The capacity of our economy to provide a high standard of living for all our people is increasingly in doubt. As jobs requiring little skill are automated or go offshore and demand increases for the highly skilled, the pool of educated and skilled people grows smaller and the backwater of the unemployable rises. Large numbers of American children are in limbo--ignorant of the past and unprepared for the future. Many are dropping out--notjust out of school--but out of productive society. These are not my words. They are a direct quote from the Executive Summary of the Carnegie Forum Report on Education and the Economy entitled A Nation Prepared: Teachers for the 21st Century (p. 2, 1986). This report was motivated by four purposes: 1. To remind Americans, yet again, of the economic challenges pressing us on all sides; 2. To assert the primacy of education as the foundation of economic growth, equal opportunity and a shared national vision; 3. To reaffirm that the teaching profession is the best hope for establishing new standards of excellence as the hallmark of American education; and 4. To point out that a remarkable window of opportunity lies before us in the next decade to reform education, an opportunity that may not present itself again until well into the next century.







Evolving Knowledge Bases


Book Description

An Evolving Knowledge Base (EKB) is capable of self evolution by means of its internally specified behaviour. In this thesis the author incrementally specifies, semantically characterizes and illustrates with examples, the concepts and tools necessary to the development of EKBs.




Learning About Assessment, Learning Through Assessment


Book Description

The MSEB, with generous support and encouragement from the Carnegie Corporation of New York, seeks to bring discussion of assessment to school-and district-based practitioners through an initiative called Assessment in Practice (AIP). Originally conceived as a series of "next steps" to follow the publication of Measuring Up and For Good Measure, the project, with assistance from an advisory board, developed a publication agenda to provide support to teachers and others directly involved with the teaching and assessment of children in mathematics classrooms at the elementary, middle, and high school levels. In a series of three booklets, AIP presents an exploration of issues in assessment. The first booklet, Learning About Assessment, Learning Through Assessment discusses ways to assist teachers in learning about assessment and how student work can be a rich resource in professional development. The second, Assessment in Support of Instruction, makes a case for aligning assessments with state and district curriculum frameworks and examines ways in which states have shifted their curriculum frameworks and related state assessment programs to reflect the NCTM Standards and other perspectives. The third booklet, Keeping Score, discusses issues to be considered while developing high quality mathematics assessments. This series is specifically designed to be used at the school and school district level by teachers, principals, supervisors, and measurement specialists.