Actionable Evaluation Basics


Book Description

Avoid getting lost in indicators, measures, and analysis methods; use this guide to get clear, well-reasoned, insightful answers to your most important questions about quality and value. Great tips for reporting that is succinct and straight-to-the-point without falling into the trap of oversimplification. This easy-to-read, informative minibook provides an overview of the six elements essential for actionable evaluation, as covered in Dr. Jane Davidson's popular workshops on Actionable Evaluation: (1) a clear purpose for the evaluation; (2) the right stakeholder engagement strategy; (3) important, big picture evaluation questions to guide the whole evaluation; (4) well-reasoned answers to the big picture questions; (5) succinct, straight to the point reporting that doesn't get lost in the details; and (6) answers and insights that are actionable.




Evaluation Methodology Basics


Book Description

Evaluation Methodology Basics introduces evaluation by focusing on the main kinds of 'big picture' questions that evaluations usually need to answer, and how the nature of such questions are linked to evaluation methodology choices. The author: shows how to identify the right criteria for your evaluation; discusses how to objectively figure out which criteria are more important than the others; and, delves into how to combine a mix of qualitative and quantitative data with 'relevant values' (such as needs) to draw explicitly evaluative conclusions.




Credible and Actionable Evidence


Book Description

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.




Principles-Focused Evaluation


Book Description

How can programs and organizations ensure they are adhering to core principles--and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises. ÿ




Introduction to Theory-Driven Program Evaluation


Book Description

Introduction to Theory-Driven Program Evaluation provides a clear guide for practicing evaluation science, and numerous examples of how these evaluations actually unfold in contemporary practice. A special emphasis is placed how to conduct theory-driven program evaluations that are culturally responsive and strengths-focused. In this thoroughly revised new edition, author Stewart I. Donaldson provides a state-of-the art treatment of the basics of conducting theory-driven program evaluations. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. The initial chapters discuss the evolution and popularity of theory-driven program evaluation, as well as step-by-step guide for culturally responsive and strengths-focused applications. Succeeding chapters provide actual cases and discuss the practical implications of theory-driven evaluation science. Reflections, challenges, and lessons learned across numerous cases from practices are discussed. The volume is of significant value to practicing evaluators, professors of introductory evaluation courses and their students, advanced undergraduate and graduate students, and serves as a text or a supplementary text for a wide range of evaluation and applied research courses. It is also of great interest to those interested in the connections between work and health, well-being, career development, human service organizations, and organizational improvement and effectiveness.




Performance-focused Smile Sheets


Book Description

This book, "Performance-Focused Smile Sheets," completely reimagines the smile sheet as an essential tool to drive performance improvement. Traditional smile sheets (i.e., learner response forms, student reaction forms) don't work! Decades of practice shows them to have negligible benefits. Scientific studies prove that traditional smile sheets are not correlated with learning results! Yet still we rely on smile sheets to make critical decisions about our learning interventions. In this book, Dr. Will Thalheimer carefully builds the case for a new methodology in smile-sheet design. Based on the learning research, "Performance-Focused Smile Sheets" shows how to write better questions, more focused on performance. The book also shows how to deploy smile sheets to our learners to get valid feedback--feedback that can be used to help us as trainers, instructional designers, teachers, professors, eLearning developers, and chief learning officers build virtuous cycles of continuous improvement.




Utilization-Focused Evaluation


Book Description

The second edition of Patton's classic text retains the practical advice, based on empirical observation and evaluation theory, of the original. It shows how to conduct an evaluation, from beginning to end, in a way that will be useful -- and actually used. Patton believes that evaluation epitomizes the challenges of producing and using information in the information age. His latest book includes new stories, new examples, new research findings, and more of Patton's evaluation humour. He adds to the original book's insights and analyses of the changes in evaluation during the past decade, including: the emergence of evaluation as a field of professional practice; articulation of standards for evaluation; a methodological synthesis of the qualitative versus quantitative debate; the tremendous growth of 'in-house' evaluations; and the cross-cultural development of evaluation as a profession. This edition also incorporates the considerable research done on utilization during the last ten years. Patton integrates diverse findings into a coherent framework which includes: articulation of utilization-focused evaluation premises; examination of the stakeholder assumption; and clarification of the meaning of utilization. --Publisher description.




Getting Teacher Evaluation Right


Book Description

Teacher evaluation systems are being overhauled by states and districts across the United States. And, while intentions are admirable, the result for many new systems is that goodoften excellentteachers are lost in the process. In the end, students are the losers. In her new book, Linda Darling-Hammond makes a compelling case for a research-based approach to teacher evaluation that supports collaborative models of teacher planning and learning. She outlines the most current research informing evaluation of teaching practice that incorporates evidence of what teachers do and what their students learn. In addition, she examines the harmful consequences of using any single student test as a basis for evaluating individual teachers. Finally, Darling-Hammond offers a vision of teacher evaluation as part of a teaching and learning system that supports continuous improvement, both for individual teachers and for the profession as a whole.




The Goldilocks Challenge


Book Description

The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.




Handbook on Measurement, Assessment, and Evaluation in Higher Education


Book Description

In this valuable resource, well-known scholars present a detailed understanding of contemporary theories and practices in the fields of measurement, assessment, and evaluation, with guidance on how to apply these ideas for the benefit of students and institutions. Bringing together terminology, analytical perspectives, and methodological advances, this second edition facilitates informed decision-making while connecting the latest thinking in these methodological areas with actual practice in higher education. This research handbook provides higher education administrators, student affairs personnel, institutional researchers, and faculty with an integrated volume of theory, method, and application.