Designing Educational Project and Program Evaluations


Book Description

Drawing upon experiences at state and local level project evaluation, and based on current research in the professional literature, Payne presents a practical, systematic, and flexible approach to educational evaluations. Evaluators at all levels -- state, local and classroom -- will find ideas useful in conducting, managing, and using evaluations. Special user targets identified are state department of education personnel and local school system administrative personnel. The volume can be used by those doing evaluation projects `in the field', or as a text for graduate courses at an introductory level. The book begins with an overview of the generic evaluation process. Chapter Two is devoted to the criteria for judging the effectiveness of evaluation practice. Chapter Three addresses the all important topic of evaluation goals and objectives. Chapters Four, Five and Six basically are concerned with the approach, framework, or design of an evaluation study. Chapter Four contains a discussion of four major philosophical frameworks or metaphors and the implications of these frameworks for conducting an evaluation. Chapters Five and Six describe predominantly quantitative and qualitative designs, respectively. Design, implementation and operational issues related to instrumentation (Chapter Seven), management and decision making (Chapter Eight), and reporting and utilization of results (Chapter Nine) are next addressed. The final chapter of the book (Chapter Ten) considers the evaluation of educational products and materials.




Designing Educational Project and Program Evaluations


Book Description

Drawing upon experiences at state and local level project evaluation, and based on current research in the professional literature, Payne presents a practical, systematic, and flexible approach to educational evaluations. Evaluators at all levels -- state, local and classroom -- will find ideas useful in conducting, managing, and using evaluations. Special user targets identified are state department of education personnel and local school system administrative personnel. The volume can be used by those doing evaluation projects `in the field', or as a text for graduate courses at an introductory level. The book begins with an overview of the generic evaluation process. Chapter Two is devoted to the criteria for judging the effectiveness of evaluation practice. Chapter Three addresses the all important topic of evaluation goals and objectives. Chapters Four, Five and Six basically are concerned with the approach, framework, or design of an evaluation study. Chapter Four contains a discussion of four major philosophical frameworks or metaphors and the implications of these frameworks for conducting an evaluation. Chapters Five and Six describe predominantly quantitative and qualitative designs, respectively. Design, implementation and operational issues related to instrumentation (Chapter Seven), management and decision making (Chapter Eight), and reporting and utilization of results (Chapter Nine) are next addressed. The final chapter of the book (Chapter Ten) considers the evaluation of educational products and materials.




Educational Technology Program and Project Evaluation


Book Description

Educational Technology Program and Project Evaluation is a unique, comprehensive guide to the formative and summative evaluation of programs, projects, products, practices and policies involving educational technology. Written for both beginning and experienced evaluators, the book utilizes an integrative, systems-based approach; its practical emphasis on logic models and theories of change will help readers navigate their own evaluation processes to improve interventions and conduct meaningful educational research. Key features include: evidence-based guidelines for constructing and conducting evaluations practical exercises to support the development of knowledge, skills, and program evaluation portfolios a variety of interdisciplinary case studies references and links to pertinent research and resources Using the TELL, ASK, SHOW, DO model first introduced in this series, Educational Technology Program and Project Evaluation provides comprehensive coverage of the concepts, goals, design, implementation, and critical questions imperative to successful technology-enhanced evaluation.




The Program Evaluation Standards


Book Description

Including a new section on evaluation accountability, this Third Edition details 30 standards which give advice to those interested in planning, implementing and using program evaluations.




Impact Evaluation in Practice, Second Edition


Book Description

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.




Program Evaluation Theory and Practice


Book Description

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large- and small-scale evaluations. Numerous sample studies—many with reflective commentary from the evaluators—reveal the process through which an evaluator incorporates a paradigm into an actual research project. The book shows how theory informs methodological choices (the specifics of planning, implementing, and using evaluations). It offers balanced coverage of quantitative, qualitative, and mixed methods approaches. Useful pedagogical features include: *Examples of large- and small-scale evaluations from multiple disciplines. *Beginning-of-chapter reflection questions that set the stage for the material covered. *"Extending your thinking" questions and practical activities that help readers apply particular theoretical paradigms in their own evaluation projects. *Relevant Web links, including pathways to more details about sampling, data collection, and analysis. *Boxes offering a closer look at key evaluation concepts and additional studies. *Checklists for readers to determine if they have followed recommended practice. *A companion website with resources for further learning.




Understanding by Design


Book Description

What is understanding and how does it differ from knowledge? How can we determine the big ideas worth understanding? Why is understanding an important teaching goal, and how do we know when students have attained it? How can we create a rigorous and engaging curriculum that focuses on understanding and leads to improved student performance in today's high-stakes, standards-based environment? Authors Grant Wiggins and Jay McTighe answer these and many other questions in this second edition of Understanding by Design. Drawing on feedback from thousands of educators around the world who have used the UbD framework since its introduction in 1998, the authors have greatly revised and expanded their original work to guide educators across the K-16 spectrum in the design of curriculum, assessment, and instruction. With an improved UbD Template at its core, the book explains the rationale of backward design and explores in greater depth the meaning of such key ideas as essential questions and transfer tasks. Readers will learn why the familiar coverage- and activity-based approaches to curriculum design fall short, and how a focus on the six facets of understanding can enrich student learning. With an expanded array of practical strategies, tools, and examples from all subject areas, the book demonstrates how the research-based principles of Understanding by Design apply to district frameworks as well as to individual units of curriculum. Combining provocative ideas, thoughtful analysis, and tested approaches, this new edition of Understanding by Design offers teacher-designers a clear path to the creation of curriculum that ensures better learning and a more stimulating experience for students and teachers alike.




Evaluating Professional Development


Book Description

Explains how to better evaluate professional development in order to ensure that it increases student learning, providing questions for accurate measurement of professional development and showing how to demonstrate results and accountability.




Evaluation of PEPFAR's Contribution (2012-2017) to Rwanda's Human Resources for Health Program


Book Description

Since 2004, the U.S. government has supported the global response to HIV/AIDS through the President's Emergency Plan for AIDS Relief (PEPFAR). The Republic of Rwanda, a PEPFAR partner country since the initiative began, has made gains in its HIV response, including increased access to and coverage of antiretroviral therapy and decreased HIV prevalence. However, a persistent shortage in human resources for health (HRH) affects the health of people living with HIV and the entire Rwandan population. Recognizing HRH capabilities as a foundational challenge for the health system and the response to HIV, the Government of Rwanda worked with PEPFAR and other partners to develop a program to strengthen institutional capacity in health professional education and thereby increase the production of high-quality health workers. The Program was fully managed by the Government of Rwanda and was designed to run from 2011 through 2019. PEPFAR initiated funding in 2012. In 2015, PEPFAR adopted a new strategy focused on high-burden geographic areas and key populations, resulting in a reconfiguration of its HIV portfolio in Rwanda and a decision to cease funding the Program, which was determined no longer core to its programming strategy. The last disbursement for the Program from PEPFAR was in 2017. Evaluation of PEPFAR's Contribution (2012-2017) to Rwanda's Human Resources for Health Program describes PEPFAR-supported HRH activities in Rwanda in relation to programmatic priorities, outputs, and outcomes and examines, to the extent feasible, the impact on HRH and HIV-related outcomes. The HRH Program more than tripled the country's physician specialist workforce and produced major increases in the numbers and qualifications of nurses and midwives. Partnerships between U.S. institutions and the University of Rwanda introduced new programs, upgraded curricula, and improved the quality of teaching and training for health professionals. Growing the number, skills, and competencies of health workers contributed to direct and indirect improvements in the quality of HIV care. Based on the successes and challenges of the HRH program, the report recommends that future investments in health professional education be designed within a more comprehensive approach to human resources for health and institutional capacity building, which would strengthen the health system to meet both HIV-specific and more general health needs. The recommendations offer an aspirational framework to reimagine how partnerships are formed, how investments are made, and how the effects of those investments are documented.




Educational Technology


Book Description

The aim of this book is to prepare students with knowledge and skills to understand the organizational needs and requirements of educational technology. Students should be able to use and manage both existing and emerging technologies effectively and be able to apply associated pedagogies to suit the environment, but also evaluate and manage technological advances of future and the requisite pedagogical shifts to achieve efficiency and effectiveness. The demand of educational technology has been rising steadily, primarily due to the fact that e-learning is a huge and significantly expanding world-wide industry. Commercial e-learning companies, training departments in large companies and organizations, computer software companies and educational institutions the world over employ large numbers of educational technology specialists. There is a strong demand for technologists who understand educational theories and for instructional designers and teachers who understand technologies. This book is targeted towards those who are looking for career in educational technology, instructional design, or media and information systems, or may want to continue their studies in graduate programs in learning and instructional technology, and those who are interested in becoming teacher in K-12 setting but need background in educational technology. This book will also act as a valuable resource in teacher education programs where primary focus on mainstream education and requires an authentic resource in instructional design and educational technology. Keeping in mind the varied needs of the organizations, employees and potential students, this book adopts a competency approach to learning and assessment. The themes and topics take a multi-disciplinary approach, and are aimed at preparing students for competent and innovative educational technology professionals.