Evaluating Country Programmes


Book Description

In 2003 the evaluation unit of the Austrian Development Cooperation (ADC) chose the Mozambique country programme as the first country programme to undergo an evaluation as a whole. This delicate process was assigned to L&R Institute for Social Research (Vienna). The country programme was assessed according to the following criteria: relevance, coherence, flexibility, effectiveness, impact, efficiency, sustainability, visibility and ownership.Through this assessment it not only became clear that there is a growing interest in country programme evaluations and the issues raised within this study, but that the entire medium of country programming and evaluation is rapidly changing.




Impact Evaluation in Practice, Second Edition


Book Description

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.




Evaluation and Aid Effectiveness No 2 - Evaluating Country Programmes Vienna Workshop, 1999


Book Description

Evaluation is a key tool in improving the quality and effectiveness of development co-operation. The Development Assistance Committee (DAC) Working Party in Aid Evaluation is the only international forum where bilateral and multilateral evaluation ...




Evaluation of FAO’s country programme in Armenia 2016-2020


Book Description

Armenia’s agriculture represents the main economic source in rural areas and significantly contributes to the country’s GDP, employing about 30 percent of the working population. Aligned with Armenia’s national development priorities, FAO's programme has been well aligned with national priorities focusing on provision of highly specialized technical expertise towards the development of national policies, institutions, and also offering innovative approaches and solutions. The evaluation concluded that FAO should continue offering its advisory services and technical support in thematic areas within its competence, focusing on longer term sustainability of results achieved and taking into consideration vulnerability of food and agriculture systems to climate change. The Country Office needs to expand its support in areas where FAO has clear comparative advantages, and respond to the new demands in the context of the upcoming United Nations Sustainable Development Cooperation Framework Guidance (UNSDCF) for the period 2021-2025.




Evaluation of FAO’s country programme in Ethiopia 2014-2019


Book Description

Ethiopia is a low-income country and agriculture is the mainstay of the economy, accounting for for 34 percent of GDP and 70 percent of total employment share. Ethiopia remains one of the world’s poorest countries, despite the significant progress achieved in reducing poverty and hunger. The Government of Ethiopia through its Growth and Transformation Plan (GTP II) has consistently prioritized the transformation of agriculture from low-input, subsistence-oriented production systems to a fast-growing, intensive and commercially oriented sector to support the country’s aspirations to become a middle-income country by 2025. FAO’s Country Programme Framework (2016-2020), was formulated based on the GTP II. Over the evaluation period (2014-2019), FAO exceeded the resource mobilization targets. Overall, FAO’s programme displays several imbalances and disconnects, specifically between development activities and emergency response. The evaluation calls for FAO to adopt a more cohesive programmatic approach and continue to consolidate its fragmented programme. In the context of the Government’s plans for agricultural transformation, the evaluation also recommends that FAO support an economically sound value chain and market-based approach to agricultural development, while upholding normative values of inclusiveness and ecological sustainability.




Evaluation of FAO’s country programme in Sierra Leone 2012–2019


Book Description

The agriculture sector in Sierra Leone accounts for 60 percent of GDP and 58 percent of total employment. More than 58 percent of the country’s population live in rural areas and 86.1 percent of this population are engaged in smallholder subsistence agricultural production. Ten years of civil conflict and the Ebola epidemic in 2014 negatively affected food security and the country’s overall socio-economic situation. The country is particularly vulnerable to extreme events such as food chain crises and natural hazards which have a direct impact on food security and livelihoods. This evaluation aims to identify lessons learned and provide strategic recommendations on how FAO programmes can be better oriented in Sierra Leone. FAO’s overall contribution to developmental challenges was assessed in the priority areas defined in the CPFs covering 2012–16 and 2017–19. The evaluation comprised an examination of associated outcome areas related to support to smallholder commercialization, natural resources management, and effective response to disasters and increasing social productivity and resilience. The review also evaluated crosscutting issues, including gender equality and women’s empowerment, climate resilience, nutrition, capacity development and youth employment.The evaluation used different methods to collect the views of the beneficiaries and other stakeholders, such as structured focus group discussions, structured key informant interviews, direct observation, and workshops. The fieldwork took place with actors from projects across five districts: Bo, Bombali, Kenema, Kono, and Port Loko.The evaluation found evidence of significant and sustainable results in a range of areas of FAO’s activities, including policy-related work, from adoption of legislation to policy influence, piloting of approaches, and standards and regulatory frameworks. Likewise, results leading to livelihoods improvements, empowerment and adoption of more sustainable organizational practices, technologies and skills were found. Nevertheless, the programme failed to aggregate activities and interventions in a programmatic and coherent portfolio. FAOs capacity to deliver sustainable and consistent results, with strong partnerships and complementary action, was often undermined by lack of, or weak systems and functions. FAO should use the development of the new CPF as a way to re-design its strategic footprint in the country and reach its full potential, despite the limiting factors. To do this, FAO could consider adopting an area-based approach, implementing a programmatic, multi-stakeholder and cross sectoral adaptive approach based on regions/districts.




The Land Governance Assessment Framework


Book Description

Increased global demand for land posits the need for well-designed country-level land policies to protect long-held rights, facilitate land access and address any constraints that land policy may pose for broader growth. While the implementation of land reforms can be a lengthy process, the need to swiftly identify key land policy challenges and devise responses that allow the monitoring of progress, in a way that minimizes conflicts and supports broader development goals, is clear. The Land Governance Assessment Framework (LGAF) makes a substantive contribution to the land sector by providing a quick and innovative tool to monitor land governance at the country level. The LGAF offers a comprehensive diagnostic tool that covers five main areas for policy intervention: Legal and institutional framework; Land use planning, management and taxation; Management of public land; Public provision of land information; and Dispute resolution and conflict management. The LGAF assesses these areas through a set of detailed indicators that are rated on a scale of pre-coded statements (from lack of good governance to good practice). While land governance can be highly technical in nature and tends to be addressed in a partial and sporadic manner, the LGAF posits a tool for a comprehensive assessment, taking into account the broad range of issues that land governance encompasses, while enabling those unfamiliar with land to grasp its full complexity. The LGAF will make it possible for policymakers to make sense of the technical levels of the land sector, benchmark governance, identify areas that require further attention and monitor progress. It is intended to assist countries in prioritizing reforms in the land sector by providing a holistic diagnostic review that can inform policy dialogue in a clear and targeted manner. In addition to presenting the LGAF tool, this book includes detailed case studies on its implementation in five selected countries: Peru, the Kyrgyz Republic, Ethiopia, Indonesia and Tanzania.




Economic Evaluation in Education


Book Description

The past decade has seen increased attention to cost-effectiveness and benefit-cost analysis in education as administrators are being asked to accomplish more with the same or even fewer resources, philanthropists are keen to calculate their "return on investment" in social programs, and the general public is increasingly scrutinizing how resources are allocated to schools and colleges. Economic Evaluation in Education: Cost-Effectiveness and Benefit-Cost Analysis (titled Cost-Effectiveness Analysis: Methods and Applications in its previous editions) is the only full-length book to provide readers with the step-by-step methods they need to plan and implement a benefit-cost analysis in education. Authors Henry M. Levin, Patrick J. McEwan, Clive Belfield, Alyshia Brooks Bowden, and Robert Shand examine a range of issues, including how to identify, measure, and distribute costs; how to measure effectiveness, utility, and benefits; and how to incorporate cost evaluations into the decision-making process. The updates to the Third Edition reflect the considerable methodological development in the evaluation literature, and the greater empiricism practiced by education researchers, to help readers learn to apply more advanced methods to their own analyses.




Applying Evaluation Criteria Thoughtfully


Book Description

Relevance, coherence, effectiveness, efficiency, impact, and sustainability are widely used evaluation criteria, particularly in international development co-operation. They help to determine the merit or worth of various interventions, such as strategies, policies, programmes or projects. This guidance aims to help evaluators and others to better understand those criteria, and improve their use.




Knowledge-Based Country Programs


Book Description

The World Bank Group is currently engaged in reflection and debate on how to improve the delivery of development support. Part of this debate concerns strengthening the knowledge agenda. The findings of this evaluation are particularly relevant because they speak directly to questions that the institution is deliberating. In particular, they address four key aspects of the “science of delivery”: the role of local partners or local knowledge hubs; consultation with clients and other stakeholders in the process of designing knowledge services; delivery of knowledge on issues that are relevant to the client; and improving the way the Bank Group learns from upper-middle-income countries and intermediating this knowledge to other countries.The evaluation assesses knowledge-based activities in nine country programs selected from 48 knowledge-intensive programs supported by the Bank Group. It identifies the factors in the success or failure of those activities as they contribute to policy making or development outcomes. It also identifies areas of strength for the Bank Group as well as areas of weakness or risk. The main objective of the evaluation is to learn lessons from practices in a focus group of high-income and upper-middle-income countries that have knowledge-based programs with the Bank Group. The findings have implications for the Bank Group’s knowledge work, including governance and incentives.Over the past 15 years, Bank Group country programs have shifted toward more intensive delivery of knowledge services relative to lending, and this trend is expected to continue. The evaluation was done on economic and sector work and non-lending technical assistance activities selected from a purposive sample of knowledge-intensive country programs. In addition, the evaluation assessed International Finance Corporation Advisory Services for their synergy with the Bank’s analytical and advisory activities. The lessons from this evaluation could help leverage the Bank Group’s global knowledge to meet the needs of countries that mainly rely on knowledge services and are not pressed for financing.