Building in an Evaluation Component for Active Labor Market Programs


Book Description

The guide outlines the main evaluation challenges associated with ALMP s, and shows how to obtain rigorous impact estimates using two leading evaluation approaches. The most credible and straightforward evaluation method is a randomized design, in which a group of potential participants is randomly divided into a treatment and a control group. Random assignment ensures that the two groups would have had similar experiences in the post-program period in the absence of the program intervention. The observed post-program difference therefore yields a reliable estimate of the program impact. The second approach is a difference in differences design that compares the change in outcomes between the participant group and a selected comparison group from before to after the completion of the program. In general the outcomes of the comparison group may differ from the outcomes of the participant group, even in the absence of the program intervention. If the difference observed prior to the program would have persisted in the absence of the program, however, then the change in the outcome gap between the two groups yields a reliable estimate of the program impact. This guideline reviews the various steps in the design and implementation of ALMP s, and in subsequent analysis of the program data, that will ensure a rigorous and informative impact evaluation using either of these two techniques. -- active labor market programs ; policy evaluation ; randomized trials ; difference in difference ; average treatment effect on the treated ; development effectiveness.




Evaluating the Labor-market Effects of Social Programs


Book Description

"Jointly sponsored by the Industrial Relations Section and the Office of the Assistant Secretary for Policy, Evaluation and Research of the U.S. Department of Labor." Includes bibliographies.




Impact Evaluation


Book Description







Active Labor Market Policy Evaluations


Book Description

This paper presents a meta-analysis of recent microeconometric evaluations of active labor market policies. Our sample contains 199 separate "program estimates"--Estimates of the impact of a particular program on a specific subgroup of participants - drawn from 97 studies conducted between 1995 and 2007. For about one-half of the sample we have both a short-term program estimate (for a one-year post-program horizon) and a medium- or long-term estimate (for 2 or 3 year horizons). We categorize the estimated post-program impacts as significantly positive, insignificant, or significantly negative. By this criterion we find that job search assistance programs are more likely to yield positive impacts, whereas public sector employment programs are less likely. Classroom and on-the-job training programs yield relatively positive impacts in the medium term, although in the short-term these programs often have insignificant or negative impacts. We also find that the outcome variable used to measure program impact matters. In particular, studies based on registered unemployment are more likely to yield positive program impacts than those based on other outcomes (like employment or earnings). On the other hand, neither the publication status of a study nor the use of a randomized design is related to the sign or significance of the corresponding program estimate. Finally, we use a subset of studies that focus on post-program employment to compare meta-analytic models for the "effect size" of a program estimate with models for the sign and significance of the estimated program effect. We find that the two approaches lead to very similar conclusions about the determinants of program impact.










The Development Dimension Strengthening Accountability in Aid for Trade


Book Description

This book looks at what the trade and development community needs to know about aid-for-trade results, what past evaluations of programmes and projects reveal about trade outcomes and impacts, and how the trade and development community could improve the performance of aid for trade interventions.




Do Active Labor Market Policies Increase Employment?


Book Description

Using panel data for 15 industrial countries, active labor market policies (ALMPs) are shown to have raised employment rates in the business sector in the 1990s, after controlling for many institutions, country-specific effects, and economic variables. Among such policies, direct subsidies to job creation were the most effective. ALMPs also affected employment rates by reducing real wages below levels allowed by technological growth, changes in the unemployment rate, and institutional and other economic factors. However, part of this wage moderation may be linked to a composition effect because policies were targeted to low-paid individuals. Whether ALMPs are cost-effective from a budgetary perspective remains to be determined, but they are certainly not substitutes for comprehensive institutional reforms.