Evaluating Research Efficiency in the U.S. Environmental Protection Agency


Book Description

A new book from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches. Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan. These evaluations require panels of experts. In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures. The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.




Research Handbook on Program Evaluation


Book Description

In the Research Handbook on Program Evaluation, an impressive range of authors take stock of the history and current standing of key issues and debates in the evaluation field. Examining current literature of program evaluation, the Research Handbook assesses the field's status in a post-pandemic and social justice-oriented world, examining today’s theoretical and practical concerns and proposing how they might be resolved by future innovations. This title contains one or more Open Access chapters.




Handbook on the Theory and Practice of Program Evaluation


Book Description

'The economic crisis has simultaneously placed a strong emphasis on the role of R&D as an engine of economic growth and a demand that limited public resources are demonstrated to have had the maximum possible impact. Rigorous evaluation is the key to meeting these needs. This Handbook brings together highly experienced leaders in the field to provide a comprehensive and well-organised state-of-the-art overview of the range of methods available. It will prove invaluable to experienced practitioners, students in the field and more widely to those who want to increase their understanding of the complex and pervasive ways in which technological advance contributes to economic and social progress.' – Luke Georghiou, University of Manchester, UK 'Theoretical and empirical research on program evaluation has advanced rapidly in scope and quality. A concomitant trend is increasing pressure on policymakers to show that programs are "effective". Now is the time for a comprehensive status report on state-of-the-art research and methods by leading scholars in a variety of disciplines on program evaluation. This outstanding collection of contributions will serve as a valuable reference tool for academics, policymakers, and practitioners for many years to come.' – Donald S. Siegel, University at Albany, SUNY, US There has been a dramatic increase in expenditures on public goods over the past thirty years, particularly in the area of research and development. As governments explore the many opportunities for growth in this area, they – and the general public – are becoming increasingly concerned with the transparency, accountability and performance of public programs. This pioneering Handbook offers a collection of critical essays on the theory and practice of program evaluation, written by some of the most well-known experts in the field. As this volume demonstrates, a wide variety of methodologies exist to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question. Scholars, practitioners and students with an interest in economics and innovation will all find this Handbook an invaluable resource.




EPA's Office of Research and Development Performance Measures Need Improvement


Book Description

The U.S. Environmental Protection Agency (EPA) relies on sound science to safeguard human health and the environment. As the scientific research arm of the Agency, EPA's Office of Research and Development (ORD) conducts research on ways to prevent pollution, protect human health, and reduce risk. Twelve ORD national research programs provide the science to support EPA's goals in its strategic plan. We conducted this evaluation to determine whether one of ORD's research programs, the Land Research Program (LRP), has appropriate performance measures for assessing the effectiveness of its research products.