Evaluation and Performance Measurement of Research and Development


Book Description

This book develops and illustrates a comprehensive, multi-level framework for the evaluation of industrial research and development (R&D) activities and the measurement of their performance. The framework encompasses a set of hierarchical, interrelated levels at which R&D evaluation and performance measurement could be undertaken. This enlightening book focuses on the single industrial firm to study performance measurement of R&D functions, projects and individual researchers or engineers. It also addresses R&D evaluation from the point of view of financial markets, with a focus on the relationship between R&D investments and the value of the traded firm. The book broadens tin scope to study the role of technology platforms as R&D coordination mechanisms and also looks at the evaluation of R&D policies. This book will be warmly welcomed by researchers and postgraduate students in disciplines concerned with innovation management, technology policy, and finance who wish to gain an updated overview of R&D evaluation and performance measurement as well as exploring different units of analysis.




Program Evaluation and Performance Measurement


Book Description

Program Evaluation and Performance Measurement: An Introduction to Practice, Second Edition offers an accessible, practical introduction to program evaluation and performance measurement for public and non-profit organizations, and has been extensively updated since the first edition. Using examples, it covers topics in a detailed fashion, making it a useful guide for students as well as practitioners who are participating in program evaluations or constructing and implementing performance measurement systems. Authors James C. McDavid, Irene Huse, and Laura R. L. Hawthorn guide readers through conducting quantitative and qualitative program evaluations, needs assessments, cost-benefit and cost-effectiveness analyses, as well as constructing, implementing and using performance measurement systems. The importance of professional judgment is highlighted throughout the book as an intrinsic feature of evaluation practice.




Tactical Display for Soldiers


Book Description

This book examines the human factors issues associated with the development, testing, and implementation of helmet-mounted display technology in the 21st Century Land Warrior System. Because the framework of analysis is soldier performance with the system in the full range of environments and missions, the book discusses both the military context and the characteristics of the infantry soldiers who will use the system. The major issues covered include the positive and negative effects of such a display on the local and global situation awareness of the individual soldier, an analysis of the visual and psychomotor factors associated with each design feature, design considerations for auditory displays, and physical sources of stress and the implications of the display for affecting the soldier's workload. The book proposes an innovative approach to research and testing based on a three-stage strategy that begins in the laboratory, moves to controlled field studies, and culminates in operational testing.







Performance Assessment for the Workplace


Book Description

Although ability testing has been an American preoccupation since the 1920s, comparatively little systematic attention has been paid to understanding and measuring the kinds of human performance that tests are commonly used to predictâ€"such as success at school or work. Now, a sustained, large-scale effort has been made to develop measures that are very close to actual performance on the job. The four military services have carried out an ambitious study, called the Joint-Service Job Performance Measurement/Enlistment Standards (JPM) Project, that brings new sophistication to the measurement of performance in work settings. Volume 1 analyzes the JPM experience in the context of human resource management policy in the military. Beginning with a historical overview of the criterion problem, it looks closely at substantive and methodological issues in criterion research suggested by the project: the development of performance measures; sampling, logistical, and standardization problems; evaluating the reliability and content representativeness of performance measures; and the relationship between predictor scores and performance measuresâ€"valuable information that can also be useful in the civilian workplace.




Organizational Assessment


Book Description

Organizational Assessment: A framework for improving performance




Dealing With Complexity in Development Evaluation


Book Description

Recognizing that complexity calls for innovative, conceptual, and methodological solutions, Dealing with Complexity in Development Evaluation by Michael Bamberger, Jos Vaessen, and Estelle Raimondo offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.




Transforming Performance Measurement


Book Description

Performance improvement thought leader Dean Spitzer explains why performance measurement should be less about calculations and analysis and more about the crucial social factors that determine how well the measurements get used. Transforming Performance Measurement presents a breakthrough approach that will not only significantly reduce those dysfunctions, but also promote alignment with business strategy, maximize cross-enterprise integration, and help everyone to work collaboratively to drive value throughout your organization. Spitzer’s "socialization of measurement" process focuses on learning and improvement from measurement, and on the importance of asking such questions as: How well do our measures reflect our business model? How successfully are they driving our strategy? What should we be measuring and not measuring? Are the right people having the right measurement discussions? Performance measurement is a dynamic process that calls for an awareness of the balance necessary between seemingly disparate ideas: the technical and the social aspects of performance measurement. This book gives you assessment tools to gauge where you are now and a roadmap for moving, with little or no disruption, to a more "transformational" and mature measurement system. The book also provides 34 TMAPs, Transformational Measurement Action Plans, which suggest both well-accepted and "emergent" measures (in areas such as marketing, human resources, customer service, knowledge management, productivity, information technology, research and development, costing, and more) that you can use right away. Transforming Performance Measurement tells you not only what to measure, but how to do it -- and in what context -- to make a truly transformational difference in your enterprise.




A Study Of Performance Measurement In The Outsourcing Decision


Book Description

Outsourcing is a key issue for many organisations having moved from the contracting out of peripheral activities such as cleaning to more critical areas such as design and marketing. This report is for managers and people in finance and accounting functions and takes a practical approach in developing a framework and then applying this framework in an actual organisation which makes it easier for practitioners to understand.• This report provides a framework which incorporates both qualitative and quantitative performance measures that can be used in the outsourcing process• This research is of value to commercial and public sector organisations as well as academics as it provides insights for organisations considering outsourcing that will enable them to assess service levels throughout the contract




Research evaluation metrics


Book Description

Traducción parcial de la Introducción: "En la actualidad, la evaluación de la investigaciones es una cuestión que se está replanteando en todo el mundo. En algunos casos, los trabajos de investigación están generando resultados muy buenos, en la mayoría de los casos los resultados son mediocres, y en algunos casos negativos. Por todo esto, la evaluación de los resultados de la investigación se convierte en una condición sine qua non. Cuando el número de investigadores eran menos, eran los propios colegas de profesión quienes evaluaban la investigación. Con el paso del tiempo, el número de investigadores aumentó, las áreas de investigación proliferaron, los resultados de la investigación se multiplicaron. La tendencia continuó y después de la Segunda Guerra Mundial, la investigación comenzó a crecer exponencialmente. Hoy en día, incluso en una estimación moderada hay alrededor de más de un millón de investigadores y producen más de dos millón de trabajos de investigación y otros documentos por año. En este contexto, la evaluación de la investigación es una cuestión de primera importancia. Para cualquier promoción, acreditación, premio y beca puede haber decenas o cientos de nominados. De entre éstos, seleccionar el mejor candidato es una cuestión difícil de determinar. Las evaluaciones inter pares en muchos casos están demostrando ser subjetivas. En 1963 se crea Science Citation Index (SCI) que cubre la literatura científica desde 1961. Unos años después, Eugene Garfield, fundador del SCI, preparó una lista de los 50 autores científicos más citados basándose en las citas que recibía el trabajo de un autor por parte de los trabajos de otros colegas de investigación. El documento titulado "¿Pueden predecirse los ganadores del Premio Nobel? 'Fue publicado en 1968 (Garfield y Malin, 1968). En el siguiente año es decir, 1969, dos científicos que figuran en la lista, por ejemplo, Derek HR Barton y Murray Gell-Mann recibieron el codiciado premio. Esto reivindicó la utilidad del análisis de citas. Cada año, varios científicos pertenecientes al campo de la Física, Química, Fisiología y Medicina reciben el Premio Nobel. De esta manera el análisis de citas se convirtió en una herramienta útil. Sin embargo, el análisis de citas siempre tuvo críticas y múltiples fallas. Incluso Garfield comentó - "El Uso del análisis de citas de los trabajos de evaluación es una tarea difícil. Existen muchas posibilidades de error '(Garfiled, 1983). Para la evaluación de la investigación, se necesitaban algunos otros indicadores. El análisis de citas, junto con la revisión por pares garantiza el mejor juicio en innumerables casos. Pero se necesita algo que sea más exacto. La llegada de la World Wide Web (WWW) brindó la oportunidad; pues un buen número de indicadores se están generando a partir de los datos disponibles en la WWW". (Trad. Julio Alonso Arévalo. Univ. Salamanca).