Assessing Research


Book Description

The Research Assessment Exercise is used to assess the quality of, and determine core government funding for, research carried out in UK universities. In 2002 this process was reviewed (http://www.ra-review.ac.uk). This report provided evidence for the review; it describes workshops that investigated the academic community's views of research quality and attitudes towards models of assessment. Nine facilitated workshops were held in December 2002, which involved 142 academics and research managers from throughout the UK. The report outlines the recurring themes and issues raised by the participants. Key findings were that the overwhelming majority of participants thought research should be assessed using a system based on peer review; that there was a strong desire for a system with clear rules and transparent procedures; and that there was a need for improved systems to assess inter- and multi-disciplinary research work.




Assessing Research: The Researchers' View


Book Description

This report, prepared for and funded by the Joint Funding Bodies' Review of Research Assessment, presents findings from a series of nine facilitated workshops held with academics and research managers across the United Kingdom (UK) in December 2002. The objective of the workshops was to investigate views of research quality and attitudes towards different models of research assessment. The report outlines the recurring themes and issues raised by the 142 participants in the workshops. The participants, academics and research managers, represented over one third of the 173 institutions that submitted to the Research Assessment Exercise in 2001. This report will be of interest to those concerned with research assessment and evaluation in academic research, both practitioners and policy makers. In the first workshop task, participants considered the characteristics of high quality research and how it should be assessed. In the second task, participants discussed the strengths and weaknesses of four approaches to research assessment: Expert Review, Algorithms, Historical Ratings, and Self Assessment. In the remaining two tasks, participants were asked to design their ideal assessment system, basing it on one of the approaches examined in Task 2. They then considered how their system would be implemented, what its weak points might be, and how its use would change research culture in UK higher education. The overwhelming majority of the workshop participants felt that research should be assessed using a system based on peer review by subject-based panels. Of the 29 systems designed, 25 were based on Expert Review. The participants also indicated that these panels should be informed by metrics and self-assessment, with some input from research users. The first volume of this report describes the methodology and details the findings of the workshops. The second volume contains additional source data. (66 tables, 1 figure).




Assessing Research


Book Description

The Research Assessment Exercise was reviewed in 2002. This seminar report concluded that research should be assessed using a system based on peer review; the system should have clear rules and transparent procedures; and that there was a need for improved systems to assess inter- and multi-disciplinary research work.




Finding What Works in Health Care


Book Description

Healthcare decision makers in search of reliable information that compares health interventions increasingly turn to systematic reviews for the best summary of the evidence. Systematic reviews identify, select, assess, and synthesize the findings of similar but separate studies, and can help clarify what is known and not known about the potential benefits and harms of drugs, devices, and other healthcare services. Systematic reviews can be helpful for clinicians who want to integrate research findings into their daily practices, for patients to make well-informed choices about their own care, for professional medical societies and other organizations that develop clinical practice guidelines. Too often systematic reviews are of uncertain or poor quality. There are no universally accepted standards for developing systematic reviews leading to variability in how conflicts of interest and biases are handled, how evidence is appraised, and the overall scientific rigor of the process. In Finding What Works in Health Care the Institute of Medicine (IOM) recommends 21 standards for developing high-quality systematic reviews of comparative effectiveness research. The standards address the entire systematic review process from the initial steps of formulating the topic and building the review team to producing a detailed final report that synthesizes what the evidence shows and where knowledge gaps remain. Finding What Works in Health Care also proposes a framework for improving the quality of the science underpinning systematic reviews. This book will serve as a vital resource for both sponsors and producers of systematic reviews of comparative effectiveness research.




Evaluating and Valuing in Social Research


Book Description

Much applied research takes place as if complex social problems--and evaluations of interventions to address them--can be dealt with in a purely technical way. In contrast, this groundbreaking book offers an alternative approach that incorporates sustained, systematic reflection about researchers' values, what values research promotes, how decisions about what to value are made and by whom, and how judging the value of social interventions takes place. The authors offer practical and conceptual guidance to help researchers engage meaningfully with value conflicts and refine their capacity to engage in deliberative argumentation. Pedagogical features include a detailed evaluation case, "Bridge to Practice" exercises and annotated resources in most chapters, and an end-of-book glossary.




Social Science Research


Book Description

This book is designed to introduce doctoral and graduate students to the process of conducting scientific research in the social sciences, business, education, public health, and related disciplines. It is a one-stop, comprehensive, and compact source for foundational concepts in behavioral research, and can serve as a stand-alone text or as a supplement to research readings in any doctoral seminar or research methods class. This book is currently used as a research text at universities on six continents and will shortly be available in nine different languages.




The Critical Assessment of Research


Book Description

This book examines the following factors: sponsorship of research, control of the dissemination of research, effects of dominant research paradigms, financial interests of authors, publishers, and editors, role of new technologies (for example, Web 2.0).It is widely accepted among researchers and educators that the peer review process, the reputation of the publisher and examination of the author's credentials are the gold standards for assessing the quality of research and information. However, the traditional gold standards are not sufficient, and the effective evaluation of information requires the consideration of additional factors. Controversies about positive evaluations of new medications that appear in peer-reviewed journals, the financial reports on Enron prior to the revelations that led to its collapse, and obstacles to the publication of research that does not conform to dominant paradigms are just a few examples that indicate the need for a more sophisticated and nuanced approach to evaluating information.Each of the factors is discussed in a factual manner, supported by many examples that illustrate not only the nature of the issues but also their complexity. Practical suggestions for the evaluation of information are an integral part of the text. - Highlights frequently overlooked criteria for evaluating research - Challenges the assumption that the gold standards for evaluation are sufficient - Examines the role of new technologies in evaluating and disseminating research




Achieving Impact in Research


Book Description

This unique addition to the Success in Research series addresses the importance of understanding and achieving impact for the purposes of gaining research funding and reporting achieved impact for the Research Excellence Framework (REF). The book includes contributions from researchers and researcher developers who feel that impact is ill-defined and poorly understood despite its prevalence in policy documents, websites and institutional activities. This succinct and cohesive text draws on the expert contributors′ collective research practice, knowledge and experience. Using a variety of examples, boxed activities and highlighted reflection points, this practical guide covers the following key areas: The meaning of impact in relation to research How the Impact Agenda fits with attitudes and ethics that motivate research The different characterisations of research impact and when impact is apparent How impact can be planned into proposals, evaluated and evidenced The skills needed to be an impactful researcher How impact can be supported through Knowledge Exchange and effective partnerships This is a must-have guide for anyone seeking to understand and achieve impact in their own research. The Success in Research series, from Cindy Becker and Pam Denicolo, provides short, authoritative and accessible guides on key areas of professional and research development. Avoiding jargon and cutting to the chase of what you really need to know, these practical and supportive books cover a range of areas from presenting research to achieving impact, and from publishing journal articles to developing proposals. They are essential reading for any student or researcher interested in developing their skills and broadening their professional and methodological knowledge in an academic context.







Quality


Book Description

This book offers a comprehensive overview of quality and quality management. It also explores total quality management, covering its human, technological and analytical imperatives. It also examines quality systems and system standards, highlighting essential features and avoiding a reproduction of the ISO 9000 standard, as well as people-related issues in implementing a quality system. A holistic understanding of quality considerations, which now permeate every aspect of human life, should guide related policies, plans and practices. The book describes the all-pervasive characteristics of quality, putting together diverse definitions of "quality," outlining its different dimensions, and linking it with reliability and innovation. It goes on to assess the quality of measurements in terms of precision, accuracy and uncertainty and discusses managing quality with a focus on business performance. This is followed by a chapter on improving process quality, which is the summum bonum of quality management, and a chapter addressing the crucial problem of measuring customer satisfaction through appropriate models and tools. Further, it covers non-traditional subjects such as quality of life, quality of working life, quality assurance and improvement in education, with special reference to higher education, quality in research and development and characterizes the quality-related policies and practices in Indian industry. The last chapter provides a broad sketch of some recent advances in statistical methods for quality management. Along with the research community, the book’s content is also useful for practitioners and industry watchers.