Assessing Research: The Researchers' View


Book Description

This report, prepared for and funded by the Joint Funding Bodies' Review of Research Assessment, presents findings from a series of nine facilitated workshops held with academics and research managers across the United Kingdom (UK) in December 2002. The objective of the workshops was to investigate views of research quality and attitudes towards different models of research assessment. The report outlines the recurring themes and issues raised by the 142 participants in the workshops. The participants, academics and research managers, represented over one third of the 173 institutions that submitted to the Research Assessment Exercise in 2001. This report will be of interest to those concerned with research assessment and evaluation in academic research, both practitioners and policy makers. In the first workshop task, participants considered the characteristics of high quality research and how it should be assessed. In the second task, participants discussed the strengths and weaknesses of four approaches to research assessment: Expert Review, Algorithms, Historical Ratings, and Self Assessment. In the remaining two tasks, participants were asked to design their ideal assessment system, basing it on one of the approaches examined in Task 2. They then considered how their system would be implemented, what its weak points might be, and how its use would change research culture in UK higher education. The overwhelming majority of the workshop participants felt that research should be assessed using a system based on peer review by subject-based panels. Of the 29 systems designed, 25 were based on Expert Review. The participants also indicated that these panels should be informed by metrics and self-assessment, with some input from research users. The first volume of this report describes the methodology and details the findings of the workshops. The second volume contains additional source data. (66 tables, 1 figure).




Assessing Research: The Researchers' View, Volume 2


Book Description

This report, prepared for and funded by the Joint Funding Bodies' Review of Research Assessment, presents findings from a series of nine facilitated workshops held with academics and research managers across the United Kingdom (UK) in December 2002. The objective of the workshops was to investigate views of research quality and attitudes towards different models of research assessment. The report outlines the recurring themes and issues raised by the 142 participants in the workshops. The participants, academics and research managers, represented over one third of the 173 institutions that submitted to the Research Assessment Exercise in 2001. This report will be of interest to those concerned with research assessment and evaluation in academic research, both practitioners and policy makers. In the first workshop task, participants considered the characteristics of high quality research and how it should be assessed. In the second task, participants discussed the strengths and weaknesses of four approaches to research assessment: Expert Review, Algorithms, Historical Ratings, and Self Assessment. In the remaining two tasks, participants were asked to design their ideal assessment system, basing it on one of the approaches examined in Task 2. They then considered how their system would be implemented, what its weak points might be, and how its use would change research culture in UK higher education. The overwhelming majority of the workshop participants felt that research should be assessed using a system based on peer review by subject-based panels. Of the 29 systems designed, 25 were based on Expert Review. The participants also indicated that these panels should be informed by metrics and self-assessment, with some input from research users. The first volume of this report describes the methodology and details the findings of the workshops. The second volume contains additional source data. (66 tables, 1 figure).







Best Practices in Assessment of Research and Development Organizations


Book Description

Research and development (R&D) organizations are operated by government, business, academe, and independent institutes. The success of their parent organizations is closely tied to the success of these R&D organizations. In this report, organizations refers to an organization that performs research and/or development activities (often a laboratory), and parent refers to the superordinate organization of which the R&D organization is a part. When the organization under discussion is formally labeled a laboratory, it is referred to as such. The question arises: How does one know whether an organization and its programs are achieving excellence in the best interests of its parent? Does the organization have an appropriate research staff, facilities, and equipment? Is it doing the right things at high levels of quality, relevance, and timeliness? Does it lead to successful new concepts, products, or processes that support the interests of its parent? This report offers assessment guidelines for senior management of organizations and of their parents. The report lists the major principles of assessment, noting that details will vary from one organization to another. It provides sufficient information to inform the design of assessments, but it does not prescribe precisely how to perform them, because different techniques are needed for different types of organizations. Best Practices in Assessment of Research and Development Organizations covers three key factors that underpin the success of an R&D organization: (1) the mission of the organization and its alignment with that of the parents; (2) the relevance and impact of the organization's work; and (3) the resources provided to the organization, beginning with a high-quality staff and management.




Assessing Research


Book Description

The Research Assessment Exercise was reviewed in 2002. This seminar report concluded that research should be assessed using a system based on peer review; the system should have clear rules and transparent procedures; and that there was a need for improved systems to assess inter- and multi-disciplinary research work.







Prometheus Assessed?


Book Description

This book examines the problems, pitfalls and opportunities of different models of assessing research quality, drawing on studies from around the world. Aimed at academics, education officials and public servants, key features include an overview of the argument of whether research should be assessed and how research quality should be determined. Prometheus Assessed? offers a survey of research assessment models in the US, UK, Japan and New Zealand and includes an examination of citation analysis and comparison between the different models. Should research be assessed and what is research quality? Survey of research assessment models in US, UK, Japan and New Zealand Examination of citation analysis




Reshaping the University


Book Description

The global economic crisis has required governments across the globe to reconsider their spending priorities. It is within this demanding economic context that higher education systems have been steadily restructured with in many ways the English model in the vanguard of change. This book focuses in particular upon the policy of removing almost entirely public support for the payment of student fees. This has emerged from a steady process of change, which has broad political support and is underwritten by the idea that higher education is now seen more as a private than a public, good. As this shift has occurred (not a new innovation but rather a return to what once prevailed as more of a market in English higher education) so the relationship between government and the higher education has evolved with the latter now attempting to steer the development of the system through a state-regulated market. The book has a strong comparative dimension that draws upon US higher education to illustrate both the possible advantages and potential hazards to the marketization strategy. It concludes that any such strategy needs to be accompanied by state regulation if it is to function effectively, particularly to stimulate price competition, encourage innovation from new entrants, and provide consumer protection for students paying high fees.