Assessing the Value of Research in the Chemical Sciences


Book Description

This book captures the messages from a workshop that brought together research managers from government, industry, and academia to review and discuss the mechanisms that have been proposed or used to assess the value of chemical research. The workshop focused on the assessment procedures that have been or will be established within the various organizations that carry out or fund research activities, with particular attention to the Government Performance and Results Act (GPRA). The book presents approaches and ideas from leaders in each area that were intended to identify new and useful ways of assessing the value and potential impact of research activities.




Understanding and Evaluating Research


Book Description

Understanding and Evaluating Research: A Critical Guide shows students how to be critical consumers of research and to appreciate the power of methodology as it shapes the research question, the use of theory in the study, the methods used, and how the outcomes are reported. The book starts with what it means to be a critical and uncritical reader of research, followed by a detailed chapter on methodology, and then proceeds to a discussion of each component of a research article as it is informed by the methodology. The book encourages readers to select an article from their discipline, learning along the way how to assess each component of the article and come to a judgment of its rigor or quality as a scholarly report.




Assessing Measurement Invariance for Applied Research


Book Description

This user-friendly guide illustrates how to assess measurement invariance using computer programs, statistical methods, and real data.







A Strategy for Assessing Science


Book Description

A Strategy for Assessing Science offers strategic advice on the perennial issue of assessing rates of progress in different scientific fields. It considers available knowledge about how science makes progress and examines a range of decision-making strategies for addressing key science policy concerns. These include avoiding undue conservatism that may arise from the influence of established disciplines; achieving rational, high-quality, accountable, and transparent decision processes; and establishing an appropriate balance of influence between scientific communities and agency science managers. A Strategy for Assessing Science identifies principles for setting priorities and specific recommendations for the context of behavioral and social research on aging.




Finding What Works in Health Care


Book Description

Healthcare decision makers in search of reliable information that compares health interventions increasingly turn to systematic reviews for the best summary of the evidence. Systematic reviews identify, select, assess, and synthesize the findings of similar but separate studies, and can help clarify what is known and not known about the potential benefits and harms of drugs, devices, and other healthcare services. Systematic reviews can be helpful for clinicians who want to integrate research findings into their daily practices, for patients to make well-informed choices about their own care, for professional medical societies and other organizations that develop clinical practice guidelines. Too often systematic reviews are of uncertain or poor quality. There are no universally accepted standards for developing systematic reviews leading to variability in how conflicts of interest and biases are handled, how evidence is appraised, and the overall scientific rigor of the process. In Finding What Works in Health Care the Institute of Medicine (IOM) recommends 21 standards for developing high-quality systematic reviews of comparative effectiveness research. The standards address the entire systematic review process from the initial steps of formulating the topic and building the review team to producing a detailed final report that synthesizes what the evidence shows and where knowledge gaps remain. Finding What Works in Health Care also proposes a framework for improving the quality of the science underpinning systematic reviews. This book will serve as a vital resource for both sponsors and producers of systematic reviews of comparative effectiveness research.




Assessing Research-Doctorate Programs


Book Description

How should we assess and present information about the quality of research-doctorate programs? In recommending that the 1995 NRC rankings in Assessing the Quality of Research-Doctorate Programs: Continuity and Change be updated as soon as possible, this study presents an improved approach to doctoral program assessment which will be useful to administrators, faculty, and others with an interest in improving the education of Ph.D.s in the United States. It reviews the methodology of the 1995 NRC rankings and recommends changes, including the collection of new data about Ph.D. students, additional data about faculty, and new techniques to present data on the qualitative assessment of doctoral program reputation. It also recommends revision of the taxonomy of fields from that used in the 1995 rankings.




Assessing the Quality of Survey Data


Book Description

This is a book for any researcher using any kind of survey data. It introduces the latest methods of assessing the quality and validity of such data by providing new ways of interpreting variation and measuring error. By practically and accessibly demonstrating these techniques, especially those derived from Multiple Correspondence Analysis, the authors develop screening procedures to search for variation in observed responses that do not correspond with actual differences between respondents. Using well-known international data sets, the authors exemplify how to detect all manner of non-substantive variation having sources such as a variety of response styles including acquiescence, respondents′ failure to understand questions, inadequate field work standards, interview fatigue, and even the manufacture of (partly) faked interviews.




Assessing 21st Century Skills


Book Description

The routine jobs of yesterday are being replaced by technology and/or shipped off-shore. In their place, job categories that require knowledge management, abstract reasoning, and personal services seem to be growing. The modern workplace requires workers to have broad cognitive and affective skills. Often referred to as "21st century skills," these skills include being able to solve complex problems, to think critically about tasks, to effectively communicate with people from a variety of different cultures and using a variety of different techniques, to work in collaboration with others, to adapt to rapidly changing environments and conditions for performing tasks, to effectively manage one's work, and to acquire new skills and information on one's own. The National Research Council (NRC) has convened two prior workshops on the topic of 21st century skills. The first, held in 2007, was designed to examine research on the skills required for the 21st century workplace and the extent to which they are meaningfully different from earlier eras and require corresponding changes in educational experiences. The second workshop, held in 2009, was designed to explore demand for these types of skills, consider intersections between science education reform goals and 21st century skills, examine models of high-quality science instruction that may develop the skills, and consider science teacher readiness for 21st century skills. The third workshop was intended to delve more deeply into the topic of assessment. The goal for this workshop was to capitalize on the prior efforts and explore strategies for assessing the five skills identified earlier. The Committee on the Assessment of 21st Century Skills was asked to organize a workshop that reviewed the assessments and related research for each of the five skills identified at the previous workshops, with special attention to recent developments in technology-enabled assessment of critical thinking and problem-solving skills. In designing the workshop, the committee collapsed the five skills into three broad clusters as shown below: Cognitive skills: nonroutine problem solving, critical thinking, systems thinking Interpersonal skills: complex communication, social skills, team-work, cultural sensitivity, dealing with diversity Intrapersonal skills: self-management, time management, self-development, self-regulation, adaptability, executive functioning Assessing 21st Century Skills provides an integrated summary of the presentations and discussions from both parts of the third workshop.




Assessing Quality in Applied and Practice-based Research in Education


Book Description

This book explores the challenges of assessing quality in applied and practice-based research in education. It offers various views on quality in applied and practice-based research and proposes ways in which qualitycriteria may reflect more closely the diversity of applied research and its complex entanglements with practice and policy.