Scrutinizing Science


Book Description




Reproducibility and Replicability in Science


Book Description

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.




Testing Scientific Theories


Book Description

Testing Scientific Theories was first published in 1984. Minnesota Archive Editions uses digital technology to make long-unavailable books once again accessible, and are published unaltered from the original University of Minnesota Press editions. Since much of a scientist's work consists of constructing arguments to show how experiments and observation bear on a particular theory, the methodologies of theory testing and their philosophical underpinnings are of vital concern to philosophers of science. Confirmation of scientific theories is the topic of Clark Glymour's important book Theory and Evidence,published in 1980. His negative thesis is that the two most widely discussed accounts of the methodology of theory testing - hypothetico-deductivism and Bayesianism - are flawed. The issues Glymour raises and his alternative "bootstrapping" method provided the focus for a conference sponsored by the Minnesota Center for Philosophy of Science and for this book. As editor John Earman says in his preface, the papers presented in Testing Scientific Theories germinate so many new ideas that philosophers of science will reap the harvest for years to come. Topics covered include a discussion of Glymour's bootstrapping theory of confirmation, the Bayesian perspective and the problems of old evidence, evidence and explanation, historical case studies, alternative views on testing theories, and testing particular theories, including psychoanalytic hypotheses and hypotheses about the completeness of the fossil record.




Scientific Research in Education


Book Description

Researchers, historians, and philosophers of science have debated the nature of scientific research in education for more than 100 years. Recent enthusiasm for "evidence-based" policy and practice in educationâ€"now codified in the federal law that authorizes the bulk of elementary and secondary education programsâ€"have brought a new sense of urgency to understanding the ways in which the basic tenets of science manifest in the study of teaching, learning, and schooling. Scientific Research in Education describes the similarities and differences between scientific inquiry in education and scientific inquiry in other fields and disciplines and provides a number of examples to illustrate these ideas. Its main argument is that all scientific endeavors share a common set of principles, and that each fieldâ€"including education researchâ€"develops a specialization that accounts for the particulars of what is being studied. The book also provides suggestions for how the federal government can best support high-quality scientific research in education.




The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry


Book Description

Offering a variety of innovative methods and tools, this book provides a comprehensive and up-to-date presentation on multi and mixed methods research.




Case Studies and Theory Development in the Social Sciences


Book Description

The use of case studies to build and test theories in political science and the other social sciences has increased in recent years. Many scholars have argued that the social sciences rely too heavily on quantitative research and formal models and have attempted to develop and refine rigorous methods for using case studies. This text presents a comprehensive analysis of research methods using case studies and examines the place of case studies in social science methodology. It argues that case studies, statistical methods, and formal models are complementary rather than competitive. The book explains how to design case study research that will produce results useful to policymakers and emphasizes the importance of developing policy-relevant theories. It offers three major contributions to case study methodology: an emphasis on the importance of within-case analysis, a detailed discussion of process tracing, and development of the concept of typological theories. Case Studies and Theory Development in the Social Sciences will be particularly useful to graduate students and scholars in social science methodology and the philosophy of science, as well as to those designing new research projects, and will contribute greatly to the broader debate about scientific methods.




The Structure of Scientific Theories


Book Description

''A clear and comprehensive introduction to contemporary philosophy of science.'' -- American Scientist ''The best account of scientific theory now available, one that surely commends itself to every philosopher of science with the slightest interest in metaphysics.'' -- Review of Mathematics ''It should certainly be of interest to those teaching graduate courses in philosophy of science and to scientists wishing to gain a further appreciation of the approach used by philosophers of science.'' -- Science Activities




Statistical Inference as Severe Testing


Book Description

Mounting failures of replication in social and biological sciences give a new urgency to critically appraising proposed reforms. This book pulls back the cover on disagreements between experts charged with restoring integrity to science. It denies two pervasive views of the role of probability in inference: to assign degrees of belief, and to control error rates in a long run. If statistical consumers are unaware of assumptions behind rival evidence reforms, they can't scrutinize the consequences that affect them (in personalized medicine, psychology, etc.). The book sets sail with a simple tool: if little has been done to rule out flaws in inferring a claim, then it has not passed a severe test. Many methods advocated by data experts do not stand up to severe scrutiny and are in tension with successful strategies for blocking or accounting for cherry picking and selective reporting. Through a series of excursions and exhibits, the philosophy and history of inductive inference come alive. Philosophical tools are put to work to solve problems about science and pseudoscience, induction and falsification.




Social Science Research


Book Description

This book is designed to introduce doctoral and graduate students to the process of conducting scientific research in the social sciences, business, education, public health, and related disciplines. It is a one-stop, comprehensive, and compact source for foundational concepts in behavioral research, and can serve as a stand-alone text or as a supplement to research readings in any doctoral seminar or research methods class. This book is currently used as a research text at universities on six continents and will shortly be available in nine different languages.




Concepts of Biology


Book Description

Black & white print. Concepts of Biology is designed for the typical introductory biology course for nonmajors, covering standard scope and sequence requirements. The text includes interesting applications and conveys the major themes of biology, with content that is meaningful and easy to understand. The book is designed to demonstrate biology concepts and to promote scientific literacy.