Essays on Contemporary Psychometrics


Book Description

This book 'Essays on Contemporary Psychometrics' provides an overview of contemporary psychometrics, the science devoted to the advancement of quantitative measurement practices in psychology, education and the social sciences. The volume consists of four parts, each having several chapters on cutting-edge work in the field. Part I, General Perspectives on Psychometrics, includes expert views on topics such as psychological models vs. measurement models, using tests in decision making, artificial intelligence, and psychometric network models. Part II, Factor Analysis and Classical Test Theory, the type of psychometrics that is still used most often in the social and behavioral sciences, includes state-of-the-art contributions on test-score reliability, change-score reliability, handling missing data in principal component analysis, test equating, and conditional standard errors of measurement. Part III, Item Response Theory, the leading form of psychometrics in modern educational measurement, includes discussions of sampling from many conditional distributions, transparent score reporting, nonparametric item response theory, and targeted testing. Part IV, New Psychometrics, discusses recently developed ideas beyond classical test theory and item response theory, including topics related to computer adaptive testing, response-time modelling, validity indices, diagnostic classification models, and the sparse latent class model for ordinal measurements. Together, these four parts provide an overview of the current state-of-the-art in psychometrics in educational measurement. They are a valuable source of information for graduate students who (intend to) study psychometrics and need an overview of the field, and for researchers interested in the current developments in the field. Chapters [3], [5], [8], [16] and [19] are available open access under a Creative Commons Attribution 4.0 International License via link.springer.com.




Contemporary Psychometrics


Book Description

Contemporary Psychometrics features cutting edge chapters organized in four sections: test theory, factor analysis, structural equation modeling, and multivariate analysis. The section on test theory includes topics such as multidimensional item response theory (IRT), the relationship between IRT and factor analysis, estimation and testing of these models, and basic measurement issues that are often neglected. The factor analysis section reviews the history and development of the model, factorial invariance and factor analysis indeterminacy, and Bayesian inference for factor scores and parameter estimates. The section on structural equation modeling (SEM) includes the general algebraic-graphic rules for latent variable SEM, a survey of goodness of fit assessment, SEM resampling methods, a discussion of how to compare correlations between and within independent samples, dynamic factor models based on ARMA time series models, and multi-level factor analysis models for continuous and discrete data. The final section on multivariate analysis includes topics such as dual scaling of ordinal data, model specification and missing data problems in time series models, and a discussion of the themes that run through all multivariate methods. This tour de force through contemporary psychometrics will appeal to advanced students and researchers in the social and behavioral sciences and education, as well as methodologists from other disciplines.




Multivariate Statistical Methods


Book Description

Multivariate Statistical Methods: A Primer offers an introduction to multivariate statistical methods in a rigorous yet intuitive way, without an excess of mathematical details. In this fifth edition, all chapters have been revised and updated, with clearer and more direct language than in previous editions, and with more up-to-date examples, exercises, and references, in areas as diverse as biology, environmental sciences, economics, social medicine, and politics. Features • A concise and accessible conceptual approach that requires minimal mathematical background. • Suitable for a wide range of applied statisticians and professionals from the natural and social sciences. • Presents all the key topics for a multivariate statistics course. • The R code in the appendices has been updated, and there is a new appendix introducing programming basics for R. • The data from examples and exercises are available on a companion website. This book continues to be a great starting point for readers looking to become proficient in multivariate statistical methods, but who might not be deeply versed in the language of mathematics. In this edition, we provide readers with conceptual introductions to methods, practical suggestions, new references, and a more extensive collection of R functions and code that will help them to deepen their toolkit of multivariate statistical methods.







Handbook of Automated Essay Evaluation


Book Description

This comprehensive, interdisciplinary handbook reviews the latest methods and technologies used in automated essay evaluation (AEE) methods and technologies. Highlights include the latest in the evaluation of performance-based writing assessments and recent advances in the teaching of writing, language testing, cognitive psychology, and computational linguistics. This greatly expanded follow-up to Automated Essay Scoring reflects the numerous advances that have taken place in the field since 2003 including automated essay scoring and diagnostic feedback. Each chapter features a common structure including an introduction and a conclusion. Ideas for diagnostic and evaluative feedback are sprinkled throughout the book. Highlights of the book’s coverage include: The latest research on automated essay evaluation. Descriptions of the major scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM Engine, c-raterTM, and LightSIDE. Applications of the uses of the technology including a large scale system used in West Virginia. A systematic framework for evaluating research and technological results. Descriptions of AEE methods that can be replicated for languages other than English as seen in the example from China. Chapters from key researchers in the field. The book opens with an introduction to AEEs and a review of the "best practices" of teaching writing along with tips on the use of automated analysis in the classroom. Next the book highlights the capabilities and applications of several scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM engine, c-raterTM, and LightSIDE. Here readers will find an actual application of the use of an AEE in West Virginia, psychometric issues related to AEEs such as validity, reliability, and scaling, and the use of automated scoring to detect reader drift, grammatical errors, discourse coherence quality, and the impact of human rating on AEEs. A review of the cognitive foundations underlying methods used in AEE is also provided. The book concludes with a comparison of the various AEE systems and speculation about the future of the field in light of current educational policy. Ideal for educators, professionals, curriculum specialists, and administrators responsible for developing writing programs or distance learning curricula, those who teach using AEE technologies, policy makers, and researchers in education, writing, psychometrics, cognitive psychology, and computational linguistics, this book also serves as a reference for graduate courses on automated essay evaluation taught in education, computer science, language, linguistics, and cognitive psychology.




Contemporary Second Language Assessment


Book Description

Includes chapters on key aspects of second language assessment such as test construct, diagnosis, exam design, and the growing range of public policy, social and ethical issues. Each of the contributors is an expert in their area; some are established names while others are talented newcomers to the field. The chapters present new research or perspectives on traditional concerns such as test quality; fairness and bias; the testing of different language skills; the needs of different groups of examinees, including English language learners who need to take content tests in English; and the use of language assessments for gate-keeping purposes. The volume demonstrates how language assessment is informed by and engages with neighbouring areas of applied linguistics such as technology and language corpora. The book represents the best of current practice in second language assessment and, as a one volume reference, will be invaluable to students and researchers looking for material that extends their understanding of the field.




A Paul Meehl Reader


Book Description

This new book introduces a new generation to the important insights of Paul Meehl. In addition to selected papers from the classic reader, Psychodiagnosis, this book features new material selected from Meehl's most influential writings. The resulting collection is a tour de force illustrating quantitative analysis of life science problems, an examination of the inadequacy of some methods of analysis, and a review of the application of taxometrics. A Paul Meehl Reader is organized into five content areas: theory building and appraisal - how we discover and test the true causal relations of psychological constructs; specific etiology - an examination of genetic, behavioral, and environmental etiology in psychopathology; diagnosis and prediction - a review of the appropriate use of base rates; taxometrics - a look at Meehl's development of the method he invented; thinking effectively about psychological questions - a critique of correlation research and the power of quantitative thinking in psychology. The Reader features section introductions to orient the reader and provide a context and structure for Paul Meehl's work. The section on diagnosis and prediction features problem sets with solutions to guide the reader through practical applications of the principles described. Accompanying downloadable resources contain footage from Paul Meehl's engaging seminar on clinical versus statistical prediction. This book appeals to advanced students and professionals in psychology, sociology, law, education, human development, and philosophy.




Test Scoring


Book Description

Test Scoring provides a summary of traditional true score test theory and modern item response theory related to scoring tests, as well as novel developments resulting from the integration of these approaches. The background material introduced in the first four chapters builds a foundation for the new developments covered in later chapters. These new methods offer alternative psychometric approaches to scoring complex assessments. Each of the book's contributors draws from the classic literature of traditional test theory, as well as psychometric developments of the past decade. The emphasis is on large-scale educational measurement but the topics and procedures may be applied broadly within many measurement contexts. Numerous graphs and illustrative examples based on real tests and actual data are integrated throughout. This multi-authored volume shows the reader how to combine the coded outcomes on individual test items into a numerical summary about the examinee's performance. This book is intended for researchers and students in education and other social sciences interested in educational assessment and policy, the design and development of tests, and the procedures for test administration and scoring. Prerequisites include an introduction to educational and psychological measurement and basic statistics. Knowledge of differential and integral calculus and matrix algebra is helpful but not required.




Realism and Psychology


Book Description

This volume is a collection of new, published and revised essays, providing a distinctive, thoroughgoing, realist approach to contemporary psychological theories, concepts, methods, and applications. The essays also offer critical analyses of antirealist trends both in and outside of mainstream psychology.




Method Matters in Psychology


Book Description

This book applies a range of ideas about scientific discovery found in contemporary philosophy of science to psychology and related behavioral sciences. In doing so, it aims to advance our understanding of a host of important methodological ideas as they apply to those sciences. A philosophy of local scientific realism is adopted in favor of traditional accounts that are thought to apply to all sciences. As part of this philosophy, the implications of a commitment to philosophical naturalism are spelt out, and a correspondence theory of truth is defended by showing how it helps explain various features of scientific practice. The central chapter of the book presents a broad theory of scientific method that comprises the detection of empirical phenomena and their subsequent understanding by constructing explanatory theories through the use of abductive methods. This theory of scientific method is then used as a framework to reconstruct the well-known qualitative method of grounded theory, and to present a systematic perspective on clinical reasoning and case formulation. Relatedly, an abductive or explanationist understanding of methods is employed to evaluate the knowledge credentials of evolutionary psychology. In addition, the conceptual and methodological foundations of a variety of quantitative methods are examined. Exploratory factor analysis and tests of statistical significance are given special attention.