Validity in Educational and Psychological Assessment


Book Description

Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.




Standards for Educational and Psychological Testing


Book Description

"Prepared by the Joint Committee on Standards for Educatioanl and Psychological Testing of the American Educational Research Association, American Psychological Association and National Council on Measurement in Education"--T.p. verso.




Psychological Testing in the Service of Disability Determination


Book Description

The United States Social Security Administration (SSA) administers two disability programs: Social Security Disability Insurance (SSDI), for disabled individuals, and their dependent family members, who have worked and contributed to the Social Security trust funds, and Supplemental Security Income (SSSI), which is a means-tested program based on income and financial assets for adults aged 65 years or older and disabled adults and children. Both programs require that claimants have a disability and meet specific medical criteria in order to qualify for benefits. SSA establishes the presence of a medically-determined impairment in individuals with mental disorders other than intellectual disability through the use of standard diagnostic criteria, which include symptoms and signs. These impairments are established largely on reports of signs and symptoms of impairment and functional limitation. Psychological Testing in the Service of Disability Determination considers the use of psychological tests in evaluating disability claims submitted to the SSA. This report critically reviews selected psychological tests, including symptom validity tests, that could contribute to SSA disability determinations. The report discusses the possible uses of such tests and their contribution to disability determinations. Psychological Testing in the Service of Disability Determination discusses testing norms, qualifications for administration of tests, administration of tests, and reporting results. The recommendations of this report will help SSA improve the consistency and accuracy of disability determination in certain cases.




Handbook of Psychoeducational Assessment


Book Description

The Handbook of Psychoeducational Assessment is a practical guide for educational and psychological professionals using norm-referenced tests in the ability, achievement, and behavioral assessment of children. Written by key individuals involved in the construction and evolution of the most widely used tests, this book provides critical information on the nature and scope of commonly used tests, their reliability and validity, administration, scoring and interpretation, and on how the tests may differ and complement each other in their utility with specific populations. Part 1 of the Handbook of Psychoeducational Assessment focuses on ability assessment and the use of full battery intelligence tests as well as brief scales and short forms. Part 2 discusses achievement and the expanded role of psychologists in consultation with educators. Part 3 covers behavior assessment with special attention given to discussion of which tests are most suitable for assessing specific behavioral problems such as ADHD, anxiety, and depression. The final section recognizes the importance of context and person sensitive assessment practices, discussing cross-cultural assessment, neuropsychological assessment, and the usefulness of dynamic assessment for program planning and intervention delivery. Key Features: - Covers the most commonly used and newest assessment instruments - Describes the nature, scope, reliability, and validity of each test - Discusses the administration, scoring, and interpretation of tests - Provides empirical findings on patterns of performance with tested populations - Includes case studies to highlight the utility of specific tests for specific populations - Illustrates new developments in instrumentation and unique features - Covers the most commonly used and newest assessment instruments - Describes the nature, scope, reliability, and validity of each test - Discusses the administration, scoring, and interpretation of tests - Provides empirical findings on patterns of performance with tested populations - Includes case studies to highlight the utility of specific tests for specific populations - Illustrates new developments in instrumentation and unique features




Validity


Book Description

Validity is a clear, substantive introduction to the two most fundamental aspects of defensible testing practice: understanding test score meaning and justifying test score use. Driven by evidence-based and consensus-grounded measurement theory, principles, and terminology, this book addresses the most common questions of applied validation, the quality of test information, and the usefulness of test results. Concise yet comprehensive, this volume’s integrated framework is ideal for graduate courses on assessment, testing, psychometrics, and research methods as well as for credentialing organizations, licensure and certification entities, education agencies, and test publishers.




Validity and Validation in Social, Behavioral, and Health Sciences


Book Description

This book combines an overview of validity theory, trends in validation practices and a review of standards and guidelines in several international jurisdictions with research synthesis of the validity evidence in different research areas. An overview of theory is both useful and timely, in view of the increased use of tests and measures for decision-making, ranking and policy purposes in large-scale testing, assessment and social indicators and quality of life research. Research synthesis is needed to help us assemble, critically appraise and integrate the overwhelming volume of research on validity in different contexts. Rather than examining whether any given measure is “valid”, the focus is on a critical appraisal of the kinds of validity evidence reported in the published research literature. The five sources of validity evidence discussed are: content-related, response processes, internal structure, associations with other variables and consequences. The 15 syntheses included here, represent a broad sampling of psychosocial, health, medical and educational research settings, giving us an extensive evidential basis to build upon earlier studies. The book concludes with a meta-synthesis of the 15 syntheses and a discussion of the current thinking of validation practices by leading experts in the field.







Advancing Human Assessment


Book Description

This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.




Problems and Solutions in Human Assessment


Book Description

The assessment of individual differences has generated shockwaves affecting sociology, education, and a number of other behavioral sciences as well as the fields of management and organizational behavior. In covering the assessment of individual differences, this book pays tribute to the interests and activities that Douglas N. Jackson has incorporated into his career as a psychologist. He continues to be a leader in putting academic findings to practical use. He has also inspired generations of students with his mastery of complex concepts and as a personal example of the ability to balance several simultaneous areas of research. Consistent with the focus of Jackson's research, the theme of this book will be how the use of deductive, construct-driven strategies in the assessment of individual differences leads to benefits in terms of the applicability of the assessment instruments and the clarity of the conclusions that can be drawn from the research.




Frontiers of Test Validity Theory


Book Description

This book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation and meaning. Psychometric and philosophical perspectives receive attention along with unresolved issues. The authors explore how measurement is conceived from both the classical and modern perspectives. The importance of understanding the underlying concepts as well as the practical challenges of test construction and use receive emphasis throughout. The book summarizes the current state of the test validity theory field. Necessary background on test theory and statistics is presented as a conceptual overview where needed. Each chapter begins with an overview of key material reviewed in previous chapters, concludes with a list of suggested readings, and features boxes with examples that connect theory to practice. These examples reflect actual situations that occurred in psychology, education, and other disciplines in the US and around the globe, bringing theory to life. Critical thinking questions related to the boxed material engage and challenge readers. A few examples include: What is the difference between intelligence and IQ? Can people disagree on issues of value but agree on issues of test validity? Is it possible to ask the same question in two different languages? The first part of the book contrasts theories of measurement as applied to the validity of behavioral science measures.The next part considers causal theories of measurement in relation to alternatives such as behavior domain sampling, and then unpacks the causal approach in terms of alternative theories of causation.The final section explores the meaning and interpretation of test scores as it applies to test validity. Each set of chapters opens with a review of the key theories and literature and concludes with a review of related open questions in test validity theory. Researchers, practitioners and policy makers interested in test validity or developing tests appreciate the book's cutting edge review of test validity. The book also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice and other fields. The book does not assume a background in measurement.