Large-Scale Cognitive Assessment


Book Description

This open access methodological book summarises existing analysing techniques using data from PIAAC, a study initiated by the OECD that assesses key cognitive and occupational skills of the adult population in more than 40 countries. The approximately 65 PIAAC datasets that has been published worldwide to date has been widely received and used by an interdisciplinary research community. Due to the complex structure of the data, analyses with PIAAC datasets are very challenging. To ensure the quality and significance of these data analyses, it is necessary to instruct users in the correct handling of the data. This methodological book provides a standardised approach to successfully implementing these data analyses. It contains examples of and tools for the analysis of the PIAAC data using different statistical approaches and software, and it offers perspectives from various disciplines. The contributing authors have hands-on experience of using PIAAC data, and/or they have conducted data analysis workshops with these data.




International Handbook of Comparative Large-Scale Studies in Education


Book Description

This handbook is the first of its kind to provide a general and comprehensive overview of virtually every aspect of International Large Scale Assessment (ILSA). It includes historical, economic, and policy perspectives, theoretical foundations, methodology, and reviews of findings from analyses of ILSA data. After decades, during which ILSAs have generated knowledge within central areas of education research and gained increased and substantial impact on educational policy, practice and research, such a broad overview for a wide-ranging audience is much needed. With contributions from authors and editors from all continents, this handbook appeals to an international audience and keeps a neutral perspective, not favoring one ILSA over another. The handbook is suitable to be read by politicians, researchers and stakeholders who are seeking an overview of ILSAs, their history and development, and both potential benefits and limitations with regard to policy implications. The reviews of findings from studies analyzing ILSA data will be of interest to stakeholders, teachers, researchers, and policymakers. Considering that the reviews extend to all fields pertaining to educational research, the book will be valuable to all researchers interested in education. Students may use the book to learn about ILSAs in the context of policy, theoretical underpinnings, or research. Moreover, the methodology section is written in a manner that is understandable and accessible for students, stakeholders, or researchers not familiar with these data. This methodology part, however, is also a valuable resource for researchers who are familiar with ILSA data, as it provides overviews of the design and sampling procedures of several ILSAs, and includes advice on methods of analysis.Even the owners of the ILSAs may find the book valuable, as it contains overviews and insights into a number of ILSAs, provides information how the data is used by the research community, and includes recommendations for future instruments.




Implementation of Large-Scale Education Assessments


Book Description

Presents a comprehensive treatment of issues related to the inception, design, implementation and reporting of large-scale education assessments. In recent years many countries have decided to become involved in international educational assessments to allow them to ascertain the strengths and weaknesses of their student populations. Assessments such as the OECD's Programme for International Student Assessment (PISA), the IEA's Trends in Mathematics and Science Study (TIMSS) and Progress in International Reading Literacy (PIRLS) have provided opportunities for comparison between students of different countries on a common international scale. This book is designed to give researchers, policy makers and practitioners a well-grounded knowledge in the design, implementation, analysis and reporting of international assessments. Readers will be able to gain a more detailed insight into the scientific principles employed in such studies allowing them to make better use of the results. The book will also give readers an understanding of the resources needed to undertake and improve the design of educational assessments in their own countries and regions. Implementation of Large-Scale Education Assessments: Brings together the editors’ extensive experience in creating, designing, implementing, analysing and reporting results on a wide range of assessments. Emphasizes methods for implementing international studies of student achievement and obtaining highquality data from cognitive tests and contextual questionnaires. Discusses the methods of sampling, weighting, and variance estimation that are commonly encountered in international large-scale assessments. Provides direction and stimulus for improving global educational assessment and student learning Is written by experts in the field, with an international perspective. Survey researchers, market researchers and practitioners engaged in comparative projects will all benefit from the unparalleled breadth of knowledge and experience in large-scale educational assessments gathered in this one volume.




Advancing Human Assessment


Book Description

This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.




Cognitive Diagnostic Assessment for Education


Book Description

With the current push toward educational reform, there is great potential for innovation and change, particularly in large scale testing. One area where change is possible is in cognitive diagnostic assessment. Researchers in educational measurement and cognitive psychology are finally in a position to design tests targeted specifically for providing valuable information about students' cognitive strengths and weaknesses. This self-contained volume organizes what is known about cognitive diagnostic assessment in education, including its conceptual and philosophical basis, methods, and applications. The complete list of topics includes educational demand, philosophical rationale, construct validity, cognitive methods, test construction, statistical models, and unresolved issues (e.g., how to best translate diagnostic information into teaching practices). Leighton and Gierl present a comprehensive and up-to-date examination of cognitive diagnostic assessment in education.







Cognitive Assessment


Book Description

First Published in 2009. Routledge is an imprint of Taylor & Francis, an informa company.




Implementation of Large-Scale Education Assessments


Book Description

Presents a comprehensive treatment of issues related to the inception, design, implementation and reporting of large-scale education assessments. In recent years many countries have decided to become involved in international educational assessments to allow them to ascertain the strengths and weaknesses of their student populations. Assessments such as the OECD's Programme for International Student Assessment (PISA), the IEA's Trends in Mathematics and Science Study (TIMSS) and Progress in International Reading Literacy (PIRLS) have provided opportunities for comparison between students of different countries on a common international scale. This book is designed to give researchers, policy makers and practitioners a well-grounded knowledge in the design, implementation, analysis and reporting of international assessments. Readers will be able to gain a more detailed insight into the scientific principles employed in such studies allowing them to make better use of the results. The book will also give readers an understanding of the resources needed to undertake and improve the design of educational assessments in their own countries and regions. Implementation of Large-Scale Education Assessments: Brings together the editors’ extensive experience in creating, designing, implementing, analysing and reporting results on a wide range of assessments. Emphasizes methods for implementing international studies of student achievement and obtaining highquality data from cognitive tests and contextual questionnaires. Discusses the methods of sampling, weighting, and variance estimation that are commonly encountered in international large-scale assessments. Provides direction and stimulus for improving global educational assessment and student learning Is written by experts in the field, with an international perspective. Survey researchers, market researchers and practitioners engaged in comparative projects will all benefit from the unparalleled breadth of knowledge and experience in large-scale educational assessments gathered in this one volume.




Multifaceted Assessment for Early Childhood Education


Book Description

Multifaceted Assessment in Early Childhood is ideal for those on upper-division undergraduate courses and first-level graduate courses in early childhood education assessment. The book covers the various measures used in a range of assessment dimensions, and includes valuable information regarding young children with special needs and English Language Learners, which has rarely been touched upon in other textbooks. The chapters are focused on student accessibility and include practical applications of key concepts. Features and benefits: Covers a range of assessment concepts, including - Formative (uses feedback from learning to adapt teaching) -Summative (i.e. tests, quizzes) -Authentic (focuses on complex/deeper tasks) -Standardized (STAR, SAT) Includes coverage of assessment for English language learners and children with special needs -- topics that are not provided enough coverage in other books (including Wortham, McAfee, Puckett and Mindes). Wright's writing style grabs and engages the reader in the topic. Two of our reviewers who use Wortham specifically cited Wright's writing style as a reason they would adopt our book. A McAfee reviewer is likely to switch for the same reason.




Reliability and Validity of International Large-Scale Assessment


Book Description

This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.