Educational Policy Evaluation Through International Comparative Assessments


Book Description

One of the most salient findings from the field of education is that there are huge national differences in student achievement as shown in international comparative studies like PISA and TIMSS. The shockingly large gap between the highest performing countries (mostly in East Asia) and many European countries corresponds to a difference in attainment of two years of schooling. Although this finding has been replicated in several studies, the reasons for and consequences of such differences are currently not well understood. This book is a collection of essays and studies by leading experts in international comparative education who demonstrate how international comparative assessments can be used to evaluate educational policies. The volume is organized into two parts that address, first, theoretical foundations and methodological developments in the field of international assessments, and, second, innovative substantive studies that utilize international data for policy evaluation studies. The intention of this book is to revisit the idea of 'using the world as an educational laboratory', both to inform policy and to facilitate theory development.




Educational Policy Evaluation through International Comparative Assessments


Book Description

One of the most salient findings from the field of education is that there are huge national differences in student achievement as shown in international comparative studies like PISA and TIMSS. The shockingly large gap between the highest performing countries (mostly in East Asia) and many European countries corresponds to a difference in attainment of two years of schooling. Although this finding has been replicated in several studies, the reasons for and consequences of such differences are currently not well understood. This book is a collection of essays and studies by leading experts in international comparative education who demonstrate how international comparative assessments can be used to evaluate educational policies. The volume is organized into two parts that address, first, theoretical foundations and methodological developments in the field of international assessments, and, second, innovative substantive studies that utilize international data for policy evaluation studies. The intention of this book is to revisit the idea of 'using the world as an educational laboratory', both to inform policy and to facilitate theory development.




Schooling Across the Globe


Book Description

This research examines 17 international assessments over 60+ years highlighting the critical role that schooling plays around the world.




Improving a Country’s Education


Book Description

This open access book compares and contrasts the results of international student assessments in ten countries. The OECD’s Programme for International Student Assessment (PISA) released the results of its 2018 assessment in December 2019. This book reflects the debates that typically follow the release of these results and focuses on the causes of differences between countries. Such causes include continuous decline in one country, improvement combined with increasing internal inequalities in another country, or rapid improvement in spite of an outdated curriculum in yet another. In addition, the book discusses a number of general questions: Is knowledge outdated? Are computers taking over and replacing teachers? Are schools killing creativity? Are we adequately preparing the next generation? Are schools failing to educate our kids? The book starts out with a summary of PISA’s evolution and PISA results, and an explanation of the major factors that play a role in changes in countries’ results. The next ten chapters are devoted to ten specific countries, offering a summary of data and an explanation of the major drives for changes in education results for each one. Each chapter includes a short description of the country’s educational system as well as the impact of PISA and other ILSA studies on the country’s educational policies. The chapters also include a timeline of policy measures and main hallmarks of the country’s educational evolution, discussing the impact of these measures on its PISA results. A final reference chapter explains what PISA is, what it measures and how. While highlighting the 2018 results, the book also takes into consideration previous results, as well as long-term initiatives. This book gathers the contribution of well-known and respected experts in the field. Specialists such as Eric Hanushek, for the US, Tim Oates, for England, Montse Gomendio, for Spain, Gunda Tire, for Estonia, and all other contributors draw on their vast experience and statistical analysis expertise to draw a set of rich country lessons and recommendations that are invaluable for all of those who care about improving a country’s education system.




Reliability and Validity of International Large-Scale Assessment


Book Description

This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.




Handbook of Human and Social Conditions in Assessment


Book Description

The Handbook of Human and Social Conditions in Assessment is the first book to explore assessment issues and opportunities occurring due to the real world of human, cultural, historical, and societal influences upon assessment practices, policies, and statistical modeling. With chapters written by experts in the field, this book engages with numerous forms of assessment: from classroom-level formative assessment practices to national accountability and international comparative testing practices all of which are significantly influenced by social and cultural conditions. A unique and timely contribution to the field of Educational Psychology, the Handbook of Human and Social Conditions in Assessment is written for researchers, educators, and policy makers interested in how social and human complexity affect assessment at all levels of learning. Organized into four sections, this volume examines assessment in relation to teachers, students, classroom conditions, and cultural factors. Each section is comprised of a series of chapters, followed by a discussant chapter that synthesizes key ideas and offers directions for future research. Taken together, the chapters in this volume demonstrate that teachers, test creators, and policy makers must account for the human and social conditions that shape assessment if they are to implement successful assessment practices which accomplish their intended outcomes.




Assessment Reform in Education


Book Description

This book discusses the recent assessment movements in the eastern and western worlds with particular focuses on the policies, implementation, and impacts of assessment reform on education. A new perspective of assessment sees assessment as a means to enhance learning. This book examines the tensions, challenges and outcomes (intended and unintended) of assessment reform arising at the interface of policy and implementation, and implementation and student learning. The book reviews the experiences insights gained from research, and identifies the facilitators and hindrances to effective change. It reflects current thinking of assessment and provides the readers with ample background information of assessment development in many countries including USA, England, Scotland, Wales, Northern Ireland, Australia, Singapore, Taiwan, and Hong Kong.




International Handbook of Comparative Large-Scale Studies in Education


Book Description

This handbook is the first of its kind to provide a general and comprehensive overview of virtually every aspect of International Large Scale Assessment (ILSA). It includes historical, economic, and policy perspectives, theoretical foundations, methodology, and reviews of findings from analyses of ILSA data. After decades, during which ILSAs have generated knowledge within central areas of education research and gained increased and substantial impact on educational policy, practice and research, such a broad overview for a wide-ranging audience is much needed. With contributions from authors and editors from all continents, this handbook appeals to an international audience and keeps a neutral perspective, not favoring one ILSA over another. The handbook is suitable to be read by politicians, researchers and stakeholders who are seeking an overview of ILSAs, their history and development, and both potential benefits and limitations with regard to policy implications. The reviews of findings from studies analyzing ILSA data will be of interest to stakeholders, teachers, researchers, and policymakers. Considering that the reviews extend to all fields pertaining to educational research, the book will be valuable to all researchers interested in education. Students may use the book to learn about ILSAs in the context of policy, theoretical underpinnings, or research. Moreover, the methodology section is written in a manner that is understandable and accessible for students, stakeholders, or researchers not familiar with these data. This methodology part, however, is also a valuable resource for researchers who are familiar with ILSA data, as it provides overviews of the design and sampling procedures of several ILSAs, and includes advice on methods of analysis.Even the owners of the ILSAs may find the book valuable, as it contains overviews and insights into a number of ILSAs, provides information how the data is used by the research community, and includes recommendations for future instruments.







Assessment of Reading in International Studies


Book Description

This book brings together contributions from different scholarly contexts that address a diverse range of focused topics, as well as empirical and conceptual perspectives, on research with international studies. Some chapters focus on technical aspects, exploring opportunities for drawing causal inferences from the data, and investigating biases originating in distributional scale properties. Others are of a more conceptual nature, addressing changes in the relevance of socio-economic indicators across time and countries, examining the exposure of mother-tongue and English instruction on performance and investigating the effects of test construction on gender difference. The discussion takes a much-needed meta-perspective on the usefulness of international large-scale assessments for educational research and allows reflection upon possibilities and opportunities for their improvement. This book was originally published as a special issue of Assessment in Education.