Computers and Their Impact on State Assessments


Book Description

The Race To The Top program strongly advocates the use of computer technology in assessments. It dramatically promotes computer-based testing, linear or adaptive, in K-12 state assessment programs. Moreover, assessment requirements driven by this federal initiative exponentially increase the complexity in assessment design and test development. This book provides readers with a review of the history and basics of computer-based tests. It also offers a macro perspective for designing such assessment systems in the K-12 setting as well as a micro perspective on new challenges such as innovative items, scoring of such items, cognitive diagnosis, and vertical scaling for growth modeling and value added approaches to assessment. The editors’ goal is to provide readers with necessary information to create a smarter computer-based testing system by following the advice and experience of experts from education as well as other industries. This book is based on a conference (http://marces.org/workshop.htm) held by the Maryland Assessment Research Center for Education Success. It presents multiple perspectives including test vendors and state departments of education, in designing and implementing a computer-based test in the K-12 setting. The design and implementation of such a system requires deliberate planning and thorough considerations. The advice and experiences presented in this book serve as a guide to practitioners and as a good source of information for quality control. The technical issues discussed in this book are relatively new and unique to K-12 large-scale computer-based testing programs, especially due to the recent federal policy. Several chapters provide possible solutions to psychometricians dealing with the technical challenges related to innovative items, cognitive diagnosis, and growth modeling in computer-based linear or adaptive tests in the K-12 setting.




Technology and Assessment


Book Description

The papers in this collection were commissioned by the Board on Testing and Assessment (BOTA) of the National Research Council (NRC) for a workshop held on November 14, 2001, with support from the William and Flora Hewlett Foundation. Goals for the workshop were twofold. One was to share the major messages of the recently released NRC committee report, Knowing What Students Know: The Science and Design of Educational Assessment (2001), which synthesizes advances in the cognitive sciences and methods of measurement, and considers their implications for improving educational assessment. The second goal was to delve more deeply into one of the major themes of that report-the role that technology could play in bringing those advances together, which is the focus of these papers. For the workshop, selected researchers working in the intersection of technology and assessment were asked to write about some of the challenges and opportunities for more fully capitalizing on the power of information technologies to improve assessment, to illustrate those issues with examples from their own research, and to identify priorities for research and development in this area.










Knowing What Students Know


Book Description

Education is a hot topic. From the stage of presidential debates to tonight's dinner table, it is an issue that most Americans are deeply concerned about. While there are many strategies for improving the educational process, we need a way to find out what works and what doesn't work as well. Educational assessment seeks to determine just how well students are learning and is an integral part of our quest for improved education. The nation is pinning greater expectations on educational assessment than ever before. We look to these assessment tools when documenting whether students and institutions are truly meeting education goals. But we must stop and ask a crucial question: What kind of assessment is most effective? At a time when traditional testing is subject to increasing criticism, research suggests that new, exciting approaches to assessment may be on the horizon. Advances in the sciences of how people learn and how to measure such learning offer the hope of developing new kinds of assessments-assessments that help students succeed in school by making as clear as possible the nature of their accomplishments and the progress of their learning. Knowing What Students Know essentially explains how expanding knowledge in the scientific fields of human learning and educational measurement can form the foundations of an improved approach to assessment. These advances suggest ways that the targets of assessment-what students know and how well they know it-as well as the methods used to make inferences about student learning can be made more valid and instructionally useful. Principles for designing and using these new kinds of assessments are presented, and examples are used to illustrate the principles. Implications for policy, practice, and research are also explored. With the promise of a productive research-based approach to assessment of student learning, Knowing What Students Know will be important to education administrators, assessment designers, teachers and teacher educators, and education advocates.




PISA Computer-Based Assessment of Student Skills in Science


Book Description

This report documents the initial step towards an electronically-delivered Programme for International Student Assessment (PISA) test pioneered by Denmark, Iceland and Korea.




Resilience Assessment and Evaluation of Computing Systems


Book Description

The resilience of computing systems includes their dependability as well as their fault tolerance and security. It defines the ability of a computing system to perform properly in the presence of various kinds of disturbances and to recover from any service degradation. These properties are immensely important in a world where many aspects of our daily life depend on the correct, reliable and secure operation of often large-scale distributed computing systems. Wolter and her co-editors grouped the 20 chapters from leading researchers into seven parts: an introduction and motivating examples, modeling techniques, model-driven prediction, measurement and metrics, testing techniques, case studies, and conclusions. The core is formed by 12 technical papers, which are framed by motivating real-world examples and case studies, thus illustrating the necessity and the application of the presented methods. While the technical chapters are independent of each other and can be read in any order, the reader will benefit more from the case studies if he or she reads them together with the related techniques. The papers combine topics like modeling, benchmarking, testing, performance evaluation, and dependability, and aim at academic and industrial researchers in these areas as well as graduate students and lecturers in related fields. In this volume, they will find a comprehensive overview of the state of the art in a field of continuously growing practical importance.










Computer-assisted Assessment of Students


Book Description

This text draws on a range of expertise to share good practice and explore new ways of using appropriate technologies in assessment. It provides a strategic overview along with pragmatic proposals for the use of computers in assessment.