Educational Assessment


Book Description

Educational Tests and Measurements in the Age of Accountability is a core text for use in a first level graduate course in educational measurement and testing. In addition to covering the topics traditionally found in core textbooks for this course, this text also provides coverage of contemporary topics (including national testing programs, international achievement comparisons, the value added assessment of schools and teachers, and the public policy debate on selective admissions vs. affirmative minority enrollment).




Assessing 21st Century Skills


Book Description

The routine jobs of yesterday are being replaced by technology and/or shipped off-shore. In their place, job categories that require knowledge management, abstract reasoning, and personal services seem to be growing. The modern workplace requires workers to have broad cognitive and affective skills. Often referred to as "21st century skills," these skills include being able to solve complex problems, to think critically about tasks, to effectively communicate with people from a variety of different cultures and using a variety of different techniques, to work in collaboration with others, to adapt to rapidly changing environments and conditions for performing tasks, to effectively manage one's work, and to acquire new skills and information on one's own. The National Research Council (NRC) has convened two prior workshops on the topic of 21st century skills. The first, held in 2007, was designed to examine research on the skills required for the 21st century workplace and the extent to which they are meaningfully different from earlier eras and require corresponding changes in educational experiences. The second workshop, held in 2009, was designed to explore demand for these types of skills, consider intersections between science education reform goals and 21st century skills, examine models of high-quality science instruction that may develop the skills, and consider science teacher readiness for 21st century skills. The third workshop was intended to delve more deeply into the topic of assessment. The goal for this workshop was to capitalize on the prior efforts and explore strategies for assessing the five skills identified earlier. The Committee on the Assessment of 21st Century Skills was asked to organize a workshop that reviewed the assessments and related research for each of the five skills identified at the previous workshops, with special attention to recent developments in technology-enabled assessment of critical thinking and problem-solving skills. In designing the workshop, the committee collapsed the five skills into three broad clusters as shown below: Cognitive skills: nonroutine problem solving, critical thinking, systems thinking Interpersonal skills: complex communication, social skills, team-work, cultural sensitivity, dealing with diversity Intrapersonal skills: self-management, time management, self-development, self-regulation, adaptability, executive functioning Assessing 21st Century Skills provides an integrated summary of the presentations and discussions from both parts of the third workshop.




Measuring Up


Book Description

How do you judge the quality of a school, a district, a teacher, a student? By the test scores, of course. Yet for all the talk, what educational tests can and can’t tell you, and how scores can be misunderstood and misused, remains a mystery to most. The complexities of testing are routinely ignored, either because they are unrecognized, or because they may be—well, complicated. Inspired by a popular Harvard course for students without an extensive mathematics background, Measuring Up demystifies educational testing—from MCAS to SAT to WAIS, with all the alphabet soup in between. Bringing statistical terms down to earth, Daniel Koretz takes readers through the most fundamental issues that arise in educational testing and shows how they apply to some of the most controversial issues in education today, from high-stakes testing to special education. He walks readers through everyday examples to show what tests do well, what their limits are, how easily tests and scores can be oversold or misunderstood, and how they can be used sensibly to help discover how much kids have learned.




Frontiers of Test Validity Theory


Book Description

This book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation and meaning. Psychometric and philosophical perspectives receive attention along with unresolved issues. The authors explore how measurement is conceived from both the classical and modern perspectives. The importance of understanding the underlying concepts as well as the practical challenges of test construction and use receive emphasis throughout. The book summarizes the current state of the test validity theory field. Necessary background on test theory and statistics is presented as a conceptual overview where needed. Each chapter begins with an overview of key material reviewed in previous chapters, concludes with a list of suggested readings, and features boxes with examples that connect theory to practice. These examples reflect actual situations that occurred in psychology, education, and other disciplines in the US and around the globe, bringing theory to life. Critical thinking questions related to the boxed material engage and challenge readers. A few examples include: What is the difference between intelligence and IQ? Can people disagree on issues of value but agree on issues of test validity? Is it possible to ask the same question in two different languages? The first part of the book contrasts theories of measurement as applied to the validity of behavioral science measures.The next part considers causal theories of measurement in relation to alternatives such as behavior domain sampling, and then unpacks the causal approach in terms of alternative theories of causation.The final section explores the meaning and interpretation of test scores as it applies to test validity. Each set of chapters opens with a review of the key theories and literature and concludes with a review of related open questions in test validity theory. Researchers, practitioners and policy makers interested in test validity or developing tests appreciate the book's cutting edge review of test validity. The book also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice and other fields. The book does not assume a background in measurement.










Psychological Testing in the Service of Disability Determination


Book Description

The United States Social Security Administration (SSA) administers two disability programs: Social Security Disability Insurance (SSDI), for disabled individuals, and their dependent family members, who have worked and contributed to the Social Security trust funds, and Supplemental Security Income (SSSI), which is a means-tested program based on income and financial assets for adults aged 65 years or older and disabled adults and children. Both programs require that claimants have a disability and meet specific medical criteria in order to qualify for benefits. SSA establishes the presence of a medically-determined impairment in individuals with mental disorders other than intellectual disability through the use of standard diagnostic criteria, which include symptoms and signs. These impairments are established largely on reports of signs and symptoms of impairment and functional limitation. Psychological Testing in the Service of Disability Determination considers the use of psychological tests in evaluating disability claims submitted to the SSA. This report critically reviews selected psychological tests, including symptom validity tests, that could contribute to SSA disability determinations. The report discusses the possible uses of such tests and their contribution to disability determinations. Psychological Testing in the Service of Disability Determination discusses testing norms, qualifications for administration of tests, administration of tests, and reporting results. The recommendations of this report will help SSA improve the consistency and accuracy of disability determination in certain cases.




Beyond Test Scores


Book Description

When it comes to sizing up America’s public schools, test scores are the go-to metric of state policy makers and anxious parents looking to place their children in the “best” schools. Yet ample research indicates that standardized tests are a poor way to measure a school’s performance. It is time—indeed past time—to rethink this system, Jack Schneider says. Beyond Test Scores reframes current debates over school quality by offering new approaches to educational data that can push us past our unproductive fixation on test scores. Using the highly diverse urban school district of Somerville, Massachusetts, as a case study, Schneider and his research team developed a new framework to more fairly and comprehensively assess educational effectiveness. And by adopting a wide range of measures aligned with that framework, they were able to more accurately capture a broader array of school strengths and weaknesses. Their new data not only provided parents, educators, and administrators with a clearer picture of school performance, but also challenged misconceptions about what makes a good school. With better data, Schneider shows, stakeholders at the federal, state, and local levels can undo the damage of present accountability systems and build greater capacity in our schools. Policy makers, administrators, and school leaders can better identify where assistance is needed. Educators can engage in more evidence-based decision making. And parents can make better-informed choices for their children. Perhaps most importantly, better data can facilitate communication among all these groups, allowing them to take collective action toward shared, concrete goals.




Standards for Educational and Psychological Testing


Book Description

"Prepared by the Joint Committee on Standards for Educatioanl and Psychological Testing of the American Educational Research Association, American Psychological Association and National Council on Measurement in Education"--T.p. verso.