Score Reporting Research and Applications


Book Description

Score reporting research is no longer limited to the psychometric properties of scores and subscores. Today, it encompasses design and evaluation for particular audiences, appropriate use of assessment outcomes, the utility and cognitive affordances of graphical representations, interactive report systems, and more. By studying how audiences understand the intended messages conveyed by score reports, researchers and industry professionals can develop more effective mechanisms for interpreting and using assessment data. Score Reporting Research and Applications brings together experts who design and evaluate score reports in both K-12 and higher education contexts and who conduct foundational research in related areas. The first section covers foundational validity issues in the use and interpretation of test scores; design principles drawn from related areas including cognitive science, human-computer interaction, and data visualization; and research on presenting specific types of assessment information to various audiences. The second section presents real-world applications of score report design and evaluation and of the presentation of assessment information. Across ten chapters, this volume offers a comprehensive overview of new techniques and possibilities in score reporting. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.




Adaptive Instructional Systems


Book Description

This book constitutes the refereed proceedings of the First International Conference on Adaptive Instructional Systems, AIS 2019, held in July 2019 as part of HCI International 2019 in Orlando, FL, USA. HCII 2019 received a total of 5029 submissions, of which 1275 papers and 209 posters were accepted for publication after a careful reviewing process. The 50 papers presented in this volume are organized in topical sections named: Adaptive Instruction Design and Authoring, Interoperability and Standardization in Adaptive Instructional Systems, Instructional Theories in Adaptive Instruction, Learner Assessment and Modelling, AI in Adaptive Instructional Systems, Conversational Tutors.




Assessing Competencies for Social and Emotional Learning


Book Description

Assessing Competencies for Social and Emotional Learning explores the conceptualization, development, and application of assessments of competencies and contextual factors related to social and emotional learning (SEL). As programs designed to teach students social and emotional competencies are being adopted at an ever‐increasing rate, new measurements are needed to understand their impact on student attitudes, behaviors, and academic performance. This book integrates standards of fairness, reliability, and validity, and lessons learned from personality and attitude assessment to facilitate the principled development and use of SEL assessments. Education professionals, assessment developers, and researchers will be better prepared to systematically develop and evaluate measures of social and emotional competencies.




Subscores


Book Description

This authoritative guide directs consumers and users of test scores on when and how to provide subscores and how to make informed decisions based on them. The book is designed to be accessible to practitioners and score users with varying levels of technical expertise, from executives of testing organizations and students who take tests to graduate students in educational measurement, psychometricians, and test developers. The theoretical background required to evaluate subscores and improve them are provided alongside examples of tests with subscores to illustrate their use and misuse. The first chapter covers the history of tests, subtests, scores, and subscores. Later chapters go into subscore reporting, evaluating and improving the quality of subscores, and alternatives to subscores when they are not appropriate. This thorough introduction to the existing research and best practices will be useful to graduate students, researchers, and practitioners.




Design Recommendations for Intelligent Tutoring Systems: Volume 8 - Data Visualization


Book Description

This book on data visualization is the eighth in a planned series of books that examine key topics (e.g., learner modeling, instructional strategies, authoring, domain modeling, assessment, team tutoring, self-improving systems, data visualization, and competency based scenario design) in intelligent tutoring system (ITS) design. This book focuses on data visualization and how it is applied in ITSs. The chapters within this book specifically examine topics in relationship to the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is an open-source, domain-independent, modular, service-oriented architecture for ITSs. The design of GIFT allows for reusability, reduction in authoring time, and reducing the skill level needed to create an ITS. GIFT provides functionality to create ITSs, distribute ITSs to learners through the Cloud, conduct research to evaluate ITSs, and to examine instructional outcomes. Data visualization is an important topic for ITSs, as there are many different users of the systems (including learners, instructors, researchers, subject matter experts). The data that is collected by the ITS can be organized and displayed in a number of different ways. The current book includes a general discussion of how data visualizations can be applied in ITSs, as well as detailed specific examples of existing implementations, and technical details related to incorporating data visualization in ITSs. We believe this book can be used as a design tool for data visualization interfaces in ITSs.




Enhancing Effective Instruction and Learning Using Assessment Data


Book Description

This book introduces theories and practices for using assessment data to enhance learning and instruction. Topics include reshaping the homework review process, iterative learning engineering, learning progressions, learning maps, score report designing, the use of psychosocial data, and the combination of adaptive testing and adaptive learning. In addition, studies proposing new methods and strategies, technical details about the collection and maintenance of process data, and examples illustrating proposed methods and software are included. Chapters 1, 4, 6, 8, and 9 discuss how to make valid interpretations of results and achieve more efficient instructions from various sources of data. Chapters 3 and 7 propose and evaluate new methods to promote students’ learning by using evidence-based iterative learning engineering and supporting the teachers’ use of assessment data, respectively. Chapter 2 provides technical details on the collection, storage, and security protection of process data. Chapter 5 introduces software for automating some aspects of developmental education and the use of predictive modeling. Chapter 10 describes the barriers to using psychosocial data for formative assessment purposes. Chapter 11 describes a conceptual framework for adaptive learning and testing and gives an example of a functional learning and assessment system. In summary, the book includes comprehensive perspectives of the recent development and challenges of using test data for formative assessment purposes. The chapters provide innovative theoretical frameworks, new perspectives on the use of data with technology, and how to build new methods based on existing theories. This book is a useful resource to researchers who are interested in using data and technology to inform decision making, facilitate instructional utility, and achieve better learning outcomes.




Neuroergonomics


Book Description

This book sums up key research findings, and theoretical and technological advances having a direct bearing on neuroergonomics. Neuroergonomics is an emerging area whose Neuroergonomics is an emerging area that is collectively defined as the study of human brain function and behaviour in relation to behavioural performance in natural environments and everyday settings. It helps readers to understand neural mechanisms of human cognition in the context of human interaction with complex systems, as well as understanding the change of perception, decision-making and training in humans. The authors give new insights into augmenting human performance, reflecting upon the opportunities provided through neuroergonomics research and development. Computer systems acting on data from behavioural-output, physiological, and neurological sensing technologies are used to determine the user’s cognitive state and adapt the systems to change, support, and monitor human cognition. Various domains and case studies delve into the field of neuroergonomics in detail. These include, but are not limited to: an evaluation of technologies in health, workplace, and education settings, to show the different impacts of neuroergonomics in everyday lives; assessment of real-time cognitive measures; dynamic casual interactions between inhibition and updating functions, through analysis of behavioral, neurophysiological and effective connectivity metrics; and applications in human performance modelling and assessment of mental workload, showing the reader how to train and improve working memory capacity. Neuroergonomics: Principles and Practice provides academic practitioners and graduate students with a single go-to handbook that will be of significant assistance in research associated with human factors and ergonomics, human-computer interaction, human-systems engineering and cognitive neuroscience.




Technology Applications in Education


Book Description

This volume identifies promising learning, teaching, and assessment strategies for the use and assessment of technology in educational settings, specifically: *educational context (e.g., organizational and structural factors that contribute to the effective use of technology in school settings); *promising learning and teaching strategies; *promising technology-based assessment procedures and methods; *policy implementation issues; and *a summary of current research on the effective use of technology in education. Chapter authors represent a variety of perspectives and disciplines, from computer science, cognitive and educational psychology, and educational administration. Authors represent government, business, and university communities from within and outside the U.S. These multiple perspectives contribute to the overall understanding of current technology use in education and help in identifying future research needs. Technology Applications in Education: A Learning View explores the state of the art of technology in K-16 education from a learning perspective rather than a hardware/software view. It is designed for professionals and graduate students in the educational technology, training, assessment/evaluation, school administration, military psychology, and educational psychology communities. This book is characterized in the following montage of factors: *the primacy of learning as a focus for technology implementation; *a focus on technology uses in K-16 education; *a focus on the assessment of both individuals and teams; *a broad variety of methodological approaches from qualitative to instructional design to quantitative (e.g., structural equation modeling); *a need to support the development of technology-based curriculum and tools; and *a need for theory-driven and evaluation studies to increase our knowledge.




Practical Guide to the Evaluation of Clinical Competence E-Book


Book Description

Offering a multifaceted, practical approach to the complex topic of clinical assessment, Practical Guide to the Assessment of Clinical Competence, 3rd Edition, is designed to help medical educators employ better assessment methods, tools, and models directly into their training programs. World-renowned editors and expert contributing authors provide hands-on, authoritative guidance on outcomes-based assessment in clinical education, presenting a well-organized, diverse combination of methods you can implement right away. This thoroughly revised edition is a valuable resource for developing, implementing, and sustaining effective systems for assessing clinical competence in medical school, residency, and fellowship programs. - Helps medical educators and administrators answer complex, ongoing, and critical questions in today's changing medical education system: Is this undergraduate or postgraduate medical student prepared and able to move to the next level of training? To be a competent and trusted physician? - Provides practical suggestions and assessment approaches that can be implemented immediately in your training program, tools that can be used to assess and measure clinical performance, overviews of key educational theories, and strengths and weaknesses of every method. - Covers assessment techniques, frameworks, high-quality assessment of clinical reasoning and procedural competence, psychometrics, and practical approaches to feedback. - Includes expanded coverage of fast-moving areas where concepts now have solid research and data that support practical ways to connect judgments of ability to outcomes—including work-based assessments, clinical competency committees, milestones and entrustable professional assessments (EPAs), and direct observation. - Offers examples of assessment instruments along with suggestions on how you can apply these methods and instruments in your own setting, as well as guidelines that apply across the medical education spectrum. - Includes online access to videos of medical interviewing scenarios and more, downloadable assessment tools, and detailed faculty guidelines. - An eBook version is included with purchase. The eBook allows you to access all of the text, figures, and references, with the ability to search, make notes and highlights, and have content read aloud.




The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation


Book Description

In an era of curricular changes and experiments and high-stakes testing, educational measurement and evaluation is more important than ever. In addition to expected entries covering the basics of traditional theories and methods, other entries discuss important sociopolitical issues and trends influencing the future of that research and practice. Textbooks, handbooks, monographs and other publications focus on various aspects of educational research, measurement and evaluation, but to date, there exists no major reference guide for students new to the field. This comprehensive work fills that gap, covering traditional areas while pointing the way to future developments. Features: Nearly 700 signed entries are contained in an authoritative work spanning four volumes and available in choice of electronic and/or print formats. Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of education research, measurement, and evaluation to more easily locate directly related entries. (For instance, sample themes include Data, Evaluation, Measurement Concepts & Issues, Research, Sociopolitical Issues, Standards.) Back matter includes a Chronology of the development of the field; a Resource Guide to classic books, journals, and associations; and a detailed Index. Entries conclude with References/Further Readings and Cross References to related entries. The Index, Reader’s Guide themes, and Cross References will combine to provide robust search-and-browse in the e-version.