Advances in Questionnaire Design, Development, Evaluation and Testing


Book Description

A new and updated definitive resource for survey questionnaire testing and evaluation Building on the success of the first Questionnaire Development, Evaluation, and Testing (QDET) conference in 2002, this book brings together leading papers from the Second International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2) held in 2016. The volume assesses the current state of the art and science of QDET; examines the importance of methodological attention to the questionnaire in the present world of information collection; and ponders how the QDET field can anticipate new trends and directions as information needs and data collection methods continue to evolve. Featuring contributions from international experts in survey methodology, Advances in Questionnaire Design, Development, Evaluation and Testing includes latest insights on question characteristics, usability testing, web probing, and other pretesting approaches, as well as: Recent developments in the design and evaluation of digital and self-administered surveys Strategies for comparing and combining questionnaire evaluation methods Approaches for cross-cultural and cross-national questionnaire development New data sources and methodological innovations during the last 15 years Case studies and practical applications Advances in Questionnaire Design, Development, Evaluation and Testing serves as a forum to prepare researchers to meet the next generation of challenges, making it an excellent resource for researchers and practitioners in government, academia, and the private sector.




Question Evaluation Methods


Book Description

Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods at the upper-undergraduate and graduate levels. it also serves as a reference for government statisticians, survey methodologists, and researchers and practitioners who carry out survey research in the areas of the social and health sciences.




Design, Evaluation, and Analysis of Questionnaires for Survey Research


Book Description

Praise for the First Edition "...this book is quite inspiring, giving many practical ideas for survey research, especially for designing better questionnaires." —International Statistical Review Reflecting modern developments in the field of survey research, the Second Edition of Design, Evaluation, and Analysis of Questionnaires for Survey Research continues to provide cutting-edge analysis of the important decisions researchers make throughout the survey design process.The new edition covers the essential methodologies and statistical tools utilized to create reliable and accurate survey questionnaires, which unveils the relationship between individual question characteristics and overall question quality. Since the First Edition, the computer program Survey Quality Prediction (SQP) has been updated to include new predictions of the quality of survey questions on the basis of analyses of Multi-Trait Multi-Method experiments. The improved program contains over 60,000 questions, with translations in most European languages. Featuring an expanded explanation of the usage and limitations of SQP 2.0, the Second Edition also includes: New practice problems to provide readers with real-world experience in survey research and questionnaire design A comprehensive outline of the steps for creating and testing survey questionnaires Contemporary examples that demonstrate the many pitfalls of questionnaire design and ways to avoid similar decisions Design, Evaluation, and Analysis of Questionnaires for Survey Research, Second Edition is an excellent textbook for upper-undergraduate and graduate-level courses in methodology and research questionnaire planning, as well as an ideal resource for social scientists or survey researchers needing to design, evaluate, and analyze questionnaires.




Advances in Comparative Survey Methods


Book Description

Covers the latest methodologies and research on international comparative surveys with contributions from noted experts in the field Advances in Comparative Survey Methodology examines the most recent advances in methodology and operations as well as the technical developments in international survey research. With contributions from a panel of international experts, the text includes information on the use of Big Data in concert with survey data, collecting biomarkers, the human subject regulatory environment, innovations in data collection methodology and sampling techniques, use of paradata across the survey lifecycle, metadata standards for dissemination, and new analytical techniques. This important resource: Contains contributions from key experts in their respective fields of study from around the globe Highlights innovative approaches in resource poor settings, and innovative approaches to combining survey and other data Includes material that is organized within the total survey error framework Presents extensive and up-to-date references throughout the book Written for students and academic survey researchers and market researchers engaged in comparative projects, this text represents a unique collaboration that features the latest methodologies and research on global comparative surveys.




Methods for Testing and Evaluating Survey Questionnaires


Book Description

The definitive resource for survey questionnaire testing and evaluation Over the past two decades, methods for the development, evaluation, and testing of survey questionnaires have undergone radical change. Research has now begun to identify the strengths and weaknesses of various testing and evaluation methods, as well as to estimate the methods’ reliability and validity. Expanding and adding to the research presented at the International Conference on Questionnaire Development, Evaluation and Testing Methods, this title presents the most up-to-date knowledge in this burgeoning field. The only book dedicated to the evaluation and testing of survey questionnaires, this practical reference work brings together the expertise of over fifty leading, international researchers from a broad range of fields. The volume is divided into seven sections: Cognitive interviews Mode of administration Supplements to conventional pretests Special populations Experiments Multi-method applications Statistical modeling Comprehensive and carefully edited, this groundbreaking text offers researchers a solid foundation in the latest developments in testing and evaluating survey questionnaires, as well as a thorough introduction to emerging techniques and technologies.




Usability Testing for Survey Research


Book Description

Usability Testing for Survey Research provides researchers with a guide to the tools necessary to evaluate, test, and modify surveys in an iterative method during the survey pretesting process. It includes examples that apply usability to any type of survey during any stage of development, along with tactics on how to tailor usability testing to meet budget and scheduling constraints. The book's authors distill their experience to provide tips on how usability testing can be applied to paper surveys, mixed-mode surveys, interviewer-administered tools, and additional products. Readers will gain an understanding of usability and usability testing and why it is needed for survey research, along with guidance on how to design and conduct usability tests, analyze and report findings, ideas for how to tailor usability testing to meet budget and schedule constraints, and new knowledge on how to apply usability testing to other survey-related products, such as project websites and interviewer administered tools. - Explains how to design and conduct usability tests and analyze and report the findings - Includes examples on how to conduct usability testing on any type of survey, from a simple three-question survey on a mobile device, to a complex, multi-page establishment survey - Presents real-world examples from leading usability and survey professionals, including a diverse collection of case studies and considerations for using and combining other methods - Discusses the facilities, materials, and software needed for usability testing, including in-lab testing, remote testing, and eye tracking




Handbook of Test Development


Book Description

The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.




Cognitive Interviewing


Book Description

The work provides general guidance about questionnaire design, development, and pre-testing sequence, with an emphasis on the cognitive interview.




Sensory Evaluation Practices


Book Description

Sensory Evaluation Practices examines the principles and practices of sensory evaluation. It describes methods and procedures for the analysis of results from sensory tests; explains the reasons for selecting a particular procedure or test method; and discusses the organization and operation of a testing program, the design of a test facility, and the interpretation of results. Comprised of three parts encompassing nine chapters, this volume begins with an overview of sensory evaluation: what it does; how, where, and for whom; and its origin in physiology and psychology. It then discusses measurement, psychological errors in testing, statistics, test strategy, and experimental design. The reader is also introduced to the discrimination, descriptive, and affective methods of testing, along with the criteria used to select a specific method, procedures for data analysis, and the communication of actionable results. The book concludes by looking at problems where sensory evaluation is applicable, including correlation of instrumental and sensory data, measurement of perceived efficacy, storage testing, and product optimization. This book is a valuable resource for sensory professionals, product development and production specialists, research directors, technical managers, and professionals involved in marketing, marketing research, and advertising.




Asking Questions


Book Description

Since it was first published more than twenty-five years ago, Asking Questions has become a classic guide for designing questionnaires3⁄4the most widely used method for collecting information about people?s attitudes and behavior. An essential tool for market researchers advertisers, pollsters, and social scientists, this thoroughly updated and definitive work combines time-proven techniques with the most current research, findings, and methods. The book presents a cognitive approach to questionnaire design and includes timely information on the Internet and electronic resources. Comprehensive and concise, Asking Questions can be used to design questionnaires for any subject area, whether administered by telephone, online, mail, in groups, or face-to-face. The book describes the design process from start to finish and is filled with illustrative examples from actual surveys.