Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia


Book Description

The COVID-19 pandemic has spurred interest in the use of remote data collection techniques, including phone surveys, in developing country contexts. This interest has sparked new methodological work focusing on the advantages and disadvantages of different forms of remote data collection, the use of incentives to increase response rates and how to address sample representativeness. By contrast, attention given to associated response fatigue and its implications remains limited. To assess this, we designed and implemented an experiment that randomized the placement of a survey module on women’s dietary diversity in the survey instrument. We also examine potential differential vulnerabilities to fatigue across food groups and respondents. We find that delaying the timing of mothers’ food consumption module by 15 minutes leads to 8-17 percent decrease in the dietary diversity score and a 28 percent decrease in the number of mothers who consumed a minimum of four dietary groups. This is driven by underreporting of infrequently consumed foods; the experimentally induced delay in the timing of mothers’ food consumption module led to a 40 and 11 percent decrease in the reporting of consumption of animal source foods, and fruits and vegetables, respectively. Our results are robust to changes in model specification and pass falsification tests. Responses by older and less educated mothers and those from larger households are more vulnerable to measurement error due to fatigue.




Phone surveillance, from scratch: Novel sample design features of the nationally representative Myanmar Household Welfare Survey (MHWS)


Book Description

The first round of the Myanmar Household Welfare Survey (MHWS)–a nationwide phone panel consisting of 12,100 households–was implemented between December 2021 and February 2022. The objective of the survey was to collect data on a wide range of household and individual welfare indicators–including wealth, livelihoods, unemployment, food insecurity, diet quality, health shocks, and coping strategies–in a country exceptionally hard hit by conflict, severe economic collapse, and several damaging waves of COVID-19. The respondents interviewed in the MHWS were purposely selected from a large phone database aimed at being representative at the region/state level and urban/rural level in Myanmar. In this paper, we discuss two key steps taken to ensure that the MHWS is nationally and subnationally representative at the state/region and urban/rural level. First, we used a quota-based sampling strategy by setting survey quotas for respondents’ geography, education, farming status, gender, and rural/urban residence. This sampling strategy is used to address the well-known drawbacks of phone survey samples (e.g., the over-sampling of more educated respondents) and the survey’s particular interest in over-sampling farm households and equally sampling men and women. Second, we constructed household, population, and individual level weighting factors to further ensure that the survey generates nationally and subnationally representative statistics. To assess the effectiveness of these two strategies on achieving representativeness and consistency with previous surveys, we compare results from the MHWS to earlier nationally representative datasets, focusing on sample sizes of interviewed households for each state/region, and on education levels, farm/non-farm occupation, urban/rural residence, as well as respondents’ housing characteristics, which are unlikely to change substantially over short periods of time. We show that the phone-based MHWS has broader geographical coverage than previous national surveys, reaching 310 of Myanmar’s 330 townships. Moreover, our sampling approach was generally effective in reducing the education bias of phone surveys, except for a handful of states/regions. The MHWS is also unique in providing equal representation of male and female respondents. Additionally, the MHWS sampling and weighting strategies produce statistics on key indicators that closely mirror results from the two most recent national surveys in Myanmar. Overall, the results suggest that these strategies are successful in generating a subnationally representative phone survey that collected data on a rich array of household welfare indicators in exceptionally difficult political and economic circumstances.




COVID-19 and global food security: Two years later


Book Description

Two years after the onset of the COVID-19 pandemic, the health, economic, and social disruptions caused by this global crisis continue to evolve. The impacts of the pandemic are likely to endure for years to come, with poor, marginalized, and vulnerable groups the most affected. In COVID-19 & Global Food Security: Two Years Later, the editors bring together contributions from new IFPRI research, blogs, and the CGIAR COVID-19 Hub to examine the pandemic’s effects on poverty, food security, nutrition, and health around the world. This volume presents key lessons learned on food security and food system resilience in 2020 and 2021 and assesses the effectiveness of policy responses to the crisis. Looking forward, the authors consider how the pandemic experience can inform both recovery and longer-term efforts to build more resilient food systems.




Handbook of Research Methods in Migration


Book Description

In this thoroughly revised and updated second edition, William Allen and Carlos Vargas-Silva bring together a diverse range of experts to explore the latest research methods in migration studies, taking stock of major changes that have been salient for migration research—as well as the social sciences more broadly—in the last decade. Spanning a variety of different methodologies, this second edition of the Handbook of Research Methods in Migration provides practical guidance on designing, completing, and communicating migration research, considering diverse audiences including migrants themselves. This title contains one or more Open Access chapters.




Are we done yet? Response fatigue and rural livelihoods


Book Description

Accurate understanding of peoples’ livelihoods activities is needed to inform effective policy. Existing evidence relies heavily on studies that use designated respondents to provide information about their household members, imposing significant costs on these respondents along with possible distortions in the data. In rural Ghana, we randomize the order that household members are asked about and estimate that response fatigue leads to undercounting of labor activities by 8% on average. Women are twice as impacted as men while youth are four times as impacted as older adults, distorting both within-household and population wide comparisons. These biases result from women and youth being listed systematically later in rosters and stronger effects of fatigue for them, conditional on roster position. The implications of our results extend to other topics of enquiry as well, wherever similar repetitive survey structures are deployed, such as birth records, plot-level inputs, and household consumption and expenditures.




Impacts of COVID-19 on food security: Panel data evidence from Nigeria


Book Description

This paper combines pre-pandemic face-to-face survey data with follow up phone surveys collected in April-May 2020 to quantify the overall and differential impacts of COVID-19 on household food security, labor market participation and local food prices in Nigeria. We exploit spatial variation in exposure to COVID-19 related infections and lockdown measures along with temporal differences in our outcomes of interest using a difference-in-difference approach. We find that those households exposed to higher COVID-19 cases or mobility lockdowns experience a significant increase in measures of food insecurity. Examining possible transmission channels for this effect, we find that COVID-19 significantly reduces labor market participation and increases food prices. We find that impacts differ by economic activities and households. For instance, lockdown measures increased households' experience of food insecurity by 12 percentage points and reduced the probability of participation in non-farm business activities by 13 percentage points. These lockdown measures have smaller impacts on wage-related activities and farming activities. In terms of food security, households relying on non-farm businesses, poorer households, those with school-aged children, and those living in remote and conflicted-affected zones have experienced relatively larger deteriorations in food insecurity. These findings can help inform immediate and medium-term policy responses, including social protection policies aiming at ameliorating the impacts of the pandemic, as well as guide targeting strategies of governments and international donor agencies by identifying the most impacted sub-populations.




Dietary assessment


Book Description

FAO provides countries with technical support to conduct nutrition assessments, in particular to build the evidence base required for countries to achieve commitments made at the Second International Conference on Nutrition (ICN2) and under the 2016-2025 UN Decade of Action on Nutrition. Such concrete evidence can only derive from precise and valid measures of what people eat and drink. There is a wide range of dietary assessment methods available to measure food and nutrient intakes (expressed as energy insufficiency, diet quality and food patterns etc.) in diet and nutrition surveys, in impact surveys, and in monitoring and evaluation. Differenct indicators can be selected according to a study's objectives, sample population, costs and required precision. In low capacity settings, a number of other issues should be considered (e.g. availability of food composition tables, cultural and community specific issues, such as intra-household distribution of foods and eating from shared plates, etc.). This manual aims to signpost for the users the best way to measure food and nutrient intakes and to enhance their understanding of the key features, strengths and limitations of various methods. It also highlights a number of common methodological considerations involved in the selection process. Target audience comprises of individuals (policy-makers, programme managers, educators, health professionals including dietitians and nutritionists, field workers and researchers) involved in national surveys, programme planning and monitoring and evaluation in low capacity settings, as well as those in charge of knowledge brokering for policy-making.




Food data collection in Household Consumption and Expenditure Surveys. Guidelines for low and middle income countries


Book Description

The measurement of food consumption and expenditure is a fundamental component of any analysis of poverty and food security, and hence the importance and timeliness of devoting attention to the topic cannot be overemphasized as the international development community confronts the challenges of monitoring progress in implementing the 2030 Agenda for Sustainable Development. In 2014, the International Household Survey Network published a desk review of the reliability and relevance of survey questions as included in 100 household surveys from low- and middle-income countries. The report was presented in March 2014 at the forty-fifth session of the United Nations Statistical Commission (UNSC), in a seminar organized by the Inter-Agency and Expert Group on Food Security, Agricultural and Rural Statistics (IAEG-AG). The assessment painted a bleak picture in terms of heterogeneity in survey design and overall relevance and reliability of the data being collected. On the positive side, it pointed to many areas in which even marginal changes to survey and questionnaire design could lead to a significant increase in reliability and consequently, great improvements in measurement accuracy. The report, which sparked a lot of interest from development partners and UNSC member countries, prompted IAEG-AG to pursue this area of work with the ultimate objective of developing, validating, and promoting scalable standards for the measurement of food consumption in household surveys. The work started with an expert workshop that took place in Rome in November 2014. Successive versions of the guidelines were drafted and discussed at various IAEG-AG meetings, and in another expert workshop organized in November 2016 in Rome. The guidelines were put together by a joint FAO-World Bank team, with inputs and comments received from representatives of national statistical offices, international organizations, survey practitioners, academics, and experts in different disciplines (statistics, economics, nutrition, food security, and analysis). A list of the main contributors is included in the acknowledgment section. In December 2017 a draft of the guidelines was circulated to 148 National Statistical Offices from low- to high-income countries for comments. The document was revised following that consultation and submitted to UNSC, which endorsed it at its forty-ninth session in March 2018 (under item 3(j) of the agenda, agricultural and rural statistics. The version presented here reflects what was endorsed by the Commission, edited for language. The process received support from the Global Strategy for Agricultural and Rural Statistics. The document is intended to be a reference document for National Statistical Offices, survey practitioners, and national and international agencies designing household surveys that involve the collection of food consumption and expenditure data.







Household food consumption patterns in Addis Ababa, Ethiopia


Book Description

Overweight and obesity are rising rapidly in Ethiopia's urban areas, constituting a major public health concern. Dietary choices can be one of the key drivers of adult body-weight. Using data collected from a large household survey in Addis Ababa, we provide a snapshot of dietary patterns in Ethiopia's largest urban area. We find that starchy staples (cereals, roots, and tubers) are prominent in household food baskets, taking up 25 percent of the food budget and providing more than 50 percent of consumed calories, on average. In contrast, the consumption of all kinds of fruits and vitamin A-rich vegetables is very low. For the average household, meat products account for nearly 18 percent of the food budget but provide only 2 percent of total calories. Richer households consume relatively less starchy staples than poorer households, but more animal-source foods and vegetables. However, the importance of fruits in household diets rises very slowly with household incomes. Together, these findings suggest that further income growth will result in drastic changes in the composition of food demand in Addis Ababa. Considering projections for increasing incomes, especially in urban areas, this will have major implications for agricultural production in rural areas connected to Ethiopia’s cities. There is also an urgent need to design cost-effective public health campaigns to reduce the emerging overweight and obesity crisis in urban Ethiopia.