MEASURING EMPLOYMENT AND CONSUMPTION IN HOUSEHOLD SURVEYS: REFLECTIONS FROM THREE SURVEY EXPERIMENTS

PIM Webinar

July 13, 2021, 10:00-11:00 am EDT

Programs and policies designed to improve the lives of the poor often rely on an understanding of peoples’ livelihoods and welfare that is based on information collected during long, multi-topic household surveys. These survey efforts are invaluable tools for development practitioners, but choices made by those designing these surveys can impact the information collected in ways that are difficult to predict. Increasingly researchers are incorporating experiments into survey work in an effort to better understand these methodological issues. For example, researchers can vary the order of questions to determine impacts of respondent fatigue, or test different versions of the same question to analyze how responses change.

In this webinar, we review three such experiments and reflect upon what we have learned about choices in survey design and what questions still remain. The experiments include an analysis of how respondent fatigue related to repeated questions affects labor measurement in rural Ghana, how the placement of the dietary module affects dietary diversity estimates in a phone survey in Ethiopia, and finally how different ways of defining reference periods changes responses in a food consumption module, also in Ethiopia.

Presentations:

• Are we done yet? Response fatigue and rural livelihoods (Sylvan Herskowitz, Research Fellow, IFPRI)
• Assessing response fatigue in phone survey: Experimental evidence on dietary diversity in Ethiopia (Kibrom Abay, Research Fellow, IFPRI)
• Telescoping causes overstatement in recalled food consumption: Evidence from a survey experiment in Ethiopia (Kalle Hirvonen, Senior Research Fellow, IFPRI)

Discussant: Andrew Dillon, Clinical Associate Professor of Development Economics within Kellogg's Public-Private Interface Initiative (KPPI); Director of Research Methods Cluster in the Global Poverty Research Lab, Northwestern University.

Moderator: Kate Ambler, Research Fellow, International Food Policy Research Institute (IFPRI).

Related reading:

Ambler, Kate; Herskowitz, Sylvan; and Maredia, Mywish. 2020. Are we done yet? Response fatigue and rural livelihoods. IFPRI Discussion Paper 1980. Washington, DC: International Food Policy Research Institute (IFPRI).

Abay, Kibrom A.; Berhane, Guush; Hoddinott, John; Hirfrfot, Kibrom Tafere. 2021. Assessing Response Fatigue in Phone Surveys: Experimental Evidence on Dietary Diversity in Ethiopia. Policy Research working paper no. WPS 9636 Washington, D.C.: World Bank Group.

Abate, Gashaw Tadesse; de Brauw, Alan; Gibson, John; Hirvonen, Kalle; and Wolle, Abdulazize. 2020. Telescoping causes overstatement in recalled food consumption: Evidence from a survey experiment in Ethiopia. IFPRI Discussion Paper 1976. Washington, DC: International Food Policy Research Institute (IFPRI).

PIM Webinars aim to share findings of PIM’s research, discuss their application, and get feedback and suggestions from participants. Webinars are conducted by PIM researchers in the form of research seminars. Each webinar is a live event which includes presentation(-s) and a facilitated Q&A session. See recordings of all previous webinars here. 

If you wish to receive alerts about our future webinars, please subscribe here.

Photo: ILRI/Camille Hanotte