Survey ordering and the measurement of welfare

Economic policy and research rely on the accurate measurement of welfare. In nearly all instances, measuring welfare requires collecting data via long household surveys. If survey response patterns change over the course of a survey to introduce measurement error, this measurement error can be eithe...

Full description

Bibliographic Details
Main Authors: Rahman, Khanker Wahedur, Bloem, Jeffrey R., Bellemare, Marc F.
Format: Journal Article
Language:Inglés
Published: Cambridge University Press 2025
Subjects:
Online Access:https://hdl.handle.net/10568/175965
_version_ 1855513605464653824
author Rahman, Khanker Wahedur
Bloem, Jeffrey R.
Bellemare, Marc F.
author_browse Bellemare, Marc F.
Bloem, Jeffrey R.
Rahman, Khanker Wahedur
author_facet Rahman, Khanker Wahedur
Bloem, Jeffrey R.
Bellemare, Marc F.
author_sort Rahman, Khanker Wahedur
collection Repository of Agricultural Research Outputs (CGSpace)
description Economic policy and research rely on the accurate measurement of welfare. In nearly all instances, measuring welfare requires collecting data via long household surveys. If survey response patterns change over the course of a survey to introduce measurement error, this measurement error can be either classical (i.e., changing distributions, leading to noise) or non-classical (i.e., changing expectations, leading to bias). We embed an experiment in a survey by randomly assigning a questionnaire with either the assets module near the beginning of the survey or the assets module at the end of the survey, delaying enumeration of assets by about 60 minutes. We find no evidence in the full sample that survey ordering introduces differential response patterns, either in the number of reported assets or the reported value of those assets. In exploratory analysis of heterogeneity, we find evidence of non-classical measurement error due to survey ordering within sub-samples of respondents who (i) are from larger households or (ii) have low levels of education. Our experimental design can be generalized to serve as an ex-post test of data quality with respect to questionnaire length. JEL Codes: C81; C83; I32; O12
format Journal Article
id CGSpace175965
institution CGIAR Consortium
language Inglés
publishDate 2025
publishDateRange 2025
publishDateSort 2025
publisher Cambridge University Press
publisherStr Cambridge University Press
record_format dspace
spelling CGSpace1759652025-12-19T20:32:42Z Survey ordering and the measurement of welfare Rahman, Khanker Wahedur Bloem, Jeffrey R. Bellemare, Marc F. poverty economic policies survey design welfare Economic policy and research rely on the accurate measurement of welfare. In nearly all instances, measuring welfare requires collecting data via long household surveys. If survey response patterns change over the course of a survey to introduce measurement error, this measurement error can be either classical (i.e., changing distributions, leading to noise) or non-classical (i.e., changing expectations, leading to bias). We embed an experiment in a survey by randomly assigning a questionnaire with either the assets module near the beginning of the survey or the assets module at the end of the survey, delaying enumeration of assets by about 60 minutes. We find no evidence in the full sample that survey ordering introduces differential response patterns, either in the number of reported assets or the reported value of those assets. In exploratory analysis of heterogeneity, we find evidence of non-classical measurement error due to survey ordering within sub-samples of respondents who (i) are from larger households or (ii) have low levels of education. Our experimental design can be generalized to serve as an ex-post test of data quality with respect to questionnaire length. JEL Codes: C81; C83; I32; O12 2025-01 2025-08-04T19:56:05Z 2025-08-04T19:56:05Z Journal Article https://hdl.handle.net/10568/175965 en Open Access Cambridge University Press Rahman, Khanker Wahedur; Bloem, Jeffrey; and Bellemare, Marc F. 2025. Survey ordering and the measurement of welfare. Journal of the Economic Science Association 11(1): 127-138. https://doi.org/10.1017/esa.2025.7
spellingShingle poverty
economic policies
survey design
welfare
Rahman, Khanker Wahedur
Bloem, Jeffrey R.
Bellemare, Marc F.
Survey ordering and the measurement of welfare
title Survey ordering and the measurement of welfare
title_full Survey ordering and the measurement of welfare
title_fullStr Survey ordering and the measurement of welfare
title_full_unstemmed Survey ordering and the measurement of welfare
title_short Survey ordering and the measurement of welfare
title_sort survey ordering and the measurement of welfare
topic poverty
economic policies
survey design
welfare
url https://hdl.handle.net/10568/175965
work_keys_str_mv AT rahmankhankerwahedur surveyorderingandthemeasurementofwelfare
AT bloemjeffreyr surveyorderingandthemeasurementofwelfare
AT bellemaremarcf surveyorderingandthemeasurementofwelfare