American Community Survey Response Rates
Covid and government shutdowns have decreased survey response rates, affecting the quality of data on American households and communities.
American Community Survey response rates
Housing units
Source: U.S. Census Bureau.
Survey research and, most glaringly, political polls have become less reliable and predictive in recent years due to declining response rates, and the fact those who do respond may be different than those who do not.1,2,3 One survey of such size and mandate that it should not suffer from these issues is the American Community Survey (ACS), aptly described by new Census Bureau Director Robert Santos as “a national treasure.” However, the response rate was so low in 2020, that the Census Bureau concluded the results did not meet statistical quality standards, and published the data only at the state level, marking it “experimental.”
The ACS is the source of the most accurate, up-to-date and detailed information about U.S. communities of any size. The nation’s largest household survey, with more than 2 million households responding per year, should be well-positioned to consistently collect reliable data. Indeed, its response rate has typically been well over 90 percent. But the unique challenge of the coronavirus pandemic (and to a lesser degree the 2013 and 2019 government shutdowns) pushed ACS response rates lower, particularly among lower-income households.4,5
Because disasters accelerate pre-existing trends, overall survey response rates may continue to drop and the likelihood of lower-income households and other consistently-missed populations responding may remain diminished, requiring weighting and sample enlargement, as well as overdue investment in data infrastructure.
“Polling Problems and Why We Should Still Trust (Some) Polls”. Clinton. Vanderbilt. January, 2021. https://www.vanderbilt.edu/unity/2021/01/11/polling-problems-and-why-we-should-still-trust-some-polls/
“Internet Surveys”. Pew Research Center. https://www.pewresearch.org/politics/methodology/collecting-survey-data/internet-surveys/
“Nonresponse Bias: Explanation & Examples”. Zach. Statology.org. May, 2019. https://www.statology.org/nonresponse-bias/
“An Overview of Addressing Nonresponse Bias in the American Community Survey During the COVID-19 Pandemic Using Administrative Data”. Rothbaum, Eggleston, Bee, Klee, and Mendez-Smith. U.S. Census Bureau. November, 2021. https://www.census.gov/newsroom/blogs/random-samplings/2021/11/nonresponse-acs-covid-administrative-data.html
“Addressing Nonresponse Bias in the American Community Survey During the COVID-19 Pandemic Using Administrative Data”. Rothbaum, Eggleston, Bee, Klee, and Mendez-Smith. U.S. Census Bureau. November, 2021. https://www.census.gov/library/working-papers/2021/acs/2021_Rothbaum_01.html