![Page 1: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/1.jpg)
Small-Area Estimation of Ineligible Sample Units in a Household Sample Frame
Josué De La Rosa, U.S. Census Bureau Timothy Kennel, U.S. Census Bureau
American Association for Public Opinion Research
Annual Conference May 15-18, 2014 Anaheim, CA
![Page 2: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/2.jpg)
Disclaimer This report is released to inform interested
parties of (ongoing) research and to encourage discussion (of work in progress). Any views expressed on (statistical,
methodological, technical, or operational) issues are those of the author(s) and not necessarily those of the U.S. Census Bureau.
2
![Page 3: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/3.jpg)
Research Question Does a county level model improve the
accuracy (i.e., lower MSE) of the predicted ineligible rate for small areas compared to a state level model?
3
![Page 4: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/4.jpg)
Overview Introduction to Overcoverage Implications of Estimating Overcoverage Comparison of Methods of Estimating
Overcoverage Results Discussion
4
![Page 5: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/5.jpg)
Overcoverage Error
Overcoverage – Inclusion of Ineligible Units in Sample Frame Ineligible Unit = Census Term Type B or C
Noninterview
Groves, R. M. (2009). Target Populations, Sampling Frames, and Coverage Error. Survey methodology (2nd ed., p. 76). Hoboken, N.J.: Wiley.
5
![Page 6: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/6.jpg)
Ineligible Units
U.S. Census Bureau, (2006). Design and Methodology: Current Population Survey, Technical Paper 66, October 2006, http://www.census.gov/prod/2006pubs/tp-66.pdf.
6
Examples of Household Frame Ineligibles Vacant Demolished House Trailer Moved Condemned Converted to Business or Storage Unit
![Page 7: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/7.jpg)
Why Estimate Overcoverage Level of Precision Influences Sample Size Sampling Ineligible Units Reduces Effective
Sample Size Estimated Overcoverage Influences Sampling
Rate
Desired Sample Size + Ineligible Units = Units Sent out for Interview
7
![Page 8: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/8.jpg)
Background 2000 Sample Design (Legacy Method): Assume Ineligibles Homogeneous Across Counties Calculate 12 Month State Mean Ineligible Rate Apply State Mean to Each County
8
![Page 9: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/9.jpg)
Methodology Binomial Stepwise Regression Model Predict Ineligible Rate at the County Level Covariates Data Sources: Lag + 2 County Ineligible Rate Lag + 2 USPS County Administrative Data Lag + 2 ACS County Demographic Data
9
STATS::GLM Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
![Page 10: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/10.jpg)
Data 2010 Current Population Survey Data for
California Estimate 2012 Ineligible Rate Weighted Means Square Error
Biemer, P. P. (2010). Total Survey Error: Design, Implementation, and Evaluation. Public Opinion Quarterly, 74(5), 817-848.
10
![Page 11: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/11.jpg)
11
Weighted 2012 County MSE = 31586.77
Legacy Method
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
0 5 10 15 20 25 30 35 40
Inel
igib
le R
ate
Observations
2012 Ineligible CA Rates Observed and State Mean
Observed 2012 Inelgible Rate 2010 State Mean
![Page 12: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/12.jpg)
Model Diagnostics
12
![Page 13: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/13.jpg)
13
Weighted 2012 County MSE = 5092.30
Model Estimate
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
0 5 10 15 20 25 30 35 40
Inel
igib
le R
ate
Observations
2012 Ineligible CA Rates Observed and Model Estimates
Observed 2012 Inelgible Rate Model Estimate
![Page 14: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/14.jpg)
Legacy and Model
14
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
0 5 10 15 20 25 30 35 40
Inel
igib
le R
ate
Observations
2012 Ineligible CA Rates Observed, State mean and Model Estimates
Observed 2012 Inelgible Rate Model Estimate 2010 State Mean
![Page 15: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/15.jpg)
Conclusion Weighted MSE State Model 31586.77 County Model 5092.30
Model Reduces Ineligible Prediction Error Compared to State Average Frame Ineligible Rate Heterogeneous Across
Counties
15
![Page 16: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/16.jpg)
Neighborhood Foreclosures
16
![Page 17: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/17.jpg)
Discussion Model’s Cost and Quality Implications Sophisticated Models Tract or Block level Models Geospatial Model (e.g., Kriging) Time Series Model
17
![Page 18: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/18.jpg)
Acknowledgments Coauthor Timothy Kennel Michel Tzen, Matthew Neiman, Robert
Sanders & Reid Rottach Reviewers
18
![Page 19: Small-Area Estimation of Ineligible Sample Units in a ... · Josué De La Rosa, U.S. Census Bureau . Timothy Kennel, U.S. Census Bureau . American Association for Public Opinion Research](https://reader034.vdocuments.mx/reader034/viewer/2022043000/5f77563f145cd146be53b03c/html5/thumbnails/19.jpg)
Questions If there are any questions about this presentation, I can be reached at: [email protected]
19