easier said than done: open problems in multilevel ...gelman/presentations/mrp_talk.pdfsurvey...

28

Upload: others

Post on 26-Apr-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 2: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 3: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 4: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 5: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 6: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 7: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Observed data

−4 −2 0 2 4

Page 8: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Imputed data−−Missing completely at random

−4 −2 0 2 4

Page 9: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Imputed data−−Fitted normal model

−4 −2 0 2 4

Page 10: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

−4 −2 0 2 4 −4 −2 0 2 4

−4 −2 0 2 4 −4 −2 0 2 4

Imputed data−−Various assumptions

Page 11: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 12: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Easier Said Than Done: Open Problems inMultilevel Regression and Poststratification

Andrew Gelman

Department of Statistics and Department of Political ScienceColumbia University, New York

Conference in honor of Rod Little, 31 Oct 2015

Page 13: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

From Wikipedia:

Page 14: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 15: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 16: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 17: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Survey response rates are going through the floor!R

espo

nse

rate

1940 1960 1980 2000

0%20

%40

%60

%80

%10

0%

Year

Page 18: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Survey response rates are going through the floor!R

espo

nse

rate

1940 1960 1980 2000

0%20

%40

%60

%80

%10

0%

Year

Page 19: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

The poststratification identity

θ =

∑Jj=1 Njθj∑Jj=1 Nj

Page 20: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

The poststratified estimate

θ̂ =

∑Jj=1 Nj θ̂j∑Jj=1 Nj

Page 21: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 22: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 23: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 24: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%
Page 25: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Xbox estimates, adjusting for demographics:

Page 26: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Xbox estimates, adjusting for demographics and partisanship:

Page 27: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Why multilevel regression?

Page 28: Easier Said Than Done: Open Problems in Multilevel ...gelman/presentations/mrp_talk.pdfSurvey response rates are going through the floor! Response rate 1940 1960 1980 2000 0% 20% 40%

Open problems in MRP

I Deep interactionsI Non-census variablesI Survey weightsI Cluster samplingI Estimating regression coefficientsI Building trust in results