plotting your coe cients

21
Plotting Your Coefficients Thomas B. Pepinsky Department of Government Cornell University [email protected] April 6, 2015 Pepinsky Coefficient Plots April 6, 2015 1 / 12

Upload: others

Post on 02-May-2022

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Plotting Your Coe cients

Plotting Your Coefficients

Thomas B. Pepinsky

Department of GovernmentCornell University

[email protected]

April 6, 2015

Pepinsky Coefficient Plots April 6, 2015 1 / 12

Page 2: Plotting Your Coe cients

Arguments for Plotting Regression Output

1. Looks neat

2. Is fun to do

3. Necessary for publication

4. Facilitates better communication

Pepinsky Coefficient Plots April 6, 2015 2 / 12

Page 3: Plotting Your Coe cients

Regression Plots Look Neat!

Pepinsky Coefficient Plots April 6, 2015 3 / 12

Page 4: Plotting Your Coe cients

Making Figures Is Fun!

Not a regression plot, but...

0.0, 0.0 0.0, 0.5 0.0, 0.9

0.5, 0.0 0.5, 0.5 0.5, 0.9

3.0, 0.0 3.0, 0.5 3.0, 0.9

0

1

2

3

4

0

2

4

0

2

4

6

0

2

4

6

0

2

4

6

8

0

2

4

6

8

0

5

10

15

20

0

10

20

0

5

10

15

20

0.0 0.5 1.0 1.5 2.0 1.001.251.501.752.00 1.8 1.9 2.0 2.1 2.2

0.0 0.5 1.0 1.5 2.0 2.5 1.0 1.5 2.0 1.8 2.0 2.2

0.0 0.5 1.0 1.5 2.0 1.2 1.6 2.0 1.8 1.9 2.0 2.1 2.2Estimate

dens

ity

Estimator

Lag.X..Lag.Y.

Lag.X..U

Lag.X.

κ by ρ, φ = 0.9

Pepinsky Coefficient Plots April 6, 2015 4 / 12

Page 5: Plotting Your Coe cients

Making Figures Is Fun!

Not a regression plot, but...

σB

σ A

σ β α σ

σβ

ασ

σ*0

ΓA

ΓB

σ*.3

σ*−.5

Pepinsky Coefficient Plots April 6, 2015 4 / 12

Page 6: Plotting Your Coe cients

Making Figures Is Fun!

Kinda like a regression plot...

����

����

���"��

��$��� ��

����

�� $����

�"�

"

����

�����$��

������

����

�������

����

��

����

��

��"��

��"��#

������

"

��"���

���%

���%�

����%�

!%"

���%$"���&�

Pepinsky Coefficient Plots April 6, 2015 4 / 12

Page 7: Plotting Your Coe cients

Coefficient Plots Help You Get Published?

Most recent issues of “top” social science journals

1. APSR: 3 of 9 (1 not a regression)

2. ASR: 0 of 7

3. AER: 0 of 4

4. PR: 1 of 2 (not a regression)

**Note: sample includes all regression and experimental analyses. Calibration/simulation

exercises excluded.

Caveats

1. We don’t know the denominator

2. Signaling value? (like knowing how to make LATEX – see?)

Pepinsky Coefficient Plots April 6, 2015 5 / 12

Page 8: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Model 1 Model 2(Intercept) 20.55∗∗ 20.61∗∗

(6.76) (6.91)Lwid −0.91 −0.92

(0.55) (0.55)Shld −0.31∗∗ −0.31∗∗

(0.09) (0.09)Lane 0.12 0.10

(0.20) (0.32)Len −0.10∗∗ −0.10∗

(0.04) (0.04)Trks −0.28∗ −0.28∗

(0.12) (0.12)ADT 0.00

(0.02)R2 0.54 0.54Adj. R2 0.47 0.45Num. obs. 39 39∗∗∗p < 0.001, ∗∗p < 0.01, ∗p < 0.05

Table: These models were estimated using the highway dataset in the alr3 package (Weisberg

2005).

Pepinsky Coefficient Plots April 6, 2015 6 / 12

Page 9: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Model 1 Model 2(Intercept) 20.55∗∗ 20.61∗∗

(6.76) (6.91)Lwid −0.91 −0.92

(0.55) (0.55)Shld −0.31∗∗ −0.31∗∗

(0.09) (0.09)Lane 0.12 0.10

(0.20) (0.32)Len −0.10∗∗ −0.10∗

(0.04) (0.04)Trks −0.28∗ −0.28∗

(0.12) (0.12)ADT 0.00

(0.02)R2 0.54 0.54Adj. R2 0.47 0.45Num. obs. 39 39∗∗∗p < 0.001, ∗∗p < 0.01, ∗p < 0.05

Table: These models were estimated using the highway dataset in the alr3 package (Weisberg

2005).

Pepinsky Coefficient Plots April 6, 2015 6 / 12

Page 10: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Regression Estimates−2.0 −1.5 −1.0 −0.5 0.0 0.5

lane width, in feet

width in feet ofouter shoulder on

the roadway

total number oflanes of traffic

length of thehighway segment

in miles

average daily trafficcount in thousands

truck volume asa percent of the

total volume

These models were produced using coefplot() from the arm package (Gelman et al. 2014)

Pepinsky Coefficient Plots April 6, 2015 7 / 12

Page 11: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Plots do not add information.

They highlight things differently.

Pepinsky Coefficient Plots April 6, 2015 8 / 12

Page 12: Plotting Your Coe cients

So What Else You Plot?

Different coefplot() (Lander 2015) with the same results...

(Intercept)

Lwid

Shld

Lane

Len

Trks

ADT

0 10 20 30

Value

Coe

ffici

ent

Model

m

m2

Coefficient Plot

Pepinsky Coefficient Plots April 6, 2015 9 / 12

Page 13: Plotting Your Coe cients

So What Else You Plot?

Different coefplot() (Lander 2015) with the same results...

(Intercept)

Lwid

Shld

Lane

Len

Trks

ADT

0 10 20 30

Value

Coe

ffici

ent

Model

m

m2

Coefficient Plot

Pepinsky Coefficient Plots April 6, 2015 9 / 12

Page 14: Plotting Your Coe cients

But Isn’t The Intercept Meaningless?

Consider the following model: Y = α + β1X1 + β2X2 + ε,where α = 1, β1 = 1, β2 = −2, ε ∼ N(0, σ2), X1,X2 ∈ {0, 1}

(Intercept)

x1TRUE

x2TRUE

−2

−1 0 1

Value

Coe

ffici

ent Model

dropx1

dropx2

truemodel

Coefficient Plot

Need both data and theory of DGP to know “intercept is meaningless”

Pepinsky Coefficient Plots April 6, 2015 10 / 12

Page 15: Plotting Your Coe cients

But Isn’t The Intercept Meaningless?

Consider the following model: Y = α + β1X1 + β2X2 + ε,where α = 1, β1 = 1, β2 = −2, ε ∼ N(0, σ2), X1,X2 ∈ {0, 1}

(Intercept)

x1TRUE

x2TRUE

−2

−1 0 1

Value

Coe

ffici

ent Model

dropx1

dropx2

truemodel

Coefficient Plot

Need both data and theory of DGP to know “intercept is meaningless”

Pepinsky Coefficient Plots April 6, 2015 10 / 12

Page 16: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Communication requires Author and Reader share a language. Do we?Let’s test! (cf. Hoestra et al. 2014)

Professor Smedley conducted an experiment.

The outcome of the experiment has a mean of .26, with a 95% C.I. of[.1, .4].

Pepinsky Coefficient Plots April 6, 2015 11 / 12

Page 17: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Communication requires Author and Reader share a language. Do we?Let’s test! (cf. Hoestra et al. 2014)

Professor Smedley conducted an experiment.

The outcome of the experiment has a mean of .26, with a 95% C.I. of[.1, .4].

Pepinsky Coefficient Plots April 6, 2015 11 / 12

Page 18: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Communication requires Author and Reader share a language. Do we?Let’s test! (cf. Hoestra et al. 2014)

Professor Smedley conducted an experiment.

The outcome of the experiment has a mean of .26, with a 95% C.I. of[.1, .4].

Result ●

0.0 0.1 0.2 0.3 0.4 0.5

Pepinsky Coefficient Plots April 6, 2015 11 / 12

Page 19: Plotting Your Coe cients

Coefficient Plots Facilitate Better Communication?

Communication requires Author and Reader share a language. Do we?Let’s test! (cf. Hoestra et al. 2014)

Professor Smedley conducted an experiment.

The outcome of the experiment has a mean of .26, with a 95% C.I. of[.1, .4].

So, how many of the following are true?

1. The probability that the true mean is greater than 0 is at least 95%.

2. The probability that the true mean equals 0 is smaller than 5%.

3. The “null hypothesis” that the true mean equals 0 is likely to be incorrect.

4. There is a 95% probability that the true mean lies between 0.1 and 0.4.

5. We can be 95% confident that the true mean lies between 0.1 and 0.4.

6. If we were to repeat the experiment over and over, then 95% of the time the confidenceintervals contain the true mean.

7. If we were to repeat the experiment over and over, then 95% of the time the true mean fallsbetween 0.1 and 0.4.

Pepinsky Coefficient Plots April 6, 2015 11 / 12

Page 20: Plotting Your Coe cients

Four Edward Tufte Principles

1. “Design cannot rescue failed content.”

2. “Small, noncomparative, highly labeled data sets usually belong intables.”

3. “Analytical designs are not to be decided on their convenience to theuser or necessarily their readability or what psychologists or decoratorsthink about them; rather, design architectures should be decided onhow the architecture assists analytical thinking about evidence”

4. “The minimum we should hope for with any display technology isthat it should do no harm.”

Pepinsky Coefficient Plots April 6, 2015 12 / 12

Page 21: Plotting Your Coe cients

Four Edward Tufte Principles

1. “Design cannot rescue failed content.”

2. “Small, noncomparative, highly labeled data sets usually belong intables.”

3. “Analytical designs are not to be decided on their convenience to theuser or necessarily their readability or what psychologists or decoratorsthink about them; rather, design architectures should be decided onhow the architecture assists analytical thinking about evidence”

4. “The minimum we should hope for with any display technology isthat it should do no harm.”

Pepinsky Coefficient Plots April 6, 2015 12 / 12