examples

2
1 Example for the t-distribution Consider the simple linear regression model y t = α + βx t + σ² t , t =1, 2,... 7 where ² t 7 and data as provided in Bedard et al. (2007): x -3 -2 -1 0 1 2 3 y -2.68 -4.02 -2.91 0.22 0.38 -0.28 0.03 Suppose interest is on the scalar parameter β . The maximum likelihood estimate ˆ β is obtained as 0.6504. Table 1 below reports the p-values for testing various values of β using four different meth- ods. The two first-order methods represent the typical maximum likelihood departure reported in statistical packages which is denoted as MLE and the log-likelihood ratio in (2) which is denoted as LR. The two third-order p-values are obtained by using the Lugannani and Rice expression in (12) and the Barndorff-Nielsen expression given in (13). Table 1: P-values for the t Distribution Method β =0 β =0.5 β =1.0 β =1.5 β =2.0 MLE 0.0003 0.2179 0.0350 5.33e-06 1.33e-12 LR 0.0035 0.2152 0.0577 0.0015 8.30e-05 Lugannani and Rice 0.0129 0.2349 0.1061 0.0076 0.0010 Barndorff-Nielsen 0.0124 0.2349 0.1052 0.0072 0.0009 Testing a null hypothesis of β = 1 would yield very different conclusions depending on the chosen significance level of the test. Using the conventional 5% level of significance would lead one to reject the null using the conventional MLE p-value while not rejecting the null using the LR test or either of the third-order p-values. If however, a 10% level of significance was chosen, one would reject the null using either of the two first-order p-value but fail to reject the null using either of the third-order p-values. 1

Upload: alejandro-sanhueza

Post on 13-May-2017

225 views

Category:

Documents


4 download

TRANSCRIPT

1 Example for the t-distribution

Consider the simple linear regression model

yt = α + βxt + σεt, t = 1, 2, . . . 7

where ε ∼ t7 and data as provided in Bedard et al. (2007):

x -3 -2 -1 0 1 2 3

y -2.68 -4.02 -2.91 0.22 0.38 -0.28 0.03

Suppose interest is on the scalar parameter β. The maximum likelihood estimate β̂ is obtained as

0.6504. Table 1 below reports the p-values for testing various values of β using four different meth-

ods. The two first-order methods represent the typical maximum likelihood departure reported in

statistical packages which is denoted as MLE and the log-likelihood ratio in (2) which is denoted

as LR. The two third-order p-values are obtained by using the Lugannani and Rice expression in

(12) and the Barndorff-Nielsen expression given in (13).

Table 1: P-values for the t Distribution

Method β = 0 β = 0.5 β = 1.0 β = 1.5 β = 2.0

MLE 0.0003 0.2179 0.0350 5.33e-06 1.33e-12

LR 0.0035 0.2152 0.0577 0.0015 8.30e-05

Lugannani and Rice 0.0129 0.2349 0.1061 0.0076 0.0010

Barndorff-Nielsen 0.0124 0.2349 0.1052 0.0072 0.0009

Testing a null hypothesis of β = 1 would yield very different conclusions depending on the chosen

significance level of the test. Using the conventional 5% level of significance would lead one to

reject the null using the conventional MLE p-value while not rejecting the null using the LR test

or either of the third-order p-values. If however, a 10% level of significance was chosen, one would

reject the null using either of the two first-order p-value but fail to reject the null using either of

the third-order p-values.

1

2 Example for the Pareto distribution

Consider the Pareto distribution given in Section 5 for inference concerning the parameter β.

Using a data set consisting of 50 observations, the maximum likelihood estimate is estimated as

β̂ = 1.256. Table 2 below contains the p-values for testing various values of β using the four

different methods.

Table 2: P-values for the Pareto Distribution

Method β = 0 β = 0.5 β = 1.0 β = 1.5 β = 2.0

MLE 0.0000 0.0000 0.0039 0.0056 4.96e-15

LR 0.0000 0.0000 0.0034 0.0088 2.78e-09

Lugannani and Rice 0.0000 0.0000 0.0362 0.0975 2.11e-08

Barndorff-Nielsen 0.0000 0.0000 0.0308 0.0791 2.05e-08

Once again, it is clear from this table that different conclusions can be reached depending on

which method is employed for inference. For a null of β = 1.5, the first-order methods reject the

hypothesis while the third-order methods do not reject the hypothesis at the conventional 5% level

of significance.

2