econometrics and decision theorydirectory.umm.ac.id/data elmu/jurnal/j-a/journal of...journal of...

29
Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department of Economics, Harvard University, Cambridge, MA 02138, USA Abstract The paper considers the role of econometrics in decision making under uncertainty. This leads to a focus on predictive distributions. The decision maker's subjective distribu- tion is only partly speci"ed; it belongs to a set S of distributions. S can also be regarded as a set of plausible data-generating processes. Criteria are needed to evaluate procedures for constructing predictive distributions. We use risk robustness and minimax regret risk relative to S. To obtain procedures for constructing predictive distributions, we use Bayes procedures based on parametric models with approximate prior distributions. The priors are nested, with a "rst stage that incorporates qualitative information such as exchangeability, and a second stage that is quite di!use. Special points in the parameter space, such as boundary points, can be accommodated with second-stage priors that have one or more mass points but are otherwise quite di!use. An application of these ideas is presented, motivated by an individual's consumption decision. The problem is to construct a distribution for that individual's future earnings, based on his earnings history and on a longitudinal data set that provides earnings histories for a sample of individuals. ( 2000 Elsevier Science S.A. All rights reserved. JEL classixcation: C23; C44 Keywords: Expected utility; Predictive distribution; Risk robustness; Minimax regret; Bayes procedure; Longitudinal data * Corresponding author. Tel.: (617) 495-1869; fax: (617) 495-8570. E-mail address: gary } chamberlain@harvard.edu. (G. Chamberlain) 0304-4076/00/$ - see front matter ( 2000 Elsevier Science S.A. All rights reserved. PII: S 0 3 0 4 - 4 0 7 6 ( 9 9 ) 0 0 0 3 9 - 1

Upload: others

Post on 09-Nov-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Journal of Econometrics 95 (2000) 255}283

Econometrics and decision theory

Gary Chamberlain*

Department of Economics, Harvard University, Cambridge, MA 02138, USA

Abstract

The paper considers the role of econometrics in decision making under uncertainty.This leads to a focus on predictive distributions. The decision maker's subjective distribu-tion is only partly speci"ed; it belongs to a set S of distributions. S can also be regardedas a set of plausible data-generating processes. Criteria are needed to evaluate proceduresfor constructing predictive distributions. We use risk robustness and minimax regret riskrelative to S. To obtain procedures for constructing predictive distributions, we useBayes procedures based on parametric models with approximate prior distributions. Thepriors are nested, with a "rst stage that incorporates qualitative information such asexchangeability, and a second stage that is quite di!use. Special points in the parameterspace, such as boundary points, can be accommodated with second-stage priors thathave one or more mass points but are otherwise quite di!use. An application of theseideas is presented, motivated by an individual's consumption decision. The problem is toconstruct a distribution for that individual's future earnings, based on his earningshistory and on a longitudinal data set that provides earnings histories for a sample ofindividuals. ( 2000 Elsevier Science S.A. All rights reserved.

JEL classixcation: C23; C44

Keywords: Expected utility; Predictive distribution; Risk robustness; Minimax regret;Bayes procedure; Longitudinal data

*Corresponding author. Tel.: (617) 495-1869; fax: (617) 495-8570.

E-mail address: gary}[email protected]. (G. Chamberlain)

0304-4076/00/$ - see front matter ( 2000 Elsevier Science S.A. All rights reserved.PII: S 0 3 0 4 - 4 0 7 6 ( 9 9 ) 0 0 0 3 9 - 1

Page 2: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

1. Portfolio choice

Consider an individual making a portfolio choice at date ¹ involving twoassets. The (gross) returns at t per unit invested at t!1 are y

1tand y

2t. The

individual has observed these returns from t"0 to t"¹. He has also observedthe values of the variables y

3t,2, y

Kt, which are thought to be relevant in

forecasting future returns. So the information available to him when he makeshis portfolio choice is z,M(y

1t,2, y

Kt)NT

t/0. He invests one unit, divided be-

tween an amount a in asset one and 1!a in asset two, and then holds on tothe portfolio until date H. Let w"M(y

1t, y

2t)NH

t/T`1and let h(w, a) denote the

value of the portfolio at t"H:

h(w, a)"aH<

t/T`1

y1t#(1!a)

H<

t/T`1

y2t.

How should a be chosen?The standard approach to this problem in the microeconomics of optimal

behavior under uncertainty is based on maximizing expected utility. Supposethat the investor regards (z, w) as the outcome of the random variable (Z, =)with distribution Q, and that his utility function is u. Then the problem is tochoose a decision rule d that maps observations z into actions a:

maxd

EQ[u(h(=, d(Z)))]. (1)

Suppose that an econometrician is advising this individual. What role mightthe econometrician play? Given the utility function u and the distribution Q, allthat remains is to "nd the optimal solution to (1). The econometrician cancertainly be helpful in that task, but I am more interested in the speci"cation ofthe distribution Q. In particular, given a speci"cation for part of Q, is there usefuladvice on how the rest of Q might be chosen?

Section 2 sets up a framework for examining this question and makesconnections with the literature. The estimation of parameters is not the primarygoal, and parametric models are not introduced until Section 3. Section 4 pro-vides an application motivated by an individual's consumption decision. Theproblem is to construct a distribution for that individual's future earnings, basedon his earnings history and on a longitudinal data set that provides the earningshistories for a sample of other individuals.

2. Framework

Consider an individual making a decision under uncertainty. Various systemsof axioms for rational behavior imply that he should act as if he were maximiz-ing expected utility. See Savage (1954), Anscombe and Aumann (1963), and

256 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 3: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Ferguson (1967). Suppose that he will observe the outcome z of a randomvariable Z before making his choice, and that the payo! he receives given actiona depends upon a random variable =, whose outcome w is not known whenhe makes his choice. Let h(w, a) denote this (known) payo! function. Let Qdenote the distribution of (Z, =), and let u denote the utility function. Bothu and Q are taken as given at this point; they are implied by the individual'spreferences, provided the preferences satisfy the rationality axioms. Weshall refer to Q as the individual's subjective (or personal) distribution. Letm(w, a)"u(h(w, a)) denote the utility of the payo! if="w and a is chosen. Sothe individual faces the following problem:

maxd|D

EQ[m(=, d(Z))],

with

EQ[m(=, d(Z))]"Pm(w, d(z)) dQ(z, w).

The decision rule d is a mapping fromZ, the range of Z, to A, the set of possibleactions; D is the set of all such mappings. (We can avoid measurability andintegrability issues by taking the range of (Z, =) to be a "nite set.)

Decompose the joint distribution Q into the marginal distribution Q1

forZ and the conditional distribution Q

2for= given Z:

EQ[m(=, d(Z))]"PCPm(w, d(z)) dQ

2(w D z)DdQ

1(z).

We shall refer to the conditional distribution Q2( ) D z) as the conditional predic-

tive distribution. Note that

Pm(w, d(z)) dQ2(w D z))sup

a|APm(w, a) dQ

2(w D z),

which implies that

EQ[m(=, d(Z))])PCsup

a|APm(w, a) dQ

2(w D z)DdQ

1(z).

We shall assume that the supremum of the inner integral is in fact obtained forsome action a3A. Then the optimal decision rule d

Qsatis"es

dQ(z)"argmax

a|APm(w, a) dQ

2(w D z).

The optimal action maximizes the conditional expectation of utility giventhe observation z. See Wald (1950, Chapter 5.1), Blackwell and Girshick(1954, Chapter 7.3), and Ferguson (1967, Chapter 1.8). Note that this argument

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 257

Page 4: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

relies upon there being no restrictions on the form of the decision rule, i.e., norestrictions on the set D of mappings from Z to A.

2.1. Frequentist evaluation

This framework has the virtue of being consistent with axioms of rationalbehavior. A di!erent criterion is that the decision rule d should have goodproperties in repeated samples. Suppose that these repeated samples are inde-pendent draws M(Z(j), =(j))NJ

j/1, each distributed according to Q0. We shall refer

to Q0 as the data-generating process (DGP). De"ne the risk function r:

r(Q, d)"!Pm(w, d(z)) dQ(z, w).

When evaluated at the DGP, the risk function provides a frequentist perfor-mance criterion that corresponds to (the negative of) long-run average utility: bythe law of large numbers,

r(Q0, d)"! limJ?=

1

J

J+j/1

m(=(j), d(Z(j)))

with probability one (under Q0).Since d

Qis chosen to minimize r(Q, d), it follows immediately that d

Qis

optimal in a frequentist sense if Q is the DGP. This optimality property isnoteworthy because it is not a large-sample approximation; it is exact. The lawof large numbers provides an interpretation of risk in terms of long-run averageutility, as the number of repeated samples J tends to in"nity. But the riskmeasure itself is based on an observation vector z of "xed dimension, corre-sponding to a "xed sample size.

The "nite-sample optimality of dQ

suggests asking whether dQ

might be nearlyoptimal for some set of DGP's. We shall formalize this idea as follows: a decisionrule d is S-e risk robust if

supQ|SCr(Q, d)! inf

d{|Dr(Q, d@)D(e

for some e'0. The decision rule dQ

0 minimizes risk, and hence maximizeslong-run average utility; it is not feasible, however, unless the DGP Q0 is known.A decision rule that is S-e risk robust has risk within e of this ideal, as long asthe DGP is in the set S. For small e, such a rule is very attractive under thefrequentist criterion. We shall refer to r(Q, d)!inf

d{r(Q, d@) as the regret risk.

The minimax bound for the set S is

b(S),infd|D

supQ|SCr(Q, d)! inf

d{|Dr(Q, d@)D.

258 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 5: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

An S-e robust rule exists for e'b(S). This suggests searching for a minimaxdecision rule that attains the minimax bound.

Minimax arguments played a major role in Wald's (1950) development ofstatistical decision theory. Savage (1954, Chapters 9.7, 9.8) stressed the use ofwhat we have called regret risk and argued that any motivation for the minimaxprinciple depends upon the minimax bound being quite small. Robbins (1964)considered minimizing the maximum Bayes risk relative to a class of priordistributions in his development of the empirical Bayes approach to statisticaldecision problems.

2.2. Partial specixcation for Q

Our rational decision maker is characterized by a utility function u anda distribution Q. Suppose now that Q is only partly speci"ed, and we are tryingto provide guidance on specifying the rest of Q. The partial speci"cation is thatQ3S. The decision maker could be more speci"c, but that would be costly.

Consider using a decision rule d that is S-e risk robust. Note that here S isa set of distributions for (Z, =) that contains the decision maker's subjectivedistribution. In Section 2.1 on frequentist evaluation, S was a set of distribu-tions for (Z, =) that contained the DGP.

Let v(Q, a, z) denote the conditional expected utility under distribution Q ofaction a given observation z:

v(Q, a, z)"Pm(w, a) dQ2(w D z).

Note that this is maximized by the action dQ(z). If the decision maker bore the

cost of specifying a single subjective distribution Q, then his action uponobserving z would be d

Q(z), which would provide conditional expected utility of

v(Q, dQ(z), z). We cannot claim that the proposed decision rule d provides

conditional expected utility that is close to this optimum value, for this particu-lar observation z. It is true that d comes within e of the optimum when averagedover the distribution of the observation:

P[v(Q, dQ(z), z)!v(Q, d(z), z)] dQ

1(z)"r(Q, d)!r(Q, d

Q)(e, (2)

provided that Q3S. The decision maker may "nd this a persuasive argumentfor using d, if e is su$ciently small and if the cost of fully specifying Q issu$ciently large. The weakness in the argument is that the observation z willbe known when the decision is made, and so averaging over the distribution ofthe observation is problematic. Here the averaging is with respect to a subjec-tive distribution, but the failure to condition on the observation is the basiclimitation of a frequentist criterion.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 259

Page 6: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

To pursue this issue of conditioning on the observation, we shall say that thedecision rule d is S-e posterior robust at z if

supQ|S

[v(Q, dQ(z), z)!v(Q, d(z), z)](e.

Note that posterior robustness depends upon the observation z. If posteriorrobustness holds for every observation z, then integrating over the distributionof Z as in (2) implies that d is S-e risk robust. I am particularly interested incases where the set S of subjective distributions is so rich that posteriorrobustness is not attainable, and the decision maker is not necessarily willing tobear the cost of narrowing S to obtain posterior robustness. Then risk robust-ness may have a useful role to play in decision making.

From a somewhat di!erent perspective, an analysis based on a single decisionrule that is S-e risk robust may be of interest to a number of decision makers,provided that their subjective distributions Q are all in S.

Good (1952) considers a set of subjective distributions (Q3S in our notation)and argues that a minimax solution is reasonable provided that only reasonablesubjective distributions are entertained. Berger (1984) refers to risk robustnessas procedure robustness, and he reviews the related literature on C-minimaxand C-minimax regret criteria. I have found Morris (1983a, b) on parametricempirical Bayes methods to be particularly relevant. There are surveys of workon posterior robustness in Berger (1984, 1990, 1994) and in Wasserman (1992).

I have used the cost of specifying a subjective distribution as the motivationfor considering a set S of such distributions. But I have not included this cost ina formal theory of decision making. One possibility is that the individual hasa fully speci"ed distribution Q, and he can either purchase additional informa-tion before making his terminal decision, or make the decision without theadditional information. Suppose that the additional information is the valuew1

of=1

(the "rst component of=), which, for some cost, can be known whenthe individual makes his terminal decision. He can calculate the action thatmaximizes expected utility conditional on Z"z and =

1"w

1, and the opti-

mized expected utility, net of the cost, corresponding to this action. Then thepreposterior integral over w

1, based on the conditional distribution of=

1given

Z"z, gives the expected utility from behaving optimally if he purchases =1.

This can be compared with the expected utility of behaving optimally withoutthe purchase of=

1, in order to decide whether or not to acquire the additional

information. This analysis "ts into the standard framework of expected utilitymaximization, and it does not lead to a consideration of risk robustness (orposterior robustness).

Now suppose that the additional information comes from introspection, orfrom consulting with others (and drawing upon their introspection). We couldstill model this as acquiring, at some cost, the value of a component of=. If theindividual has a joint distribution for (Z, =), then this sequential decision

260 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 7: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

problem, in which the individual can &improve' his subjective distribution, again"ts into the standard framework. The idea here is that the individual always hasa fully speci"ed subjective distribution Q, although it may be hastily construc-ted. Instead of trying to work with a set S of distributions, he faces the choicebetween making a terminal decision based on this Q or of acquiring additionalinformation. This choice "ts into the standard framework of expected utilitymaximization. It does, however, require that the individual do the preposterioranalysis, which requires specifying the possible outcomes of the additionalintrospection, maximizing conditional on these outcomes (and on z), and thenintegrating over the resulting maximized expected utilities. This calculation mayitself be costly, in which case the individual may be attracted to a risk robustdecision rule.

Manski (1981) adopted a di!erent formulation for including the cost ofspecifying a subjective distribution. The decision maker does not have a com-pletely speci"ed distribution Q for (Z, =), but only assigns probabilities to thesets in some partition of the range of (Z, =). At some cost, he can re"ne thepartition and assign probabilities to additional sets. Manski argues (p. 63): `Itseems useless in this context to seek an optimal solution to the decision maker'sproblem. As Simon (1957) properly points out, when the process of solving anidealized optimization problem is costly, the process of solving the respeci"edoptimization problem which makes these costs explicit will generally be evenmore costlya.

3. Parametric models

Suppose that the subjective distribution Q has a mixture form

Q(A]B)"PH

Ph(A]B) dn(h),

where n is a (prior) probability distribution on the parameter space H. Theprobability distribution Ph can be decomposed into a marginal distributionFh for Z and a conditional distribution Gh for = given Z:

Ph(A]B)"PA

Gh(B D z) dFh(z).

We shall assume that Fh has density f (z D h) with respect to the measure j:

Fh(A)"PA

f (z D h) dj(z)

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 261

Page 8: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

for all h3H. Then we have

Q(A, B)"PHCPAGh(B D z) f (z D h) dj(z)Ddn(h)

"PACPH

Gh(B D z) dn6 (h D z)Dq1(z) dj(z),

where n6 denotes the (posterior) distribution of h conditional on Z:

n6 (C D z)"[q1(z)]~1P

C

f (z D h) dn(h),

and q1(z)":H f (z D h) dn(h) is the density of Q

1with respect to j. Hence, the

conditional predictive distribution for= is

Q2(B D z)"PH

Gh(B D z) dn6 (h D z).

3.1. Nested prior

Suppose that the prior distribution n is itself a mixture:

n(C)"PW

ot(C) d/(t).

A prior distribution with this nested form is sometimes referred to as a &hier-archical prior'. We can regard / as a prior distribution on W, and the parametert is sometimes referred to as a &hyperparameter'. This nested form for n impliesan alternative mixture representation for Q:

Q(A]B)"PW

PHt(A]B) d/(t),

where

PHt(A]B)"PH

Ph(A]B) dot(h).

The probability distribution PHt can be decomposed into a marginal distributionFHt for Z and a conditional distribution GHt for = given Z:

PHt(A]B)"PA

GHt(B D z) dFHt(z),

262 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 9: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

where

GHt(B D z)"PH

Gh(B D z) do6 t(h D z),

FHt(A)"PH

Fh(A) dot(h),

o6 is the posterior distribution of h conditional on t:

o6 t(C D z)"[ f H(z D t)]~1PC

f (z D h) dot(h),

and f H(z D t) is the density of FHt with respect to the measure j:

f H(z D t)"PH

f (z D h) dot(h).

Let /M denote the posterior distribution of t conditional on Z:

/M (C D z)"PC

f H(z D t) d/(t)NPW

f H(z D t) d/(t).

Then the conditional predictive distribution for= can be expressed as

Q2(B D z)"PW

GHt(B D z) d/M (t D z).

We can refer to f (z D h) as the likelihood function with n as the prior distribu-tion. Or we can refer to f H(z D t) as the likelihood function with / as the priordistribution. The likelihood-prior distinction is #exible.

3.2. Partial specixcation for Q

Now suppose that Q is only partly speci"ed: Q3S. One possibility is thatMPHt: t3WN is given, but there is a set C of possible prior distributions on W.Then the set of subjective distributions for the observables (Z, =) isS"MQ(: /3CN, where Q(":PHt d/(t). The risk robustness criterion can bewritten as

sup(|CCr(Q(, d)! inf

d{|Dr(Q(, d@)D(e.

Our goal is a decision rule d that is S-e risk robust. We shall focus onspecifying an approximate prior /

!such that the corresponding Bayes rule

d!"dQ(! is risk robust. The approximate prior need not be an element of C. One

strategy is to try a uniform prior as the approximate prior and then check

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 263

Page 10: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

robustness. If the sample observation z is su$ciently informative relative to theactual prior /, then the posterior distribution for t based on the approximate,uniform prior will be similar to the posterior distribution based on the actualprior. This corresponds to the case of stable estimation in Edwards et al. (1963):`To ignore the departures from uniformity, it su$ces that your actual priordensity change gently in the region favored by the data and not itself toostrongly favor some other regiona. If Q assigns high probability to such informa-tive samples, then the risk r(Q, d!) of our procedure will be close to the optimumr(Q, d

Q). If this holds for all of the distributions Q in S, then the rule

d! corresponding to the uniform prior /!is risk robust.

Special points in the parameter space, such as boundary points, can beaccommodated with an approximate prior that has one or more mass points butis otherwise quite di!use. There is an example of this in Section 4.

3.3. Loss function

We have focused on problems where the optimal action requires a predictivedistribution. The estimation of parameters is not the primary goal; the role ofthe parametric model is to aid in the construction of the conditional predictivedistribution for=.

We can, however, de"ne a loss function with the parameter as one of itsarguments, and then express the risk function as expected loss. This loss function¸ : W]Z]APR is de"ned as follows:

¸(t, z, a)"!Pm(w, a) dGHt(w D z). (3)

Note that ¸ depends upon the observation z as well as on the parameter t andthe action a; this is necessary in order to include prediction problems. Then withQ(":PHt d/(t), we have

r(PHt, d)"P¸(t, z, d(z)) f H(z D t) dj(z)

r(Q(, d)"Pr(PHt, d) d/(t).

The optimal decision rule can be expressed as

dQ((z)"argmin

a|AP¸(t, z, a) d/M (t D z).

So the optimal action is chosen to minimize posterior expected loss; dQ( is the

Bayes rule with respect to the prior distribution /. See Wald (1950, Chapter 5.1),Blackwell and Girshick (1954, Chapter 7.3), and Ferguson (1967, Chapter 1.8).

264 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 11: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

The risk function r(PHt, d) is sometimes referred to as a classical risk function,with the stress on its being a function of the parameter t, and r(Q(, d) is referredto as the Bayes risk, with the stress on using the prior / to integrate over theparameter space. I prefer to regard them both as functions of the distribution ofthe observables (Z, =) (and of the decision rule d ). That Q( has a mixture formis not a fundamental di!erence; the mixing distribution / could assign unit massto some particular point t.

The "nite-sample optimality of Bayes decision rules played an importantrole in Wald's (1950) development of statistical decision theory. With S"

MPHt: t3WN, a decision rule d3D is admissible if there is no other rule d@3D withr(PHt, d@))r(PHt, d) for all t3W with strict inequality for some t3W. Wald'scomplete class theorem establishes that any admissible decision rule can beobtained as a Bayes rule for some prior distribution (or sequence of priordistributions).

If the estimation of parameters is a primary goal, then we can begin with thespeci"cation of a loss function and use it to examine the risk properties of anestimator. For example, we could consider estimating some scalar componenttkwith a (piecewise) linear loss function:

¸(t, z, a)"Gc1Dt

k!aD if a)t

k,

c2Dt

k!aD otherwise,

(4)

with c1, c

2'0. Then the posterior expected loss is minimized by setting the

estimate dQ((z) equal to the c

1/(c

1#c

2) quantile of the posterior distribution of

tk(as in Koenker and Bassett (1978, 1982), in a di!erent context).The linear loss function is also useful in prediction problems, if we do not

want to commit to a speci"c utility function that is based on the economics ofthe problem. Let w

kbe some scalar component of w,

!m(w, a)"Gc1Dw

k!aD if a)w

k,

c2Dw

k!aD otherwise,

(5)

and de"ne ¸(t, z, a) as in (3), where now the dependence on z is needed. Thenthe posterior expected loss is minimized by setting the forecast d

Q((z) equal to the

c1/(c

1#c

2) quantile of the conditional predictive distribution of =

k(as in

Koenker and Bassett (1978, 1982), in a similar context).

3.4. Coverage probability

As in Section 3.2, suppose that the parametric family MPHt: t3WN is given, andthere is a set C of prior distributions. Consider an approximate prior distribu-tion /

!, with corresponding subjective distribution Q(! for (Z, =). The linear

loss function in (4) implies that the optimal estimate of tk

is the c1/(c

1#c

2)

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 265

Page 12: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

quantile of the posterior distribution. If the posterior distribution of tk

iscontinuous, then

/M!(Mt: t

k)d!(z)N D z)"c

1/(c

1#c

2),

where d!"dQ(!. If Q":PHt d/(t) is the DGP, then the corresponding frequen-

tist coverage probability for d! is

cover(Q, d!)"PFHt(Mz: tk)d!(z)N) d/(t)

"P/M (Mt: tk)d!(z)N D z) dQ

1(z),

where Q1":FHt d/(t).

Likewise, the linear loss function in (5) implies that the optimal forecast of=

kis the c

1/(c

1#c

2) quantile of the conditional predictive distribution. If this

distribution is continuous, then

Q(!

2(Mw: w

k)d!(z)N D z)"c

1/(c

1#c

2).

The corresponding frequentist coverage probability for d! is

cover(Q, d!)"Q(M(z, w): wk)d!(z)N)

"PQ2(Mw: w

k)d!(z)N D z) dQ

1(z).

It follows, as in Pratt (1965), that the posterior probability and the coverageprobability are equal for d! if Q(! is the DGP:

cover(Q(!, d!)"c1/(c

1#c

2).

This suggests asking whether the posterior probability and the coverage prob-ability are nearly equal for some set of DGPs. See Morris (1983b). A correspond-ing robustness measure is

supQ|S

Dcover(Q, d!)!cover(Q, dQ)D.

I prefer to not focus on this robustness measure because it is not derived froman explicit loss function. Nevertheless, a substantial di!erence between pos-terior probability and coverage probability suggests a lack of robustness.Furthermore, a useful check on our numerical work can be based on this resultthat posterior probability equals coverage probability for d

Qwhen Q is the

DGP.

266 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 13: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

4. Application: Dynamic models for longitudinal data

Consider an individual trying to forecast his future earnings, in order to guidesavings and other decisions. We shall focus on how he might combine hispersonal earnings history with the data on the earnings trajectories of otherindividuals.

At the beginning of each period, the individual has some amount of "nancialwealth. He receives labor earnings, and "nancial wealth plus labor earningsgives cash on hand. He chooses to consume some of this and invest the rest. Thereturn on this investment gives "nancial wealth at the beginning of the nextperiod, and the process repeats. Labor income in future periods is uncertain.A decision rule speci"es consumption at each date as a function of cash on handat that date and of variables (whose values are known at that date) that are usedin forming conditional distributions for future earnings. Such a rule leads toa distribution for the consumption stream, and the individual uses expectedutility preferences to rank the distributions corresponding to di!erent rules. Theobjective is to choose a decision rule that maximizes expected utility.

Recent work on this problem includes Skinner (1988), Caballero (1990),Deaton (1991), Hubbard et al. (1994, 1995), and Carroll (1997). These papersadopt speci"cations for preferences and for the conditional distribution of futureearnings. They use analytical and numerical methods to solve for optimaldecision rules, and then summarize properties of the optimal paths for consump-tion and for the stock of "nancial wealth.

We shall work with a simple version of this problem in order to illustrate ourframework. The decision maker, denoted i"1, has access to the earningshistories for himself and N!1 other individuals over ¹#1 periods:z"MyT

iNNi/1

, where yTi"My

itNTt/0

and yit

is the log of earnings for individual i inperiod t. Let w denote the decision maker's future earnings: w"My

1tNHt/T`1

. Heregards (z, w) as the realization of the random variable (Z, =), which hassubjective distribution Q.

The decision maker has speci"ed the following parametric model, MPh: h3HN,for log earnings:

>it"c>

i,t~1#a

i#;

it, (6)

;itDM>

i0"y

i0NNi/1

*.*.$.& N(0, p2) (i"1,2, N; t"1,2, H), (7)

with h"(c, a1,2, a

N, logp2). He has the following nested prior, Mot: t3WN:

aiDM>

i0"y

i0NNi/1

*/$& N(q

1#q

2yi0, p2

v), (8)

with t"(c, q1, q

2, logp2, j) and j,p2

v/p2. Our question is whether some

approximate prior /!

on W can be recommended as being suitably robust.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 267

Page 14: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Models of this sort, with extensions to allow for serial correlation in;it, have

been used by Hause (1977), Lillard and Willis (1978), MaCurdy (1982), Abowdand Card (1989), and others. An issue, however, is the role of the normalityassumptions. In particular, MaCurdy (1982) maximized a (quasi) likelihoodfunction that was based on normality assumptions, but he based his parameterinferences on large-sample approximations that do not require specifying a par-ticular parametric family of distributions. Abowd and Card (1989) used a min-imum-distance method that, under large-sample approximations, can providemore e$cient estimates of the parameters than quasi-maximum likelihood,when the normality assumption is false.

The parameter estimates alone, however, do not provide a distribution forfuture earnings, and such a distribution is necessary for the consumptionproblem. Deaton (1991) combines estimates from MaCurdy (1982) with normal-ity assumptions to generate distributions for future earnings. Hubbard et al.(1994) use minimum-distance methods in their parameter estimation, but makenormality assumptions to provide distributions for future earnings. There hasbeen recent work using more general models to provide conditional predictivedistributions for earnings. Geweke and Keane (1996) use three-point mixtures ofnormal distributions. Chamberlain and Hirano (1997) allow for individual-speci"c persistence in earnings volatility. Hirano (1998) works with Dirichletprocess mixtures of normal distributions. In future work, I would like to apply thispaper's framework to these more general models. Also it would be good to payparticular attention to the risk of very low earnings, as stressed in Carroll (1997).

4.1. Parameter estimation

We shall begin by examining the estimation of c, using the linear loss functionin (4). Then we shall see how our conclusions are a!ected when we focus insteadon the predictive distribution of=. Our choice of DGPs is based on the samplefrom the Panel Study of Income Dynamics used in Chamberlain and Hirano(1997). The DGP Q assigns a gamma distribution to h"1/p2 with shapeparameter equal to 5.0. The 0.1 and 0.9 quantiles for p are 0.24 and 0.43.Conditional on p2, the components of (c, q

1, q

2) are independent normals with

variances proportional to p2. We consider three speci"cations for the mean of c:0.2, 0.5, 0.8. The mean of q

1is 0, and the mean of q

2is 0.25. The standard

deviations for (c, q1, q

2) in the (unconditional) t-distribution are 0.22. We con-

sider "ve speci"cations for j: uniform on (0, 0.1), (0.1, 0.3), (0.3, 1), (1, 5), (5, 25).The DGP is completed by setting the distribution of y

i0to be normal with mean

0 and standard deviation 0.45. So there are 15 DGPs in S.

4.1.1. Uniform priorOur "rst approximate prior is uniform: the parameter space W"R4][0,R),

and the density of /a(with respect to Lebesgue measure on W) is constant. The

268 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 15: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Table 1max

Q|S[r(Q, d!)!r(Q, d

Q)]

Uniform prior ¹

N2 4 10

100 0.11 0.03 0.0051000 0.03 0.004 0.000

loss function is

¸(t, z, a)"Dc!aD,

so the optimal decision rule (estimator) da is the median of the posteriordistribution for c that is implied by /

a. The risk of da under the DGP Q is

r(Q, da), and we shall compare this with the lower bound, r(Q, dQ), which would

be attained if the decision maker knew the DGP and used the median of thecorresponding posterior distribution of c. The risks are approximated numer-ically by taking 5000 independent samples from each of the DGPs, and calculat-ing the average loss. We shall consider sample sizes of N"100, 1000, and¹"2, 4, 10.

The risk comparison for the uniform prior is given in Table 1.The uniform prior appears to be quite robust when N"100, ¹"10 or

N"1000 and ¹"4 or 10. There is little to be gained then from consideringa more informative prior. With N"100 and ¹"2, however, the risk di!erenceof 0.11 is substantial. For each of the three values for E(c), the maximal regretrisk occurs for the DGP with j uniform on (0, 0.1). This suggests that there areparticular di$culties associated with the j"0 boundary of the parameterspace. There are also large discrepancies between posterior probability andcoverage probability in this case. For example, the DGP with E(c)"0.5 andj uniform on (0, 0.1), which we shall denote by Q

6, gives the coverage probabilit-

ies in Table 2. When N"100 and ¹"2, the coverage probability for theposterior median is far from 0.5; it is only 0.12.

4.1.2. Point-mass priorIn response to this poor performance for small values of j, we shall consider

a second approximate prior. It di!ers from the "rst one only in the distributionfor j. This distribution assigns point mass of 0.10 to j"0, and probability of0.90 to a gamma distribution with mean 12.5 and standard deviation 11.9.(The shape parameter is 1.1) We shall refer to prior-1 as uniform and toprior-2 as point mass. The risk comparison for the point mass prior is given inTable 3.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 269

Page 16: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Table 2Cover (Q

6, d!)

Uniform prior ¹

N2 4 10

100 0.12 0.20 0.351000 0.23 0.38 0.46

Table 3max

Q|S[r(Q, d!)!r(Q, d

Q)]

Point-mass prior ¹

N2 4 10

100 0.09 0.04 0.011000 0.05 0.01 0.002

When N"100 and ¹"2, the Bayes rule for the point-mass prior does muchbetter for the DGPs with j uniform on (0, 0.1), with maximal regret risk of 0.04instead of 0.11. The coverage probability is also much improved: the posteriormedian under the point mass prior has coverage probability (under Q

6) of 0.43

instead of 0.12. But there are tradeo!s. The maximal regret risk for the point-mass prior is 0.09, which occurs for the DGP with E(c)"0.8 and j uniform on(0.3, 1). The minimax criterion favors the point mass prior, but not by very much.At the other sample sizes, the minimax criterion favors the uniform prior. Theseresults also hold separately for each of the three speci"cations for E(c), withS consisting of the "ve DGPs corresponding to the speci"cations for j.

4.1.3. 0.05 and 0.95 quantilesNow consider the loss function in (4) with c

1"1 and c

2"19. The loss for

underestimating c is Dc!aD, but the loss for overestimating c is 19 ) Dc!aD. So theBayes rule sets the estimate a equal to the 0.05 quantile of the posteriordistribution of c. The minimax regret criterion again favors the point-mass priorwhen N"100 and ¹"2, and favors the uniform prior at the other samplesizes. These results also hold when c

1"19 and c

2"1, with the Bayes rule equal

to the 0.95 quantile of the posterior distribution of c.

4.1.4. Conditional priorSo far we have considered three estimators: based on the uniform prior, the

point-mass prior, and (for the regret calculations) the DGP prior. Numerical

270 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 17: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

quadrature has been used to calculate these estimators; Appendix A providessome detail on the calculations. I have also considered the following computa-tionally simpler estimator, which does not require quadrature; it is developed inAppendix A. The (marginal) posterior density for j is obtained in closed form,using the uniform prior. The posterior mode, jK

.0$%, is calculated numerically.

The posterior distribution of c conditional on j is a t-distribution, and it isevaluated at jK

.0$%. Then the c

1/(c

1#c

2) quantile of this posterior distribution

is used as the decision rule for the linear loss function in (4). This estimator doespoorly at the 0.05 and 0.95 quantiles, presumably because it does not allow forany uncertainty regarding j. When N"100 and ¹"2, the maximal regret risksare 0.27 and 0.71 for the loss functions with c

1/(c

1#c

2)"0.05 and 0.95. The

corresponding results for the uniform prior (not conditioning on j) are 0.21 and0.36, and the point-mass prior gives 0.14 and 0.22.

4.1.5. Fixed ewectsWe can examine the role of the nested prior in (8) by considering a uniform

prior on the original parameter space H"RN`2. In particular, the prior densityfor (a

1,2, a

N) is constant on RN, which corresponds to setting j"R. Then the

posterior mean for c can be obtained from a least-squares regression thatincludes N individual-speci"c dummy variables. (The posterior mean and me-dian coincide; see the appendix.) This is known as the "xed-e!ects (d&%) orwithin-group estimator. It is inconsistent as NPRwith ¹ "xed in our autoreg-ression model. The inconsistency is particularly interesting because this isa Bayes estimator. We would obtain very similar results using a proper prior,say uniform on (!1010, 1010)N`2. If we use this prior to construct a DGP, the(slightly modi"ed) "xed-e!ects estimator will be optimal in terms of mean squareerror (or mean absolute error) for that DGP. It will, however, be extremelynonrobust for the (plausible) family of DGPs that we have been considering.

The risk comparisons for the "xed-e!ects estimator, using mean absoluteerror, are shown in Table 4.

S contains the same 15 DGPs that were used before. The maximal regret riskwhen N"100 and ¹"2 is 0.60. Using the nested (uniform) prior on W, the

Table 4max

Q|S[r(Q, d&%)!r(Q, d

Q)]

Fixed e!ects ¹

N2 4 10

100 0.60 0.31 0.121000 0.64 0.33 0.13

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 271

Page 18: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

maximal regret risk is 0.11. In fact, the "xed-e!ects estimator is dominated, withhigher risk at each of the DGPs in S.

Since the "xed-e!ects estimator is a Bayes estimator, a modi"ed version usinga proper prior will be admissible, and so we will not have risk dominance overa su$ciently wide set of DGPs. Nevertheless, risk comparisons can providea critique of the "xed-e!ects estimator that does not rely upon large-samplearguments. To illustrate, consider adding to S the DGP with E(c)"0.5 andj uniform on (1000,1001). The mean absolute error for estimating c is about0.004 under this DGP (when N"100 and ¹"2) for each of the followingestimators: the optimal (infeasible) estimator that uses the DGP prior; theuniform, nested-prior estimator; and the "xed-e!ects estimator. Suppose thatthe risk is in fact slightly less for the "xed-e!ects estimator than for thenested-prior estimator, so we no longer have dominance. Then the critique ofthe "xed-e!ects estimator could be as follows: (i) the DGP for which the"xed-e!ects estimator does well is not plausible; (ii) even if it were, the di!erenceacross estimators in risk for that DGP is tiny, whereas the nested-prior es-timator does much better than the "xed-e!ects estimator for some (plausible)DGPs; (iii) the maximal regret risk values are not a!ected by the additionalDGP, so the minimax criterion still strongly favors the nested-prior estimator.

4.2. Predictive distributions

Consider individual i"1. Let w"My1tNHt/T`1

denote his future earnings. Thedata available to him when he makes his decision are z"MyT

iNNi/1

, whereyTi"My

itNTt/0

. He regards (z, w) as the realization of the random variable (Z, =),which has subjective distribution Q, and he adopts the parametric model andnested prior in (6)}(8). We shall work with a linear loss function, as in (5), whichgives the following prediction problem: min

dr(Q, d) with

r(Q, d)"EQ[[c

11(d(Z))>

1,T`k)#c

21(d(Z)

'>1,T`k

)] ) D>1,T`k

!d(Z)D]. (9)

The solution, for given Q, has dQ(z) equal to the c

1/(c

1#c

2) quantile of the

conditional distribution of >1,T`k

given Z"z. Working with di!erent valuesfor c

1/(c

1#c

2) will provide an indication of how well the approximate priors

perform in producing predictive distributions. I would also like to evaluate theirperformance in explicit models of optimal consumption, but that is left for futurework.

4.2.1. Forecasting one period aheadWe shall use the same DGPs and approximate priors as in the parameter

estimation problem. First consider absolute error loss, with c1"c

2"1. S con-

tains 15 DGPs, corresponding to the three values for E(c) and the "ve uniform

272 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 19: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Table 5max

Q|S[r(Q, d!)!r(Q, d

Q)]; c

1"1, c

2"1; k"1

Uniform prior ¹ Point-mass prior ¹

N2 4 10 2 4 10

100 0.004 0.001 0.000 0.005 0.001 0.0001000 0.001 0.000 0.000 0.001 0.000 0.000

distributions for j. The maximal regret risks for forecasting >1,T`1

are given inTable 5.

Consider N"100 and ¹"2. The maximal regret risk for the uniform prior isattained for the DGP with E(c)"0.2 and j uniform on (0, 0.1). There the meanabsolute errors for the forecasts corresponding to the DGP prior, the uniformprior, and the point-mass prior are all close to 0.26. These are substantial, inforecasts of log earnings. The regret risk for the uniform prior, however, is only0.004. The uniform prior appears to be very robust, with little to be gained froma more informative prior. This robustness also shows up in the coverageprobability, which is 0.50.

These results for the forecasting problem are in sharp contrast to the resultsfor estimating c, where the estimate based on the uniform prior had poorperformance for small values of j. That poor performance motivated thepoint-mass prior, which appears to not be needed in the forecast problem.Nevertheless, the point-mass prior does "ne. With N"100 and ¹"2, itsmaximal regret risk is attained for the DGP with E(c)"0.8 and j uniform on(0.1, 0.3). There the mean absolute errors for the forecasts corresponding to theDGP prior, the uniform prior, and the point-mass prior are all close to 0.30. Theregret risk for the point-mass prior is only 0.005, and its coverage probability is 0.49.

We obtain similar results for the risk function in (9) with c1"1 and c

2"19,

with the Bayes rule equal to the 0.05 quantile of the conditional predictivedistribution of >

1,T`1. When N"100 and ¹"2, the maximal regret risk for

the uniform prior is attained for the DGP with E(c)"0.5 and j uniform on(0, 0.1). There the risks for the forecasts corresponding to the DGP prior, theuniform prior, and the point-mass prior are 0.71, 0.72, and 0.71. The regret riskfor the uniform prior is only 0.01, and its coverage probability is 0.06. Nowconsider c

1"19 and c

2"1, still with N"100 and ¹"2. The Bayes rule

equals the 0.95 quantile of the conditional predictive distribution of>1,T`1

. Themaximal regret risk for the uniform prior is attained for the DGP with E(c)"0.2and j uniform on (0, 0.1). There the risks for the forecasts corresponding to theDGP prior, the uniform prior, and the point-mass prior are 0.67, 0.68, and 0.67.The regret risk for the uniform prior is only 0.01, and its coverage probabilityis 0.94.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 273

Page 20: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Both the uniform prior and the point-mass prior exhibit a substantial degreeof risk robustness when we are forecasting one period ahead. Next we shall seehow this robustness holds up when we forecast ten periods ahead.

4.2.2. Forecasting ten periods aheadWe shall consider three sample con"gurations: (N, ¹)"(100, 2), (100, 4),

(1000, 2), and three versions of the loss function in (5): (c1, c

2)"(1, 1), (1, 19),

(19, 1). S contains 15 DGPs, corresponding to E(c)"0.2, 0.5, 0.8 and to the "veuniform distributions for j. The maximal regret risks for forecasting>

1,T`10are

given in Table 6.Consider (N, ¹)"(100, 2) and (c

1, c

2)"(1, 1). The maximal regret risk for the

uniform prior is attained for the DGP with E(c)"0.8 and j uniform on (0, 0.1).There the mean absolute errors for the forecasts corresponding to the DGPprior, the uniform prior, and the point-mass prior are 0.71, 0.81, and 0.76. Theseare very substantial, in forecasts of log earnings. The regret risk for the uniformprior is much smaller at 0.09, but still substantial. The point-mass prior doesbetter than the uniform prior for this DGP, with a regret risk of 0.05. However,the maximal regret risk is smaller for the uniform prior than for the point-massprior: 0.09 versus 0.13. This is also true at the other sample con"gurations: 0.02versus 0.07, and 0.02 versus 0.09.

There are similar results for the risk function with (c1, c

2)"(1, 19), with the

Bayes rule equal to the 0.05 quantile of the conditional predictive distribution of>

1,T`10. When (N, ¹)"(100, 2), the maximal regret risk for the uniform prior is

attained for the DGP with E(c)"0.8 and j uniform on (0, 0.1). There the risksfor the forecasts corresponding to the DGP prior, the uniform prior, and thepoint mass prior are 2.0, 2.5, and 2.3. The regret risk for the uniform prior is 0.49,and it is 0.28 for the point-mass prior. As before, however, the maximal regretrisk for the uniform prior is less than for the point-mass prior: 0.49 versus 1.4. Infact, for all the DGPs, loss functions, and sample con"gurations, the risk for theuniform prior is less than for the point-mass prior except when the DGP hasj uniform on (0, 0.1). So the point-mass prior cannot be generally recommendedfor this forecast problem.

Table 6max

Q|S[r(Q, d!)!r(Q, d

Q)]; k"10

Uniform (N, ¹) Point-mass (N, ¹)prior prior(c

1, c

2) (100, 2) (100, 4) (1000, 2) (100, 2) (100, 4) (1000, 2)

(1, 1) 0.09 0.02 0.02 0.13 0.07 0.09(1, 19) 0.49 0.09 0.07 1.4 0.24 0.29(19, 1) 0.47 0.08 0.12 1.1 0.27 0.34

274 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 21: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

5. Conclusion

We have considered the role of econometrics in decision making underuncertainty. This has led to a stress on predictive distributions. This hasimportant consequences because econometric procedures are often evaluatedwithout regard to predictive distributions. For example, in dynamic models forlongitudinal data, the focus is often on autoregressive and variance-componentparameters, corresponding to aspects of a serial covariance matrix. Variousmethods (quasi-maximum likelihood, minimum distance, generalized method ofmoments) may have desirable properties relative to these parameters but fail toprovide predictive distributions.

We have considered criteria for evaluating procedures, leading to risk robust-ness and minimax regret risk relative to a set S of data-generating processes(DGPs). These criteria were stated without using large-sample approximations.This does not mean that approximations have no role to play. The numericalevaluation of our criteria is already nontrivial in the model of Section 4.Approximations may well be required to reduce the cost of computation in moregeneral models. But such approximations should not be bound up in thede"nition of the evaluation criteria; better to state the rules of the game "rst, andthen bring in approximations as necessary.

In order to construct predictive distributions, we have used Bayes proceduresbased on parametric models with approximate prior distributions. Nested priorscan be used on parameter spaces of high dimension. The "rst stage of the priorincorporates qualitative restrictions such as exchangeability, and the secondstage is quite di!use. Special points in the parameter space, such as boundarypoints, can be accommodated with point-mass priors. A motivation for Bayesprocedures is their "nite sample optimality when based on the DGP.

In our application in Section 4, the DGPs were constructed by combininga parametric model with various distributions on the parameter space. Theprocedures were constructed as Bayes procedures for the same parametricmodel and two approximate prior distributions (uniform and point mass). Ourevaluation criteria could, however, be applied in other cases. We need to specifysome set S of DGPs, but it need not be tied to a particular parametric model.Likewise, the procedures considered need not be limited to Bayes procedures fora parametric model. Bayes procedures are available for various nonparametricmodels, although the distinction is not a sharp one since we can work withparameter spaces of high dimension. Non-Bayes procedures can be considered,perhaps motivated as computationally cheaper approximations to Bayes pro-cedures.

We have considered problems where the role of the econometrician is toprovide advice to an individual on a portfolio choice or consumption decision.Related issues would arise in using data from job training experiments to advisean individual on whether he should enroll in a job training program. Or in using

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 275

Page 22: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

data from clinical trials to advise an individual on choice of medical treat-ment. It may be fruitful to approach some social policy questions from theperspective of the econometrician providing the policy maker with predictivedistributions, in which case our criteria for evaluating procedures may berelevant.

Acknowledgements

An earlier version of this paper was presented at the Principles of Econo-metrics conference at the University of Wisconsin-Madison in May 1998. I amgrateful to Charles Manski and Kenneth West for comments. Financial supportwas provided by the National Science Foundation.

Appendix A. Computation

A.1. Parameter estimation and one-period forecasts

The form of the likelihood function for m is

f (y DJ, m)"chn@2 exp[!(h/2)(y!Xb)@(y!Xb)],

where y is n]1, X is n]K, b is K]1, m@"(b@, h, j), and c is a constant in thesense that it does not depend upon m. J is a set of variables that we condition onthroughout the analysis; it could include initial conditions in dynamic models.We use the natural conjugate prior for (b, h) conditional on j:

b DJ, h, j&N(m, [hG(j)]~1)

h DJ, j&G(a1/2, 2a~1

2).

(G(a, b) denotes a gamma distribution with shape parameter a and scale para-meter b.) Let p(b, h D j) denote the prior density for (b, h) conditional on j. Theposterior distribution of (b, h) conditional on j is

b DJ, y, h, j&N(bM (j), h~1[X@X#G(j)]~1) (A.1)

h DJ, y, j&G((a1#n)/2, 2[q(j)]~1), (A.2)

where

bM (j)"[X@X#G(j)]~1[X@y#G(j)m],

q(j)"a2#y@y#m@G(j)m!bM (j)@[X@X#G(j)]bM (j).

276 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 23: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Let s be a K]1 vector; it is a constant in that it does not depend upon m, but itmay depend upon J or y. s@b has a posterior t-distribution conditional on j:

s@b DJ, y, j&s@bM (j)#[s@[X@X#G(j)]~1s]1@2[q(j)/(a1#n)]1@2t(a

1#n).

(A.3)

Suppose that, conditional on m, we have the following predictive distribution fora future value D:

D DJ, y, m&N(s@b, h~1).

Then the posterior predictive distribution for D conditional on j is

D DJ, y, j&s@bM (j)#[s@[X@X#G(j)]~1s#1]1@2[q(j)/(a1#n)]1@2t(a

1#n).

(A.4)

This result will help us to obtain posterior predictive distributions one periodahead.

The marginal likelihood for j is

r(j)"PP f (y DJ, b, h, j)p(b, h D j) db dh

"c[q(j)]~(a1`n)@2[det(X@X#G(j))]~1@2[detG(j)]1@2. (A.5)

The prior distribution for j may contain a mass point, say at j"0:

dp(j)"fdd0(j)#(1!f)g(j) dj,

with 0)f)1, :Add

0(j)"1(03A), and :g(j) dj"1. The posterior distribution

for j is given by

dp(j DJ, y)"r(j) dp(j)

:r(j) dp(j)

"

fr(0) dd0(j)#(1!f)r(j)g(j) dj

fr(0)#(1!f):r(j)g(j) dj.

Let g(t D j)"Pr(s@b)t DJ, y, j), which can be obtained from the cumulativedistribution function (cdf ) of a t-distribution using (A.3). Then the posteriordistribution of s@b is obtained as follows:

Pr(s@b)t DJ, y),g(t)"Pg(t D j) dp(j DJ, y)

"

fg(t D 0)r(0)#(1!f):g(t D j)r(j)g(j) djfr(0)#(1!f):r(j)g(j) dj

. (A.6)

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 277

Page 24: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Likewise, with g(t D j)"Pr(D)t DJ, y, j) obtained from the cdf of a t-distribu-tion using (A.4), we can obtain g(t)"Pr(D)t DJ, y) as in (A.6).

The integrals in (A.6) are calculated numerically using adaptive quadrature.Then the i-quantile is obtained by numerically "nding a solution tog(ti)!i"0. The program is written in Fortran 90 and uses the NAG FortranLibrary.

A.1.1. Improper priorPartition b@"(b@

1, b@

2), where b

1is K

1]1 and b

2is K

2]1. Suppose that the

prior density for b conditional on (h, j) is a N(m1, [hG

1(j)]~1) density for

b1

times a constant (on RK2) density for b2. Set

m"Am

10 B, G"A

G1

0

0 0B.Then the previous results continue to hold with a

1#n replaced by a

1#n!K

2and with det(G(j)) replaced by det(G

1(j)). If the prior distribution for h condi-

tional on j is improper, with a constant density for log h (on R), then seta1"a

2"0.

A.1.2. Computational simplixcationsIt is helpful to simplify q(j), r(j), s@[X@X#G(j)]~1s, and s@bM (j), since they will

be evaluated repeatedly for di!erent values of j. In our application in Section 4,(6)}(8), we have

X"(IN?l

TR), G(j)"A

j~1IN

0

0 MB, m"A0

dB,where l

Tis a ¹]1 vector of ones, R is n]K

2, M is K

2]K

2, and d is K

2]1. So

n"N )¹ and K"N#K2. In particular, our application has

y"Ay1F

yNB with y

i"A

yi1F

yiTB,

R"AR

1F

RNB with R

i"A

yi0

1 yi0

F F F

yi,T~1

1 yi0B,

with K2"3. De"ne v

i"a

i!q

1!q

2yi0, so that v

iD M>

i0"y

i0NNi/1

*.*.$.& N(0, p2

v).

Then b@1"(v

1,2, v

N), b@

2"(c, q

1, q

2), h"1/p2, and j"p2

v/p2.

278 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 25: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Let y6 "(IN?l@

T)y/¹ and RM "(I

N?l@

T)R/¹. De"ne

¹y"y@y, ¹

r"R@R, ¹

ry"R@y

By"¹y6 @y6 , B

r"¹RM @RM , B

ry"¹RM @y6 .

De"ne

¹Iy"a

2#¹

y#d@Md, ¹I

r"¹

r#M, ¹I

ry"¹

ry#Md.

Let ¸ denote the eigenvectors of ¹Irrelative to B

r, with eigenvalues i

1,2, i

K2:

¸@¹Ir¸"diagMi

1,2, i

K2N, ¸@B

r¸"I

K2.

Let u"¹j/(¹j#1). Let ¹I Hry"¸@¹I

ry, BH

ry"¸@B

ry, and RM H"RM ¸. Let

sH2"¸@s

2, where s@"(s@

1, s@

2) and s

1is N]1, s

2is K

2]1. Let

K"diagM(i1!u)~1,2, (i

K2!u)~1N.

Straightforward algebra shows that

q(j)"(¹Iy!uB

y)!(¹I H

ry!uBH

ry)@K(¹I H

ry!uBH

ry), (A.7)

r(j)"c(¹j#1)~N@2CK2

<j/1

(ij!u)D

~1@2q(j)~(a1`n)@2, (A.8)

s@[X@X#G(j)]~1s"us@1s1/¹#(sH

2!uRM H{s

1)@K(sH

2!uRM H{s

1), (A.9)

s@bM (j)"us@1y6 #(sH

2!uRM H{s

1)@K(¹I H

ry!uBH

ry). (A.10)

Now we can obtain Pr(s@b)t DJ, y) as in (A.6), using (A.7)}(A.10) to simplifythe quadrature. Setting s

1"0 and s@

2"(1, 0, 0) gives s@b"c. With D">

1, T`1,

we can obtain g(t D j)"Pr(>1,T`1

)t DJ, y, j) from (A.4) by settings@1"(1, 0,2, 0) and s@

2"(y

1T, 1, y

10). Then obtain g(t)"Pr(>

1,T`1)t DJ, y)

as in (A.6), using (A.7)}(A.10) to simplify the quadrature.

A.1.3. Fixed ewectsThe "xed-e!ects estimator corresponds to a uniform prior for (a

1,2, a

N). Let

X"(IN?l

TR), R"A

R1F

RNB with R

i"A

yi0F

yi,T~1

B,K

2"1, b@

1"(a

1,2, a

N), b

2"c, h"1/p2. The prior for (b, log h) has constant

density on RN`K2`1. De"ne the within-group moments:

=y"¹

y!B

y, =

r"¹

r!B

r, =

ry"¹

ry!B

ry.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 279

Page 26: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

s@b has a posterior t-distribution:

s@b DJ, y&s@b#[s@(X@X)~1s]1@2[q/(N¹!N!K2)]1@2t(N¹!N!K

2),

where

b"(X@X)~1X@y"Ab1

b2B"A

y6 !RM b2

=~1r=

ryB,

s@(X@X)~1s"s@1s1/¹#(s

2!RM @s

1)@=~1

r(s2!RM @s

1),

q"=y!=@

ry=~1

r=

ry.

The posterior predictive distribution of >1,T`1

is also a t-distribution:

>1,T`1

DJ, y& s@b#[s@(X@X)~1s#1]1@2[q/(N¹!N!K2)]1@2

]t(N¹!N!K2),

with s@1"(1, 0,2, 0) and s

2"y

1T.

A.2. m-period forecastReturn to the model with the nested prior, as in Section 4, (6)}(8). We shall

show that the posterior predictive distribution of >1,T`m

is a t-distribution,conditional on (c, j). Then we can obtain the marginal distribution usingtwo-dimensional quadrature. Let

X"(IN?l

TR), R"A

R1F

RNB with R

i"A

yi0

1 yi0

F F F

yi,T~1

1 yi0B.

De"ne vi"a

i!q

1!q

2yi0, so that v

iD M>

i0"y

i0NNi/1

*.*.$.&

N(0, p2v). Let

b@1"(v

1,2, v

N), b@

2"(c, q

1, q

2), h"1/p2, and j"p2

v/p2. The model implies

that

>1,T`m

DJ, y, b, h, j&NA1!cm1!c

s@b#cmy1T

, h~11!c2m1!c2 B, (A.11)

with s@1"(1, 0,2, 0) and s@

2"(0, 1, y

10).

Let e@1"(0,2, 0), e@

2"(1, 0, 0), so that e@b"c. Let c6 (j)"e@bM (j). As in (A.1),

we have

b DJ, y, h, j&N(bM (j), h~1[X@X#G(j)]~1).

Hence

s@b DJ, y, h, j, e@b&N(k1(c, j), h~1d

1(j)), (A.12)

280 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 27: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

with

k1(c, j)"s@bM (j)#[c

2(j)/c

3(j)][c!c6 (j)],

d1(j)"c

1(j)!c

2(j)2/c

3(j),

and

c1(j)"s@[X@X#G(j)]~1s, c

2(j)"s@[X@X#G(j)]~1e,

c3(j)"e@[X@X#G(j)]~1e.

There is a simpli"ed formula for c1(j) in (A.9), and there are similar formulas for

c2(j) and c

3(j):

c2(j)"us@

1e1/¹#(sH

2!uRM H{s

1)@K(eH

2!uRM H{e

1),

c3(j)"ue@

1e1/¹#(eH

2!uRM H{e

1)@K(eH

2!uRM H{e

1),

where eH2"¸@e

2.

Eqs. (A.11) and (A.12) imply that

>1,T`m

DJ, y, c, h, j&N(k2(c, j), h~1d

2(c, j)),

with

k2(c, j)"

1!cm1!c

k1(c, j)#cmy

1T,

d2(c, j)"A

1!cm1!c B

2d1(j)#

1!c2m1!c2

.

Eqs. (A.1) and (A.2) imply that

h DJ, y, j, c&G((a1#n#1)/2, 2[q8 (c, j)]~1),

with q8 (c, j)"q(j)#(c!c6 (j))2/c3(j). Hence

>1,T`m

DJ, y, c, j&k2(c, j)#[d

2(c, j)]1@2[q8 (c, j)/(a

1#n#1)]1@2

]t(a1#n#1).

The posterior distribution of c conditional on j is a t-distribution:

c DJ, y, j&c6 (j)#[c3(j)]1@2[q(j)/(a

1#n)]1@2t(a

1#n).

Let p(c DJ, y, j) denote the density function. Then we have

g(t D j)"Pr(>1,T`m

)t DJ, y, j)

"PPr(>1,T`m

)t DJ, y, c, j)p(c DJ, y, j) dc.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 281

Page 28: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

The integral over c, for a given value of j, is evaluated by quadrature. Then weobtain g(t)"Pr(>

1,T`m)t DJ, y) as in (A.6), again using quadrature.

References

Abowd, J., Card, D., 1989. On the covariance structure of earnings and hours changes. Econometrica57, 411}445.

Anscombe, F., Aumann, R., 1963. A de"nition of subjective probability. Annals of MathematicalStatistics 34, 199}205.

Berger, J., 1984. The robust Bayesian viewpoint. In: Kadane, J. (Ed.), Robustness of BayesianAnalyses, North-Holland, Amsterdam, pp. 63}124.

Berger, J., 1990. Robust Bayesian Analysis: Sensitivity to the prior. Journal of Statistical Planningand Inference 25, 303}328.

Berger, J., 1994. An overview of robust Bayesian analysis. Test 3, 5}59.Blackwell, D., Girshick, M., 1954. Theory of Games and Statistical Decisions. Wiley, New York.Caballero, R., 1990. Consumption puzzles and precautionary savings. Journal of Monetary Econ-

omics 25, 113}136.Carroll, C., 1997. Bu!er-stock saving and the life cycle/permanent income hypothesis. Quarterly

Journal of Economics 112, 1}55.Chamberlain, G., Hirano, K., 1997. Predictive distributions based on longitudinal earnings data.

Unpublished manuscript, Harvard University.Deaton, A., 1991. Saving and Liquidity Constraints. Econometrica 59, 1221}1248.Edwards, W., Lindman, H., Savage, L.J., 1963. Bayesian statistical inference for psychological

research. Psychological Review 70, 193}242.Ferguson, T., 1967. Mathematical Statistics: A Decision Theoretic Approach. Academic Press, New

York.Geweke, J., Keane, M., 1996. An empirical analysis of the male income dynamics in the PSID:

1968}1989. Unpublished manuscript, University of Minnesota.Good, I.J., 1952. Rational decisions. Journal of the Royal Statistical Society Series B 14,

107}114.Hause, J., 1977. The covariance structure of earnings and the on-the-job training hypothesis. Annals

of Economic and Social Measurement 6, 335}365.Hirano, K., 1998. Semiparametric Bayesian models for dynamic earnings data, in Essays on the

econometric analysis of panel data. Ph.D. Thesis, Harvard University.Hubbard, R.G., Skinner, J., Zeldes, S., 1994. The importance of precautionary motives in explaining

individual and aggregate saving. Carnegie}Rochester Conference Series on Public Policy, Vol.40, pp. 59}125.

Hubbard, R.G., Skinner, J., Zeldes, S., 1995. Precautionary saving and social insurance. Journal ofPolitical Economy 103, 360}399.

Koenker, R., Bassett, G., 1978. Regression quantiles. Econometrica 46, 33}50.Koenker, R., Bassett, G., 1982. Robust tests for heteroscedasticity based on regression quantiles.

Econometrica 50, 43}61.Lillard, L., Willis, R., 1978. Dynamic aspects of earnings mobility. Econometrica 46, 985}1012.MaCurdy, T., 1982. The use of time series processes to model the error structure of earnings in

a longitudinal data analysis. Journal of Econometrics 18, 83}114.Manski, C., 1981. Learning and decision making when subjective probabilities have subjective

domains. The Annals of Statistics 9, 59}65.Morris, C., 1983a. Parametric empirical Bayes inference: theory and applications. Journal of the

American Statistical Association 78, 47}55.

282 G. Chamberlain / Journal of Econometrics 95 (2000) 255}283

Page 29: Econometrics and decision theorydirectory.umm.ac.id/Data Elmu/jurnal/J-a/Journal of...Journal of Econometrics 95 (2000) 255}283 Econometrics and decision theory Gary Chamberlain* Department

Morris, C., 1983b. Parametric empirical Bayes con"dence intervals. In: Box, G., Leonard, T., Wu, C.(Eds.), Scienti"c Inference, Data Analysis, and Robustness. Academic Press, New York, pp.25}50.

Pratt, J., 1965. Bayesian interpretation of standard inference statements. Journal of the RoyalStatistical Society Series B 27, 169}192.

Robbins, H., 1964. The empirical Bayes approach to statistical decision problems. Annals ofMathematical Statistics 35, 1}20.

Savage, L.J., 1954. The Foundations of Statistics. Wiley, New York.Simon, H., 1957. Models of Man, Social and Rational. Wiley, New York.Skinner, J., 1988. Risky income, life cycle consumption, and precautionary savings. Journal of

Monetary Economics 22, 237}255.Wald, A., 1950. Statistical Decision Functions. Wiley, New York.Wasserman, L., 1992. Recent methodological advances in robust Bayesian inference. In: Bernardo,

J., Berger, J., Dawid, A., Smith, A. (Eds.), Bayesian Statistics Vol. 4. Oxford University Press,Oxford, pp. 483}490.

G. Chamberlain / Journal of Econometrics 95 (2000) 255}283 283