Hostname: page-component-78c5997874-dh8gc Total loading time: 0 Render date: 2024-11-02T22:08:16.949Z Has data issue: false hasContentIssue false
  • English
  • Français

MINIMIZING AVERAGE RISK IN REGRESSION MODELS

Published online by Cambridge University Press:  15 January 2008

Gerda Claeskens  and
Nils Lid Hjort
Gerda Claeskens
Affiliation:
Katholieke Universiteit Leuven
Nils Lid Hjort
Affiliation:
University of Oslo
Get access Rights & Permissions [Opens in a new window]

Abstract

Most model selection mechanisms work in an “overall” modus, providing models without specific concern for how the selected model is going to be used afterward. The focused information criterion (FIC), on the other hand, is geared toward optimum model selection when inference is required for a given estimand. In this paper the FIC method is extended to weighted versions. This allows one to rank and select candidate models for the purpose of handling a range of similar tasks well, as opposed to being forced to focus on each task separately. Applications include selecting regression models that perform well for specified regions of covariate values. We derive these weighted focused information criteria (wFIC), give asymptotic results, and apply the methods to real data. Formulas for easy implementation are provided for the class of generalized linear models.We express our sincere thanks to all reviewers of this paper, including the special issue guest editors and editor Professor Phillips, whose comments and questions have contributed to significant improvements. We also thank Dr. Ronald Klein for kindly giving permission to use the WESDR data. The work of Claeskens has been supported in part by the Fund for Scientific Research Flanders (G.0542.06).

Type
Research Article
Information
Econometric Theory , Volume 24 , Issue 2 , April 2008 , pp. 493 - 527
Copyright
© 2008 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Akaike, H. (1974) A new look at statistical model identification. I.E.E.E. Transactions on Automatic Control 19, 716–723.Google Scholar
Claeskens, G., C. Croux, & J. Van Kerckhoven (2006) Variable selection for logistic regression using a prediction focussed information criterion. Biometrics 62, 972–979.Google Scholar
Claeskens, G. & N.L. Hjort (2003) The focused information criterion (with discussion). Journal of the American Statistical Association 98, 900–916.Google Scholar
Dobson, A.J. (2002) An Introduction to Generalized Linear Models. Chapman and Hall.
Hansen, B.E. (2005) Challenges for econometric model selection. Econometric Theory 21, 60–68.Google Scholar
Hansen, B. (2007) Econometrics. Manuscript, Department of Economics, University of Wisconsin.
Hjort, N.L. & G. Claeskens (2003a) Frequentist model average estimators (with discussion). Journal of the American Statistical Association 98, 879–899.Google Scholar
Hjort, N.L. & G. Claeskens (2003b) Rejoinder to “The focused information criterion” and “Frequentist model average estimators.” Journal of the American Statistical Association 98, 938–945.Google Scholar
Hjort, N.L. & G. Claeskens (2006) Focussed information criteria and model averaging for Cox's hazard regression model. Journal of the American Statistical Association 101, 1449–1464.Google Scholar
Klein, R., B.E.K. Klein, S.E. Moss, M.D. Davis, & D.L. DeMets (1984) The Wisconsin epidemiologic study of diabetic retinopathy: II. Prevalence and risk of diabetic retinopathy when age at diagnosis is less than 30 years. Archives of Ophthalmology 102, 520–526.Google Scholar
Mallows, C.L. (1973) Some comments on Cp. Technometrics 15, 661–675.Google Scholar
McCullagh, P. & J. Nelder (1989) Generalized Linear Models. Chapman and Hall.
Phillips, P.C.B. & W. Ploberger (1996) An asymptotic theory of Bayesian inference for time series. Econometrica 64, 381–412.Google Scholar
Ronchetti, E. & R.G. Staudte (1994) A robust version of Mallows' Cp. Journal of the American Statistical Association 89, 550–559.Google Scholar
Schwarz, G. (1978) Estimating the dimension of a model. Annals of Statistics 6, 461–464.Google Scholar
Varian, H.R. (1975) Distributive justice, welfare economics, and the theory of fairness. Philosophy and Public Affairs 4, 223–247.Google Scholar
Wei, C.Z. (1992) On predictive least squares principles. Annals of Statistics 20, 1–42.Google Scholar
Weisberg, S. (2005) Applied Linear Regression, 3rd ed. Wiley.
Zellner, A. (1986) Bayesian estimation and prediction using asymmetric loss functions. Journal of the American Statistical Association 81, 446–451.Google Scholar