Hostname: page-component-745bb68f8f-b95js Total loading time: 0 Render date: 2025-01-30T08:21:58.364Z Has data issue: false hasContentIssue false
  • English
  • Français

Smoothing the Hill Estimator

Part of: Stochastic processes Limit theorems

Published online by Cambridge University Press:  01 July 2016

Sidney Resnick  and
Cătălin Stărică
Sidney Resnick*
Affiliation:
Cornell University
Cătălin Stărică*
Affiliation:
Cornell University
*
∗ Postal address: School of Operations Research and Industrial Engineering, 223 Rhodes Hall, Cornell University, Ithaca, NY 14853-3801, USA.
∗ Postal address: School of Operations Research and Industrial Engineering, 223 Rhodes Hall, Cornell University, Ithaca, NY 14853-3801, USA.
Get access Rights & Permissions [Opens in a new window]

Abstract

For sequences of i.i.d. random variables whose common tail 1 – F is regularly varying at infinity wtih an unknown index –α < 0, it is well known that the Hill estimator is consistent for α–1 and usually asymptotically normally distributed. However, because the Hill estimator is a function of k = k(n), the number of upper order statistics used and which is only subject to the conditions k →∞, k/n → 0, its use in practice is problematic since there are few reliable guidelines about how to choose k. The purpose of this paper is to make the use of the Hill estimator more reliable through an averaging technique which reduces the asymptotic variance. As a direct result the range in which the smoothed estimator varies as a function of k decreases and the successful use of the esimator is made less dependent on the choice of k. A tail empirical process approach is used to prove the weak convergence of a process closely related to the Hill estimator. The smoothed version of the Hill estimator is a functional of the tail empirical process.

MSC classification

Primary: 60F17: Functional limit theorems; invariance principles
Secondary: 60G70: Extreme value theory; extremal processes
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 29 , Issue 1 , March 1997 , pp. 271 - 293
Copyright
Copyright © Applied Probability Trust 1997 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The work of S. Resnick is partially supported by NSF Grant DSM-DMS-9400535 at Cornell University.

The work of C. Stǎricǎ is supported by NSF Grant DMS-9400535 at Cornell University.

References

Billingsley, P. (1968) Convergence of Probability Measures. Wiley, New York.Google Scholar
Bingham, N., Goldie, C. and Teugels, J. (1987) Regular Variation. Cambridge University Press, Cambridge.Google Scholar
Csörgo, S., Deheuvels, P. and Mason, D. (1985) Kernel estimates for the tail index of a distribution. Ann. Statist. 13, 1050–1077.Google Scholar
Csörgö, S. and Mason, D. (1985) Central limit theorems for sums of extreme values. Math. Proc. Camb. Phil. Soc. 98, 547–588.Google Scholar
Csörgö, S. and Mason, D. (1992) Intermediate and extreme sum processes. Stoch. Proc. Appl. 40, 55–67.Google Scholar
Deheuvels, P. and Mason, D. M. (1991) A tail empirical process approach to some non-standard laws of the iterated logarithm. J. Theoret. Prob. 4, 53–85.Google Scholar
Dekkers, A. L. M. and Haan, L. De (1991) Optimal choice of sample fraction in extreme value estimation. Thesis. Erasmus University, Rotterdam.Google Scholar
Feigin, P. D., Resnick, S. I. and Starica, C. (1996) Testing for independence in heavy tailed and positive innovation time series. Stoch. Models. 11, 587–612.Google Scholar
Geluk, J. and Haan, L. De (1987) Regular variation, extensions and Tauberian theorems. CWI Tract 40. Centre for Mathematics and Computer Science, Amsterdam.Google Scholar
Geluk, J., Haan, L. De, Resnick, S. and Starica, C. (1995) Second order regular variation, convolution and the central limit theorem. Preprint. Google Scholar
Goldie, C. and Smith, R. (1987) Slow variation with remainder: theory and applications. Quart. J. Math. 38, 45–71.Google Scholar
Haan, L. De and Peng, L. (1995) Comparison of tail index estimators. Preprint. Google Scholar
Haan, L. De and Resnick, S. I. (1994) Estimating the limit distribution of multivariate extremes. Stoch. Models 9, 275–309.Google Scholar
Haan, L. De and Stadtmüller, U. (1994) Generalized regular variation of second order. Preprint. Google Scholar
Hall, P. (1982) On some simple estimates of an exponent of regular variation. J. R. Statist. Soc. B 44, 37–42.Google Scholar
Hall, P. (1990) Using the bootstrap to estimate mean square error and select smoothing parameter in nonparametric problems. J. Multi. Anal. 32, 177–203.Google Scholar
Hall, P. and Welsh, A. (1985) Adaptive estimates of parameters of regular variation. Ann. Statist. 13, 331–341.CrossRefGoogle Scholar
Häusler, E. and Teugels, J. (1985) On the asymptotic normality of Hill's estimator for the exponent of regular variation. Ann. Statist. 13, 743–756.Google Scholar
Hill, B. (1975) A simple approach to inference about the tail of a distribution. Ann. Statist. 3, 1163–1174.Google Scholar
Hsing, T. (1991) On tail estimation using dependent data. Ann. Statist. 19, 1547–1569.Google Scholar
Kratz, M. and Resnick, S. (1996) The qq-estimator of the index of regular variation. Stoch. Models 12, 699–724.CrossRefGoogle Scholar
Mason, D. (1982) Laws of large numbers for sums of extreme values. Ann. Prob. 10, 754–764.Google Scholar
Mason, D. (1988) A strong invariance theorem for the tail empirical process. Ann. Inst. Henri Poincaré 24, 491–506.Google Scholar
Mason, D. and Turova, T. (1994) Weak Convergence of the Hill Estimator Process in Extreme Value Theory and Applications. ed. Galambos, J., Lechner, J. and Simiu, E.. Kluwer, Dordrecht.Google Scholar
Resnick, S. (1987) Extreme Values, Regular Variation and Point Processes. Springer, Berlin.CrossRefGoogle Scholar
Resnick, S. and Starica, C. (1995) Consistency of Hill's estimator for dependent data. J. Appl. Prob. 32, 139–167.Google Scholar
Rootzen, H., Leadbetter, M. and De Haan, L. (1990) Tail and quantile estimation for strongly mixing stationary sequences. Preprint. Econometric Institute.Google Scholar
Vervaat, W. (1972) Functional central limit theorems for processes with positive drift and their inverses. Z. Wahrscheinlichkeitsth. 23, 249–253.Google Scholar