Hostname: page-component-78c5997874-lj6df Total loading time: 0 Render date: 2024-11-13T10:20:59.621Z Has data issue: false hasContentIssue false
  • English
  • Français

Nonparametric regression estimation based on spatiallyinhomogeneous data: minimax global convergence rates and adaptivity

Published online by Cambridge University Press:  06 December 2013

Anestis Antoniadis ,
Marianna Pensky  and
Theofanis Sapatinas
Anestis Antoniadis
Affiliation:
Laboratoire Jean Kuntzmann, Universite Joseph Fourier, 38041 Grenoble Cedex 9, France. [email protected]
Marianna Pensky
Affiliation:
Department of Mathematics, University of Central Florida, Orlando, 32816-1364, USA; [email protected]
Theofanis Sapatinas
Affiliation:
Department of Mathematics and Statistics, University of Cyprus, P.O. Box 20537, CY 1678 Nicosia, Cyprus; [email protected]
Get access

Abstract

We consider the nonparametric regression estimation problem of recovering an unknownresponse function f on the basis of spatially inhomogeneous data when thedesign points follow a known density g with a finite number ofwell-separated zeros. In particular, we consider two different cases: wheng has zeros of a polynomial order and when g has zerosof an exponential order. These two cases correspond to moderate and severe data losses,respectively. We obtain asymptotic (as the sample size increases) minimax lower bounds forthe L2-risk when f is assumed to belong to aBesov ball, and construct adaptive wavelet thresholding estimators of fthat are asymptotically optimal (in the minimax sense) or near-optimal within alogarithmic factor (in the case of a zero of a polynomial order), over a wide range ofBesov balls. The spatially inhomogeneous ill-posed problem that we investigate isinherently more difficult than spatially homogeneous ill-posed problems like,e.g., deconvolution. In particular, due to spatial irregularity,assessment of asymptotic minimax global convergence rates is a much harder task than thederivation of asymptotic minimax local convergence rates studied recently in theliterature. Furthermore, the resulting estimators exhibit very different behavior andasymptotic minimax global convergence rates in comparison with the solution of spatiallyhomogeneous ill-posed problems. For example, unlike in the deconvolution problem, theasymptotic minimax global convergence rates are greatly influenced not only by the extentof data loss but also by the degree of spatial homogeneity of f.Specifically, even if 1/g is non-integrable, one can recoverf as well as in the case of an equispaced design (in terms ofasymptotic minimax global convergence rates) when it is homogeneous enough since theestimator is “borrowing strength” in the areas where f is adequatelysampled.

Keywords

AdaptivityBesov spacesinhomogeneous dataminimax estimationnonparametric regressionthresholdingwavelet estimation
Type
Research Article
Information
ESAIM: Probability and Statistics , Volume 18 , 2014 , pp. 1 - 41
Copyright
© EDP Sciences, SMAI 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Amato, U., Antoniadis, A. and Pensky, M., Wavelet kernel penalized estimation for non-equispaced design regression. Statist. Comput. 16 (2006) 37–55. Google Scholar
Antoniadis, A. and Pham, D.T., Wavelet regression for random or irregular design. Comput. Statist. Data Anal. 28 (1998) 353–369. Google Scholar
Bissantz, N., Dumbgen, L., Holzmann, H. and Munk, A., Nonparametric confidence bands in deconvolution density estimation. J. Royal Statist. Soc. Series B 69 (2007) 483–506. Google Scholar
Brown, L.D., Cai, T.T., Low, M.G. and Zhang, C.H., Asymptotic equivalence theory for nonparametric regression with random design. Annal. Statist. 30 (2002) 688–707. Google Scholar
Cai, T.T. and Brown, L.D., Wavelet shrinkage for nonequispaced samples. Annal. Statist. 26 (1998) 1783–1799. Google Scholar
Chesneau, C., Regression in random design: a minimax study. Statist. Probab. Lett. 77 (2007) 40–53. Google Scholar
I. Daubechies, Ten Lectures on Wavelets. Philadelphia: SIAM (1992).
R.B. Dingle, Asymptotic Expansions: Their Derivation and Interpretation. London: Academic Press (1973).
Gaïffas, S.,. Convergence rates for pointwise curve estimation with a degenerate design. Math. Meth. Statist. 14 (2005) 1–27. Google Scholar
Gaïffas, S., Sharp estimation in sup norm with random design. Statist. Probab. Lett. 77 (2006) 782–794. Google Scholar
Gaïffas, S., On pointwise adaptive curve estimation based on inhomogeneous data. ESAIM: Probab. Statist. 11 (2007) 344–364. Google Scholar
Gaïffas, S., Uniform estimation of a signal based on inhomogeneous data. Statistica Sinica 19 (2009) 427–447. Google Scholar
Giné, E. and Nickl, R., Confidence bands in density estimation. Annal. Statist. 38 (2010) 1122–1170. Google Scholar
Guillou, A. and Klutchnikoff, N., Minimax pointwise estimation of an anisotropic regression function with unknown density of the design. Math. Methods Statist. 20 (2011) 30–57. Google Scholar
Hall, P. and Turlach, B.A., Interpolation methods for nonlinear wavelet regression with irregularly spaced design. Annal. Statist. 25 (1997) 1912–1925. Google Scholar
W. Härdle, G. Kerkyacharian, D. Picard and A. Tsybakov, Wavelets, Approximation, and Statistical Applications, vol. 129 of Lect. Notes Statist. Springer-Verlag, New York (1998).
Hoffmann, M. and Reiss, M., Nonlinear estimation for linear inverse problems with error in the operator. Annal. Statist. 36 (2008) 310–336. Google Scholar
I.M. Johnstone, Minimax Bayes, asymptotic minimax and sparse wavelet priors, in Statistical Decision Theory and Related Topics, edited by S.S. Gupta and J.O. Berger. Springer-Verlag, New York (1994) 303–326,
I.M. Johnstone, Function Estimation and Gaussian Sequence Models. Unpublished Monograph (2002). http://statweb.stanford.edu/~imj/
Johnstone, I.M., Kerkyacharian, G., Picard, D. and Raimondo, M., Wavelet deconvolution in a periodic setting. J. Royal Statist. Soc. Series B 66 (2004) 547-573 (with discussion, 627--657). Google Scholar
Kerkyacharian, G. and Picard, D., Regression in random design and warped wavelets. Bernoulli 10 (2004) 1053-1105. Google Scholar
Kohler, M., Nonlinear orthogonal series estimation for random design regression. J. Statist. Plann. Inference 115 (2003) 491-520. Google Scholar
A.P. Korostelev and A.B. Tsybakov, Minimax Theory of Image Reconstruction, vol. 82 of Lect. Notes Statist. Springer-Verlag, New York (1993).
Kovac, A. and Silverman, B.W., Extending the scope of wavelet regression methods by coefficient-dependent thresholding. J. Amer. Statist. Assoc. 95 (2000) 172-183. Google Scholar
Kulik, R. and Raimondo, M., Wavelet regression in random design with heteroscedastic dependent errors. Annal. Statist. 37 (2009) 3396-3430. Google Scholar
Lepski, O.V., A problem of adaptive estimation in Gaussian white noise. Theory Probab. Appl. 35 (1990) 454-466. Google Scholar
Lepski, O.V., Asymptotically minimax adaptive estimation I: Upper bounds. Optimally adaptive estimators. Theory Probab. Appl. 36 (1991) 682-697. Google Scholar
Lepski, O.V., Mammen, E. and Spokoiny, V.G., Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors Annal. Statist. 25 (1997) 929-947. Google Scholar
Lepski, O. and Spokoiny, V., Optimal pointwise adaptive methods in nonparametric estimation. Annal. Statist. 25 (1997) 2512-2546. Google Scholar
S. Mallat, A Wavelet Tour of Signal Processing. 2nd Edition, Academic Press, San Diego (1999).
Y. Meyer, Wavelets and Operators. Cambridge: Cambridge University Press (1992).
Pensky, M. and Sapatinas, T., Functional deconvolution in a periodic case: uniform case. Annal. Statist. 37 (2009) 73-104. Google Scholar
Pensky, M. and Sapatinas, T., On convergence rates equivalency and sampling strategies in functional deconvolution models. Annal. Statist. 38 (2010) 1793-1844. Google Scholar
Pensky, M. and Vidakovic, B., On non-equally spaced wavelet regression. Annal. Instit. Statist. Math. 53 (2001) 681-690. Google Scholar
Sardy, S., Percival, D.B., Bruce, A.G., Gao, H.-Y. and Stuelzle, W., Wavelet shrinkage for unequally spaced data. Statist. Comput. 9 (1999) 65-75. Google Scholar
Tribouley, K., Adaptive simultaneous confidence intervals in non-parametric estimation. Statist. Probab. Lett. 69 (2004) 37-51. Google Scholar
A.B. Tsybakov, Introduction to Nonparametric Estimation. Springer-Verlag, New York (2009).
G. Wahba, Spline Models for Observational Data. SIAM, Philadelphia (1990).
Zhang, S., Wong, M.-Y. and Zheng, Z., Wavelet threshold estimation of a regression function with random design. J. Multivariate Anal. 80 (2002) 256-284. Google Scholar