Kirjahaku

This is a revised and extended version of the French book. The main changes are in Chapter 1 where the former Section 1. 3 is removed and the rest of the material is substantially revised. Sections 1. 2. 4, 1. 3, 1. 9, and 2. 7. 3 are new. Each chapter now has the bibliographic notes and contains the exercises section. I would like to thank Cristina Butucea, Alexander Goldenshluger, Stephan Huckenmann, Yuri Ingster, Iain Johnstone, Vladimir Koltchinskii, Alexander Korostelev, Oleg Lepski, Karim Lounici, Axel Munk, Boaz Nadler, AlexanderNazin,PhilippeRigollet,AngelikaRohde,andJonWellnerfortheir valuable remarks that helped to improve the text. I am grateful to Centre de Recherche en Economie et Statistique (CREST) and to Isaac Newton Ins- tute for Mathematical Sciences which provided an excellent environment for ?nishing the work on the book. My thanks also go to Vladimir Zaiats for his highly competent translation of the French original into English and to John Kimmel for being a very supportive and patient editor. Alexandre Tsybakov Paris, June 2008 Preface to the French Edition The tradition of considering the problem of statistical estimation as that of estimation of a ?nite number of parameters goes back to Fisher. However, parametric models provide only an approximation, often imprecise, of the - derlying statistical structure. Statistical models that explain the data in a more consistent way are often more complex: Unknown elements in these models are, in general, some functions having certain properties of smoo- ness.

This is a revised and extended version of the French book. The main changes are in Chapter 1 where the former Section 1. 3 is removed and the rest of the material is substantially revised. Sections 1. 2. 4, 1. 3, 1. 9, and 2. 7. 3 are new. Each chapter now has the bibliographic notes and contains the exercises section. I would like to thank Cristina Butucea, Alexander Goldenshluger, Stephan Huckenmann, Yuri Ingster, Iain Johnstone, Vladimir Koltchinskii, Alexander Korostelev, Oleg Lepski, Karim Lounici, Axel Munk, Boaz Nadler, AlexanderNazin,PhilippeRigollet,AngelikaRohde,andJonWellnerfortheir valuable remarks that helped to improve the text. I am grateful to Centre de Recherche en Economie et Statistique (CREST) and to Isaac Newton Ins- tute for Mathematical Sciences which provided an excellent environment for ?nishing the work on the book. My thanks also go to Vladimir Zaiats for his highly competent translation of the French original into English and to John Kimmel for being a very supportive and patient editor. Alexandre Tsybakov Paris, June 2008 Preface to the French Edition The tradition of considering the problem of statistical estimation as that of estimation of a ?nite number of parameters goes back to Fisher. However, parametric models provide only an approximation, often imprecise, of the - derlying statistical structure. Statistical models that explain the data in a more consistent way are often more complex: Unknown elements in these models are, in general, some functions having certain properties of smoo- ness.

La théorie de l'estimation non-paramétrique s'est développée considérablement ces deux dernières décennies, en se fixant pour objectif quelques thèmes principaux, en particulier, l'étude de l'optimalité des estimateurs et l'estimation adaptative. Ces deux thèmes occupent la place centrale dans le livre. Il s'agit de présenter, pour quelques modèles et exemples simples, les idées principales de l'estimation non-paramétrique. Quelques sujets abordés sont: les méthodes de noyaux, de projection et de polynômes locaux, vitesses optimales de convergence, le théorème de Pinsker, les inégalités d'oracle, l'adaptation au sens minimax. Un chapitre est consacré à l'exposition détaillée des différentes techniques de minoration du risque minimax.