EDP Sciences Journals List
Issue ESAIM: PS
Volume 12
Page(s) 438 - 463
DOI 10.1051/ps:2007050
Published online 25 July 2008

ESAIM: PS, July 2008, Vol. 12, p. 438-463
DOI: 10.1051/ps:2007050

Density estimation with quadratic loss: a confidence intervals method

Pierre Alquier1, 2

1  Laboratoire de Probabilités et Modèles Aléatoires, Université Paris 6, France; alquier@ensae.fr
2  Laboratoire de Statistique, CREST 3, avenue Pierre Larousse, 92240 Malakoff, France.


Received 10 October 2007. Published online 25 July 2008

Abstract
We propose a feature selection method for density estimation with quadratic loss. This method relies on the study of unidimensional approximation models and on the definition of confidence regions for the density thanks to these models. It is quite general and includes cases of interest like detection of relevant wavelets coefficients or selection of support vectors in SVM. In the general case, we prove that every selected feature actually improves the performance of the estimator. In the case where features are defined by wavelets, we prove that this method is adaptative near minimax (up to a log term) in some Besov spaces. We end the paper by simulations indicating that it must be possible to extend the adaptation result to other features.


Mathematics Subject Classification. 62G07, 62G15, 62G20, 68T05, 68Q32

Key words: Density estimation, support vector machines, kernel algorithms, thresholding methods, wavelets


© EDP Sciences, SMAI 2008


What is OpenURL?

The OpenURL standard is a protocol for transmission of metadata describing the resource that you wish to access. An OpenURL link contains article metadata and directs it to the OpenURL server of your choice. The OpenURL server can provide access to the resource and also offer complementary services (specific search engine, export of references...). The OpenURL link can be generated by different means.
  • If your librarian has set up your subscription with an OpenURL resolver, OpenURL links appear automatically on the abstract pages.
  • You can define your own OpenURL resolver with your EDPS Account. In this case your choice will be given priority over that of your library.
  • You can use an add-on for your browser (Firefox or I.E.) to display OpenURL links on a page (see http://www.openly.com/openurlref/). You should disable this module if you wish to use the OpenURL server that you or your library have defined.