EDP Sciences Journals List
Home Document
Subscriber Authentication Point
Free access article

Issue ESAIM: PS
Volume 9, 2005
Page(s) 220 - 229
DOI 10.1051/ps:2005011

ESAIM: P&S, June 2005, Vol. 9, pp. 220-229
DOI: 10.1051/ps:2005011

Risk bounds for mixture density estimation

Alexander Rakhlin1, Dmitry Panchenko2 and Sayan Mukherjee3

1  Center for Biological and Computational Learning, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; rakhlin@mit.edu
2  Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA 02143, USA.
3  Institute of Statistics and Decision Sciences, Institute for Genome Sciences and Policy, Duke University, Durham, NC 27708, USA.


(Received July 21, 2004.)

Abstract
In this paper we focus on the problem of estimating a bounded density using a finite combination of densities from a given class. We consider the Maximum Likelihood Estimator (MLE) and the greedy procedure described by Li and Barron (1999) under the additional assumption of boundedness of densities. We prove an $O(\frac{1}{\sqrt{n}})$ bound on the estimation error which does not depend on the number of densities in the estimated combination. Under the boundedness assumption, this improves the bound of Li and Barron by removing the $\log n$ factor and also generalizes it to the base classes with converging Dudley integral.


Mathematics Subject Classification. 62G05, 62G07, 62G20.

Key words: Mixture density estimation, maximum likelihood, Rademacher processes.


© EDP Sciences, SMAI 2005


What is OpenURL?

The OpenURL standard is a protocol for transmission of metadata describing the resource that you wish to access. An OpenURL link contains article metadata and directs it to the OpenURL server of your choice. The OpenURL server can provide access to the resource and also offer complementary services (specific search engine, export of references...). The OpenURL link can be generated by different means.
  • If your librarian has set up your subscription with an OpenURL resolver, OpenURL links appear automatically on the abstract pages.
  • You can define your own OpenURL resolver with your EDPS Account. In this case your choice will be given priority over that of your library.
  • You can use an add-on for your browser (Firefox or I.E.) to display OpenURL links on a page (see http://www.openly.com/openurlref/). You should disable this module if you wish to use the OpenURL server that you or your library have defined.