Spectral analysis of the Gram matrix of mixture models^∗

¹ MAP 5, UMR CNRS 8145, Université Paris Descartes, Paris, France.
florent.benaych-georges@parisdescartes.fr
² Centrale Supélec, LSS, Université Paris Sud, Gif sur Yvette, France.
romain.couillet@supelec.fr

Received: 16 October 2015
Accepted: 14 March 2016

Abstract

This text is devoted to the asymptotic study of some spectral properties of the Gram matrix W^TW built upon a collection w₁,...,w_n ∈ R^p of random vectors (the columns of W), as both the number n of observations and the dimension p of the observations tend to infinity and are of similar order of magnitude. The random vectors w₁,...,w_n are independent observations, each of them belonging to one of k classes . The observations of each class (1 ≤ a ≤ k) are characterized by their distribution , where C₁,...,C_k are some non negative definite p × p matrices. The cardinality n_a of class and the dimension p of the observations are such that n_a/n (1 ≤ a ≤ k) and p/n stay bounded away from 0 and + ∞. We provide deterministic equivalents to the empirical spectral distribution of W^TW and to the matrix entries of its resolvent (as well as of the resolvent of WW^T). These deterministic equivalents are defined thanks to the solutions of a fixed-point system. Besides, we prove that W^TW has asymptotically no eigenvalues outside the bulk of its spectrum, defined thanks to these deterministic equivalents. These results are directly used in our companion paper [R. Couillet and F. Benaych-Georges, Electron. J. Stat. 10 (2016) 1393–1454.], which is devoted to the analysis of the spectral clustering algorithm in large dimensions. They also find applications in various other fields such as wireless communications where functionals of the aforementioned resolvents allow one to assess the communication performance across multi-user multi-antenna channels.