Foundations and Trends® in Signal Processing > Vol 8 > Issue 3

Structured Robust Covariance Estimation

By Ami Wiesel, The Hebrew University of Jerusalem, Israel, amiw@cs.huji.ac.il | Teng Zhang, University of Central Florida, USA, teng.zhang@ucf.edu

 
Suggested Citation
Ami Wiesel and Teng Zhang (2015), "Structured Robust Covariance Estimation", Foundations and Trends® in Signal Processing: Vol. 8: No. 3, pp 127-216. http://dx.doi.org/10.1561/2000000053

Publication Date: 22 Dec 2015
© 2015 A. Wiesel and T. Zhang
 
Subjects
Optimization,  Statistical signal processing: classification and detection,  Statistical signal processing: estimation and regression,  Detection and estimation,  Information theory and statistics
 

Free Preview:

Download extract

Share

Download article
In this article:
Notations and Acronyms
1. Preliminaries
2. Robust Covariance Estimation
3. Tyler’s Estimator
4. Regularization
5. G-convex Structure
6. Extensions
Acknowledgements
References

Abstract

We consider robust covariance estimation with an emphasis on Tyler’s M-estimator. This method provides accurate inference of an unknown covariance in non-standard settings, including heavy-tailed distributions and outlier contaminated scenarios. We begin with a survey of the estimator and its various derivations in the classical unconstrained settings. The latter rely on the theory of g-convex analysis which we briefly review. Building on this background, we enhance robust covariance estimation via g-convex regularization, and allow accurate inference using a smaller number of samples. We consider shrinkage, diagonal loading, and prior knowledge in the form of symmetry and Kronecker structures. We introduce these concepts to the world of robust covariance estimation, and demonstrate how to exploit them in a computationally and statistically efficient manner.

DOI:10.1561/2000000053
ISBN: 978-1-68083-094-1
104 pp. $75.00
Buy book (pb)
 
ISBN: 978-1-68083-095-8
104 pp. $125.00
Buy E-book (.pdf)
Table of contents:
Notations and Acronyms
1. Preliminaries
2. Robust Covariance Estimation
3. Tyler’s Estimator
4. Regularization
5. G-convex Structure
6. Extensions
Acknowledgements
References

Structured Robust Covariance Estimation

Covariance matrices have found applications in many diverse areas. These include beamforming in array processing; portfolio analysis in finance; classification of data and the handling of high-frequency data.

Structured Robust Covariance Estimation considers the estimation of covariance matrices in non-standard conditions including heavy-tailed distributions and outlier contamination. Prior knowledge on the structure of these matrices is exploited in order to improve the estimation accuracy. The distributions, structures and algorithms are all based on an extension of convex optimization to manifolds.

Structured Robust Covariance Estimation also provides a self-contained introduction and survey of the theory known as geodesic convexity. This is a generalized form of convexity associated with positive definite matrix variables. The fundamental g-convex sets and functions are detailed, along with the operations that preserve them, and their application to covariance estimation.

This monograph will be of interest to researchers and students working in signal processing, statistics and optimization.

 
SIG-053