Foundations and TrendsŪ in Signal Processing
RETHINKING BIASED ESTIMATION
Improving Maximum Likelihood and the Cramer-Rao Bound
by Yonina C Eldar (Technion-Israel Institute of Technology, Israel)
Rethinking Biased Estimation discusses methods to improve the accuracy of unbiased estimators used in many signal processing problems. At the heart of the proposed methodology is the use of the mean-squared error (MSE) as the performance criteria. One of the prime goals of statistical estimation theory is the development of performance bounds when estimating parameters of interest in a given model, as well as constructing estimators that achieve these limits. When the parameters to be estimated are deterministic, a popular approach is to bound the MSE achievable within the class of unbiased estimators. Although it is well-known that lower MSE can be obtained by allowing for a bias, in applications it is typically unclear how to choose an appropriate bias.
Rethinking Biased Estimation introduces MSE bounds that are lower than the unbiased Cramer-Rao bound (CRB) for all values of the unknowns. It then presents a general framework for constructing biased estimators with smaller MSE than the standard maximum- likelihood (ML) approach, regardless of the true unknown values. Specializing the results to the linear Gaussian model, it derives a class of estimators that dominate least-squares in terms of MSE. It also introduces methods for choosing regularization parameters in penalized ML estimators that outperform standard techniques such as cross validation.
Published by Now Publishers and marketed by World Scientific
Contents:
- Introduction
- The Cramer-Rao Bound and Extensions
- Mean-Squared
Error Bounds
- Minimax and Blind Minimax Estimation
- The SURE Principle
- Bounded Error Estimation
- Acknowledgements
- Notations and Acronyms
- A Convex Optimization Methods
- References
Readership: Postgraduates, researchers and professionals.
| 156pp |
Pub. date: May 2008 |
|
