Graczyk, P., Schneider, U., Skalski, T., & Tardivel, P. (2023). Pattern Recovery in Penalized Estimation and its Geometry. In European Meeting of Statisticians 2023 : Book of Abstracts (pp. 223–223).
E105-02 - Forschungsbereich Ökonometrie und Systemtheorie
-
Published in:
European Meeting of Statisticians 2023 : Book of Abstracts
-
Date (published):
2023
-
Event name:
European Meeting of Statisticians 2023
en
Event date:
3-Jul-2023 - 7-Jul-2023
-
Event place:
Warsaw, Poland
-
Number of Pages:
1
-
Keywords:
Penalized Estimation; Pattern Recovery
en
Abstract:
For many penalized estimators such as LASSO, SLOPE, OSCAR, PACS, fused, clustered and generalized LASSO, the penalty term is a real-valued polyhedral gauge. We focus on pattern recovery at β with respect to such a penalty term, where β is the unknown parameter of regression coefficients. For LASSO, the pattern of β only depends on the sign of β and sign recovery by LASSO is a well known topic in the literature. We introduce the notion of patterns and pattern recovery in the broad framework of gauge-penalized least-squares estimation and illustrate the patterns different polyhedral gauges. We also provide theoretical guarantees for pattern recovery, in particular the “noiseless recovery condition” is necessary for a probability of recovery larger than 1/2 and can be viewed as a generalization of the LASSO’s irrepresentability condition. This condition may be relaxed using thresholded penalized least squares estimators, a class of estimators generalizing the thresholded LASSO. Indeed, we show that the “accessibility condition”, a weaker condition than the “noiseless recovery condition”, is necessary and asymptotically sufficient for pattern recovery in thresholded penalized estimation. We also provide a geometric interpretation of our approach to pattern recovery and the accessibility condition.
en
Research Areas:
Mathematical Methods in Economics: 40% Mathematical and Algorithmic Foundations: 20% Fundamental Mathematics Research: 40%