English
De-biasing arbitrary convex regularizers and asymptotic normality
Virtualconference
Auteurs : Bellec, Pierre C. (Auteur de la Conférence)
... (Editeur )
Ressources complémentaires :
https://www.cirm-math.fr/RepOrga/2146/Slides/Bellec_slides.pdf
... (Editeur )
Loading the player...
|
Résumé :
A new Central Limit Theorem (CLT) is developed for random variables of the form ξ=z⊤f(z)−divf(z) where z∼N(0,In).
The normal approximation is proved to hold when the squared norm of f(z) dominates the squared Frobenius norm of ∇f(z) in expectation.
Applications of this CLT are given for the asymptotic normality of de-biased estimators in linear regression with correlated design and convex penalty in the regime p/n→γ∈(0,∞). For the estimation of linear functions ⟨a,β⟩ of the unknown coefficient vector β, this analysis leads to asymptotic normality of the de-biased estimate for most normalized directions a0, where "most" is quantified in a precise sense. This asymptotic normality holds for any coercive convex penalty if γ<1 and for any strongly convex penalty if γ≥1. In particular the penalty needs not be separable or permutation invariant.
Keywords : M-estimators; convex regularization; asymptotic normality; confidence intervals; de-biasing
Codes MSC : The normal approximation is proved to hold when the squared norm of f(z) dominates the squared Frobenius norm of ∇f(z) in expectation.
Applications of this CLT are given for the asymptotic normality of de-biased estimators in linear regression with correlated design and convex penalty in the regime p/n→γ∈(0,∞). For the estimation of linear functions ⟨a,β⟩ of the unknown coefficient vector β, this analysis leads to asymptotic normality of the de-biased estimate for most normalized directions a0, where "most" is quantified in a precise sense. This asymptotic normality holds for any coercive convex penalty if γ<1 and for any strongly convex penalty if γ≥1. In particular the penalty needs not be separable or permutation invariant.
Keywords : M-estimators; convex regularization; asymptotic normality; confidence intervals; de-biasing
Ressources complémentaires :
https://www.cirm-math.fr/RepOrga/2146/Slides/Bellec_slides.pdf
|
Informations sur la Vidéo
Réalisateur : Hennenfent, GuillaumeLangue : Anglais Date de publication : 15/06/2020 Date de captation : 05/06/2020 Sous collection : Research talks arXiv category : Statistics Theory ; Computational Geometry Domaine : Probability & Statistics Format : MP4 (.mp4) - HD Durée : 00:46:32 Audience : Researchers Download : https://videos.cirm-math.fr/ 2020-06-05_Bellec.mp4 
|
Informations sur la Rencontre
Nom de la rencontre : Mathematical Methods of Modern Statistics 2 / Méthodes mathématiques en statistiques modernes 2Organisateurs de la rencontre : Bogdan, Malgorzata ; Graczyk, Piotr ; Panloup, Fabien ; Proïa, Frédéric ; Roquain, Etienne Dates : 15/06/2020 - 19/06/2020 Année de la rencontre : 2020 URL Congrès : https://www.cirm-math.com/cirm-virtual-...
Données de citation
DOI : 10.24350/CIRM.V.19640503Citer cette vidéo: Bellec, Pierre C. (2020). De-biasing arbitrary convex regularizers and asymptotic normality. CIRM. Audiovisual resource. doi:10.24350/CIRM.V.19640503 URI : http://dx.doi.org/10.24350/CIRM.V.19640503 |
Voir aussi
- [Virtualconference] Experimenting in equilibrium / Auteur de la Conférence Wager, Stefan.
- [Virtualconference] Structure learning for CTBN's / Auteur de la Conférence Miasojedow, Błażej.
- [Virtualconference] The price of competition: effect size heterogeneity matters in high dimensions! / Auteur de la Conférence Wang, Hua.
- [Virtualconference] Scaling of scoring rules / Auteur de la Conférence Wallin, Jonas.
- [Virtualconference] Hierarchical bayes modeling for large-scale inference / Auteur de la Conférence Yekutieli, Daniel.
- [Virtualconference] Change: detection, estimation, segmentation / Auteur de la Conférence Siegmund, David.
- [Virtualconference] High-dimensional, multiscale online changepoint detection / Auteur de la Conférence Samworth, Richard.
- [Virtualconference] The smoothed multivariate square-root Lasso: an optimization lens on concomitant estimation / Auteur de la Conférence Salmon, Joseph.
- [Virtualconference] Knockoff genotypes: value in counterfeit / Auteur de la Conférence Sabatti, Chiara.
- [Virtualconference] Optimal and maximin procedures for multiple testing problems / Auteur de la Conférence Rosset, Saharon.
- [Virtualconference] Sparse multiple testing: can one estimate the null distribution ? / Auteur de la Conférence Roquain, Etienne.
- [Virtualconference] Bayesian spatial adaptation / Auteur de la Conférence Rockova, Veronika.
- [Virtualconference] Universal inference using the split likelihood ratio test / Auteur de la Conférence Ramdas, Aaditya K..
- [Virtualconference] How to estimate a density on a spider web ? / Auteur de la Conférence Picard, Dominique.
- [Virtualconference] Post hoc bounds on false positives using reference families / Auteur de la Conférence Neuvial, Pierre.
- [Virtualconference] Quasi logistic distributions and Gaussian scale mixing / Auteur de la Conférence Letac, Gerard.
- [Virtualconference] Shrinkage estimation of mean for complex multivariate normal distribution with unknown covariance when p > n / Auteur de la Conférence Konno, Yoshihiko.
- [Virtualconference] Treatment effect estimation with missing attributes / Auteur de la Conférence Josse, Julie.
- [Virtualconference] Floodgate: inference for model-free variable importance / Auteur de la Conférence Janson, Lucas.
- [Virtualconference] On Cholesky structures on real symmetric matrices and their applications / Auteur de la Conférence Ishi, Hideyuki.
- [Virtualconference] Optimal control of false discovery criteria in the general two-group model / Auteur de la Conférence Heller, Ruth.
- [Virtualconference] Isotonic Distributional Regression (IDR) - leveraging monotonicity, uniquely so! / Auteur de la Conférence Gneiting, Tilmann.
- [Virtualconference] Consistent model selection criteria and goodness-of-fit test for common time series models / Auteur de la Conférence Bardet, Jean-Marc.
- [Virtualconference] High-dimensional classification by sparse logistic regression / Auteur de la Conférence Abramovich, Felix.
Bibliographie
- BELLEC, Pierre C. et ZHANG, Cun-Hui. Second order Poincar\'e inequalities and de-biasing arbitrary convex regularizers when $ p/n\to\gamma$. arXiv preprint arXiv:1912.11943, 2019. - https://arxiv.org/abs/1912.11943
- BELLEC, Pierre C. et ZHANG, Cun-Hui. De-biasing the lasso with degrees-of-freedom adjustment. arXiv preprint arXiv:1902.08885, 2019. - https://arxiv.org/abs/1902.08885
