Authors : Ramdas, Aaditya K. (Author of the conference)
CIRM (Publisher )
Abstract :
We propose a general method for constructing confidence sets and hypothesis tests that have finite-sample guarantees without regularity conditions. We refer to such procedures as “universal.” The method is very simple and is based on a modified version of the usual likelihood ratio statistic, that we call “the split likelihood ratio test” (split LRT) statistic. The (limiting) null distribution of the classical likelihood ratio statistic is often intractable when used to test composite null hypotheses in irregular statistical models. Our method is especially appealing for statistical inference in these complex setups. The method we suggest works for any parametric model and also for some nonparametric models, as long as computing a maximum likelihood estimator (MLE) is feasible under the null. Canonical examples arise in mixture modeling and shape-constrained inference, for which constructing tests and confidence sets has been notoriously difficult. We also develop various extensions of our basic methods. We show that in settings when computing the MLE is hard, for the purpose of constructing valid tests and intervals, it is sufficient to upper bound the maximum likelihood. We investigate some conditions under which our methods yield valid inferences under model-misspecification. Further, the split LRT can be used with profile likelihoods to deal with nuisance parameters, and it can also be run sequentially to yield anytime-valid p-values and confidence sequences. Finally, when combined with the method of sieves, it can be used to perform model selection with nested model classes.
Keywords : Irregular models; confidence sequences; maximum likelihood
MSC Codes :
62C05
- General considerations
62F03
- Hypothesis testing
62G10
- Nonparametric hypothesis testing
62L12
- Sequential estimation
Additional resources :
https://www.cirm-math.com/uploads/2/6/6/0/26605521/ramdas_universal.pdf
Film maker : Hennenfent, Guillaume
Language : English
Available date : 15/06/2020
Conference Date : 05/06/2020
Subseries : Research talks
arXiv category : Statistics Theory
Mathematical Area(s) : Probability & Statistics
Format : MP4 (.mp4) - HD
Video Time : 00:34:30
Targeted Audience : Researchers
Download : https://videos.cirm-math.fr/2020-06-05_Ramdas.mp4
|
Event Title : Mathematical Methods of Modern Statistics 2 / Méthodes mathématiques en statistiques modernes 2 Event Organizers : Bogdan, Malgorzata ; Graczyk, Piotr ; Panloup, Fabien ; Proïa, Frédéric ; Roquain, Etienne Dates : 15/06/2020 - 19/06/2020
Event Year : 2020
Event URL : https://www.cirm-math.com/cirm-virtual-...
DOI : 10.24350/CIRM.V.19642303
Cite this video as:
Ramdas, Aaditya K. (2020). Universal inference using the split likelihood ratio test. CIRM. Audiovisual resource. doi:10.24350/CIRM.V.19642303
URI : http://dx.doi.org/10.24350/CIRM.V.19642303
|
See Also
-
[Virtualconference]
Experimenting in equilibrium
/ Author of the conference Wager, Stefan.
-
[Virtualconference]
Structure learning for CTBN's
/ Author of the conference Miasojedow, Błażej.
-
[Virtualconference]
The price of competition: effect size heterogeneity matters in high dimensions!
/ Author of the conference Wang, Hua.
-
[Virtualconference]
Scaling of scoring rules
/ Author of the conference Wallin, Jonas.
-
[Virtualconference]
Hierarchical bayes modeling for large-scale inference
/ Author of the conference Yekutieli, Daniel.
-
[Virtualconference]
Change: detection, estimation, segmentation
/ Author of the conference Siegmund, David.
-
[Virtualconference]
High-dimensional, multiscale online changepoint detection
/ Author of the conference Samworth, Richard.
-
[Virtualconference]
The smoothed multivariate square-root Lasso: an optimization lens on concomitant estimation
/ Author of the conference Salmon, Joseph.
-
[Virtualconference]
Knockoff genotypes: value in counterfeit
/ Author of the conference Sabatti, Chiara.
-
[Virtualconference]
Optimal and maximin procedures for multiple testing problems
/ Author of the conference Rosset, Saharon.
-
[Virtualconference]
Sparse multiple testing: can one estimate the null distribution ?
/ Author of the conference Roquain, Etienne.
-
[Virtualconference]
Bayesian spatial adaptation
/ Author of the conference Rockova, Veronika.
-
[Virtualconference]
How to estimate a density on a spider web ?
/ Author of the conference Picard, Dominique.
-
[Virtualconference]
Post hoc bounds on false positives using reference families
/ Author of the conference Neuvial, Pierre.
-
[Virtualconference]
Quasi logistic distributions and Gaussian scale mixing
/ Author of the conference Letac, Gerard.
-
[Virtualconference]
Shrinkage estimation of mean for complex multivariate normal distribution with unknown covariance when p > n
/ Author of the conference Konno, Yoshihiko.
-
[Virtualconference]
Treatment effect estimation with missing attributes
/ Author of the conference Josse, Julie.
-
[Virtualconference]
Floodgate: inference for model-free variable importance
/ Author of the conference Janson, Lucas.
-
[Virtualconference]
On Cholesky structures on real symmetric matrices and their applications
/ Author of the conference Ishi, Hideyuki.
-
[Virtualconference]
Optimal control of false discovery criteria in the general two-group model
/ Author of the conference Heller, Ruth.
-
[Virtualconference]
Isotonic Distributional Regression (IDR) - leveraging monotonicity, uniquely so!
/ Author of the conference Gneiting, Tilmann.
-
[Virtualconference]
De-biasing arbitrary convex regularizers and asymptotic normality
/ Author of the conference Bellec, Pierre C..
-
[Virtualconference]
Consistent model selection criteria and goodness-of-fit test for common time series models
/ Author of the conference Bardet, Jean-Marc.
-
[Virtualconference]
High-dimensional classification by sparse logistic regression
/ Author of the conference Abramovich, Felix.
Bibliography
- WASSERMAN, Larry, RAMDAS, Aaditya, et BALAKRISHNAN, Sivaraman. Universal Inference Using the Split Likelihood Ratio Test. arXiv preprint arXiv:1912.11436, 2019. - https://arxiv.org/abs/1912.11436