[Statlist] ETH/UZH Research Seminar on Statistics by Elliot Young, The University of Cambridge, UK, 07.03.2024

[Maurer Letizia]

We are glad to announce the following talk in the ETH/UZH Research Seminar on Statistics:

"Sandwich Boosting for accurate estimation in partially linear models for grouped data"   

by Elliot Young, The University of Cambridge, UK

Time: Thursday,  07.03.2024 at 16.15 h
Place: ETH Zurich, HG G 19.1

Abstract: We study partially linear models in settings where observations are arranged in independent groups but may exhibit within-​group dependence. Existing approaches estimate linear model parameters through weighted least squares, with optimal weights (given by the inverse covariance of the response, conditional on the covariates) typically estimated by maximising a (restricted) likelihood from random effects modelling or by using generalised estimating equations. We introduce a new ‘sandwich loss’ whose population minimiser coincides with the weights of these approaches when the parametric forms for the conditional covariance are well-​specified, but can yield arbitrarily large improvements in linear parameter estimation accuracy when they are not. Under relatively mild conditions, our weighted least squares (within a double machine learning framework) estimated coefficients are asymptotically Gaussian and enjoy minimal variance among estimators with weights restricted to a given class of functions, when user-​chosen regression methods are used to estimate nuisance functions. We further expand the class of functional forms for the weights that may be fitted beyond parametric models by leveraging the flexibility of modern machine learning methods within a new gradient boosting scheme for minimising the sandwich loss. We demonstrate the effectiveness of both the sandwich loss and what we call ‘sandwich boosting’ in a variety of settings with simulated and real-​world data.

Seminar website: https://math.ethz.ch/sfs/news-and-events/research-seminar.html

Research Seminar – Seminar for Statistics | ETH Zurich
math.ethz.ch