[R-sig-ME] Calculating effect sizes of fixed effects in lmer

[FAIRS Amie]

Dear James,

Thank you so much ! I’ll check out all the references and your R package.

Best,

Amie

------------------
Dr. Amie Fairs
Post-doctorant
Aix-Marseille Université
Laboratoire Parole et Langage (LPL) | CNRS UMR 7309 | 5 Avenue Pasteur | 13100 Aix-en-Provence
Email : amie.fairs using univ-amu.fr<mailto:amie.fairs using univ-amu.fr>

While I may send this email outside of typical working hours, I have no expectation to receive an email outside of your typical hours.

From: James Pustejovsky <jepusto using gmail.com>
Sent: 24 September 2020 16:58
To: FAIRS Amie <amie.FAIRS using univ-amu.fr>
Cc: Viechtbauer, Wolfgang (SP) <wolfgang.viechtbauer using maastrichtuniversity.nl>; r-sig-mixed-models using r-project.org
Subject: Re: [R-sig-ME] Calculating effect sizes of fixed effects in lmer

Hi Amie,

I agree very much with Wolfgang's perspective that one would ideally use outcomes such that unstandardized effects can be interpreted directly. If one does have to fall back on standardized effect sizes, there's a further question of what metric to use. Researchers often jump immediately to standardized mean differences, but there are certainly other possibilities, such as log response ratios for outcomes that are measured on ratio scales.

All that said, there has been a fair amount of work on standardized mean difference effect sizes for certain types of research designs that would usually be analyzed with multi-level models. A sampling (including some of my own):

  *   Hedges, L. V. (2007). Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32(4), 341-370.
  *   Hedges, L. V. (2011). Effect sizes in three-level cluster-randomized experiments. Journal of Educational and Behavioral Statistics, 36(3), 346-380.
  *   Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014). Design-comparable effect sizes in multiple baseline designs: A general modeling framework. Journal of Educational and Behavioral Statistics, 39(5), 368-393.
  *   Stapleton, L. M., Pituch, K. A., & Dion, E. (2015). Standardized effect size measures for mediation analysis in cluster-randomized trials. The Journal of Experimental Education, 83(4), 547-582.
  *   Feingold, A. (2009). Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis. Psychological Methods, 14(1), 43.
One of my students and I have also developed an R package for estimating standardized mean differences from multilevel models fitted with nlme::lme()
https://CRAN.R-project.org/package=lmeInfo
Kind Regards,
James

	[[alternative HTML version deleted]]