[R-sig-ME] lme4 sanple size analysis / power analysis by simulation ...

[David Winsemius]

On Oct 22, 2013, at 6:35 AM, Lenth, Russell V wrote:

> The reviewers were NOT correct in questioning whether you had sufficient power. Power is the probability of rejecting a null hypothesis. You have the data, you did your analysis, so you know which hypotheses were rejected (retrospectively, the power of those is 1) and those you did not (retrospective power of 0). There is no more information about power to be gleaned with respect to those data and analyses. You can use power calculations to decide sample size for a future study only.

Don't we need to know what conclusions were being questioned when we say this? I don't disagree about the vacuity of doing post-hoc power analyses, especially when the study of a rare condition will effectively place a hard limit on sample size. However, if conclusions were being submitted about "no difference" for the features that were "not significant", isn't it possible that questions about power would have validity?


> 
> Russ
> 
> -- 
> Russell V. Lenth  -  Professor Emeritus
> Department of Statistics and Actuarial Science   
> The University of Iowa  -  Iowa City, IA 52242  USA   
> Dept office (319)335-0712  -  FAX (319)335-3017   
> russell-lenth at uiowa.edu  -  http://www.stat.uiowa.edu/~rlenth/ 
> 
> ...
> The paper was accepted with revisions which is where we are now. The
> reviewers correctly questioned to what extent we had sufficient power to
> come to the conclusions we did. I do not want to perform a post-hoc power
> analysis because from what I have read and seen on R discussions it is
> discouraged.
> ...
> 
> _______________________________________________
> R-sig-mixed-models at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-mixed-models

David Winsemius
Alameda, CA, USA