[R-sig-ME] same old question - lme4 and p-values
nikko at hailmail.net
Mon Apr 7 02:18:30 CEST 2008
I feel compelled to ad my 2c here. I am strongly against
the reporting of p-values for several reasons. There are the slew
of theoretical arguments about p-values, the most compelling is which is
correct null distribution, and that p-values are a very measure of
evidence, if they measure evidence at all. p-values only measure the
alternative, and are not a measure of evidence of one model over another
can be ranked over a set of alternate models. See Royall 1997, or Taper
and Lele 2004.
These arguments aside, in the world where I work, early development
pharmaceuticals, many scientists and
managers would have the p-values make decisions for them. This is very
dangerous, as the
experiment to experiment variation is usually much higher than the
within experiment variation.
Even more important, it is not clear to me that many of the processes we
at converge to a stable distribution. I think that the responsibility of
in a publication is to show the variability of the data, explain the
variation and how they were controlled, the relevant effect sizes and
made in the model. In either the epidemiological or the experimental
consensus will only come with demonstrated repeatability. A publication
generate scientific discussion about the mechanisms and trends being
reported. I am
not sure that p-values generate the right discussion.
Didn't mean to rant.
Statistical Evidence: A Likelihood Paradigm. R. Royall, Chapman & Hall,
MARK L. TAPER AND SUBHASH R. LELE, eds. The Nature of Scientific
Evidence: Statistical, Philosophical,
and Empirical Considerations. Chicago and London: University of Chicago
More information about the R-sig-mixed-models