[R-sig-ME] P value value for a large number of degree of freedom in lmer

[Rolf Turner]

On 24/11/2010, at 8:25 AM, Arnaud Mosnier wrote:

> I agree but how to test that a significant result is not due to the amount of data but by a real effect.

	The point is that there is *always* a ``real'' effect,
	and a large enough sample will detect this.  The question is
	whether this effect is meaningful or of *practical* significance.

> I though about subsetting my dataset and rerun the model X time to see if the result still persist ... but you can also say that doing so I will achieve to find a (small enough) size of subset at which I will not detect the effect :-)
> I also agree that the term "bias" was not correctly used ... but is there a method to increase the confidence in those results ?


Stop thinking p-values.  Think estimates and confidence intervals for
the estimated quantities.

	cheers,

		Rolf Turner