[R-sig-ME] random effects models with small n

[Felix Bach]

Dear all,

I recently saw an article in which the authorsperformed a random effects analysis with lme4  which used a group (2 levels)x condition (3 levels) x effect (4 levels) and ratio (10 levels) as fixed factors and subject as random factor. Sample size was 16 animals. They used MCMC estimation and obtained p-values of 0.0001 (lets ignore the use of p values in a Bayesian framework). How reliable are those estimates? I can't imagine that you can reliable are p-values (or credibility intervals) with such a complex models and a sample size of 16? If the model assumption of an exchangable covariance structure is valid, could you trust the results? 
Best wishes, Felix

--