[R-meta] Pseudoreplication

[Michael Dewey]

Dear Gladys

I think the referee may have misunderstood what you did. We may need 
more details about your data structure to be absolutely sure you have 
the right structure but it seems superior to the suggested rather 
indirect way of going about things.

Micael

On 28/09/2021 13:06, Gladys Barragan-Jason wrote:
> Dear all,
> 
> I am contacting you to have your advice about a reviewer comment on a 
> meta-analysis. The reviewer said that as we used multiple comparisons 
> from within studies (e.g., five effect sizes from one particular paper 
> comparisons), this raises the potential of pseudoreplication issue and 
> he/she suggests to do the following:  recalculate the overall effect 
> sizes after sampling one comparison from each separate study and 
> calculate the estimated mean and 95% CI of effect size by bootstrap 
> resampling 1,000 times in R.
> However, I think I've already taken into account non-independence of the 
> data by including three random effects using metafor to control for 
> multiple data from the same article, multiple data from same 
> participants from the same study and multiple estimates within a study 
> within a lab. So I coded random effect as follows: 
> ~1|articleID/studyID/estID. I think this is the right way to take into 
> account heterogeneity of the data but I would like to know if I am 
> correct or if the pseudoreplication techniques gave something different 
> and/or complementary?
> Thanks in advance for your help!
> Best,
> Gladys
> 
> -- 
> 
> ------------------------------------------
> 
> Gladys Barragan-Jason, PhD. ____ Website 
> <https://sites.google.com/view/gladysbarraganjason/home> / Site web 
> <https://sites.google.com/view/frgladysbarragan-jason/accueil>
> 
> Station d'Ecologie Théorique et Expérimentale (SETE)____
> 
> CNRS de Moulis____
> 
> image.pngimage.png____
> 
> 
> 
> 
> <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient> 
> 	Virus-free. www.avg.com 
> <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient> 
> 
> 
> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
> 
> _______________________________________________
> R-sig-meta-analysis mailing list
> R-sig-meta-analysis using r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-meta-analysis
> 

-- 
Michael
http://www.dewey.myzen.co.uk/home.html