[R-meta] Pseudoreplication

[Gladys Barragan-Jason]

Dear all,

I am contacting you to have your advice about a reviewer comment on a
meta-analysis. The reviewer said that as we used multiple comparisons from
within studies (e.g., five effect sizes from one particular paper
comparisons), this raises the potential of pseudoreplication issue and
he/she suggests to do the following:  recalculate the overall effect sizes
after sampling one comparison from each separate study and calculate the
estimated mean and 95% CI of effect size by bootstrap resampling 1,000
times in R.
However, I think I've already taken into account non-independence of the
data by including three random effects using metafor to control for
multiple data from the same article, multiple data from same participants
from the same study and multiple estimates within a study within a lab. So
I coded random effect as follows: ~1|articleID/studyID/estID. I think this
is the right way to take into account heterogeneity of the data but I would
like to know if I am correct or if the pseudoreplication techniques gave
something different and/or complementary?
Thanks in advance for your help!
Best,
Gladys

-- 

------------------------------------------

Gladys Barragan-Jason, PhD.  Website
<https://sites.google.com/view/gladysbarraganjason/home> / Site web
<https://sites.google.com/view/frgladysbarragan-jason/accueil>

Station d'Ecologie Théorique et Expérimentale (SETE)

CNRS de Moulis

[image: image.png][image: image.png]

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20210928/80343d4c/attachment.html>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 7125 bytes
Desc: not available
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20210928/80343d4c/attachment.png>