[R-meta] Pseudoreplication

[Gladys Barragan-Jason]

Dear Michael,
thanks a lot for your reply.
I have a structure like this:

Article ID.         Study ID.           Effect size.
X et al.              S1                       0.5
X et al.              S2                       0.8
Y et al.              S1                       0.2
Y et al.              S2                       0.6
Y et al.              S2                       0.2
Z et al.              S1                       0.1
Z et al.              S1                       0.5

and I use: random=~1|articleID/studyID/estID with estid <- 1:nrow(data)
Thanks,
Gladys

Le mar. 28 sept. 2021 à 15:57, Michael Dewey <lists using dewey.myzen.co.uk> a
écrit :

> Dear Gladys
>
> I think the referee may have misunderstood what you did. We may need
> more details about your data structure to be absolutely sure you have
> the right structure but it seems superior to the suggested rather
> indirect way of going about things.
>
> Micael
>
> On 28/09/2021 13:06, Gladys Barragan-Jason wrote:
> > Dear all,
> >
> > I am contacting you to have your advice about a reviewer comment on a
> > meta-analysis. The reviewer said that as we used multiple comparisons
> > from within studies (e.g., five effect sizes from one particular paper
> > comparisons), this raises the potential of pseudoreplication issue and
> > he/she suggests to do the following:  recalculate the overall effect
> > sizes after sampling one comparison from each separate study and
> > calculate the estimated mean and 95% CI of effect size by bootstrap
> > resampling 1,000 times in R.
> > However, I think I've already taken into account non-independence of the
> > data by including three random effects using metafor to control for
> > multiple data from the same article, multiple data from same
> > participants from the same study and multiple estimates within a study
> > within a lab. So I coded random effect as follows:
> > ~1|articleID/studyID/estID. I think this is the right way to take into
> > account heterogeneity of the data but I would like to know if I am
> > correct or if the pseudoreplication techniques gave something different
> > and/or complementary?
> > Thanks in advance for your help!
> > Best,
> > Gladys
> >
> > --
> >
> > ------------------------------------------
> >
> > Gladys Barragan-Jason, PhD. ____ Website
> > <https://sites.google.com/view/gladysbarraganjason/home> / Site web
> > <https://sites.google.com/view/frgladysbarragan-jason/accueil>
> >
> > Station d'Ecologie Théorique et Expérimentale (SETE)____
> >
> > CNRS de Moulis____
> >
> > image.pngimage.png____
> >
> >
> >
> >
> > <
> http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> >       Virus-free. www.avg.com
> > <
> http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> >
> >
> > <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
> >
> > _______________________________________________
> > R-sig-meta-analysis mailing list
> > R-sig-meta-analysis using r-project.org
> > https://stat.ethz.ch/mailman/listinfo/r-sig-meta-analysis
> >
>
> --
> Michael
> http://www.dewey.myzen.co.uk/home.html
>


-- 

------------------------------------------

Gladys Barragan-Jason, PhD.  Website
<https://sites.google.com/view/gladysbarraganjason/home> / Site web
<https://sites.google.com/view/frgladysbarragan-jason/accueil>

Station d'Ecologie Théorique et Expérimentale (SETE)

CNRS de Moulis

[image: image.png][image: image.png]

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20210928/6a2b968e/attachment-0001.html>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 7519 bytes
Desc: not available
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20210928/6a2b968e/attachment-0002.png>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 7125 bytes
Desc: not available
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20210928/6a2b968e/attachment-0003.png>