[R-meta] Multilevel, multivariate meta analysis on studies with multiple outcomes and dependent effect sizes

[Nasiri Moghadam, Neda]

Hi everyone,

I’m doing a meta analysis to find the connection between environmental fluctuation and fitness performance of organisms. I have collected data (844 Hedge’s g mean difference effect sizes ) from 43 studies (multiple effect sizes per study).
Dependency between effect sizes within each study arises from one of the following conditions:

  1.
several treatments (treatment.type) have been compared with a common control group,
  2.
several control conditions (control.type) have been compared with one treatment,
  3.  several control and treatment conditions have been compared together.

The treatment and control conditions are study-specific therefore there is no dependency between studies.

In each study effect of treatment has been assessed on different traits (growth, yield, survival and so on). The traits and their numbers are different between studies. The applied organism for the experiments is different between studies (insect, bacteria, virus and ...).

Here is a data sample to clear my explanation:

 [enter image description here] <https://i.stack.imgur.com/NQZ6B.png>

Due to the dependency between effect sizes within each study (I don't know the covariances between the different outcomes) I combined information of the treatment.type and control.type in a new column (combination) using the paste function in R. I nested this column in study ID and included in the model as a random factor.

res <- rma.mv(yi,vi,data=mydata,mods=~factor(A)+factor(B)+C,
>                           random = ~1|studyID/combination,
>                           method="REML",tdist=TRUE))


I've also made the phylogeny tree and correlation matrix between species. I'm going to include the species as a random factor in the model. I checked the likelihood profile plot for sigma^2.1 and sigma^2.2. In both cases the plot peaks at the estimate.

The distribution of the heterogeneity is as follows:
level1: 59%,
level2: 7%,
level3: 32%

I obtained cluster robust standard error using the following command:

robust(res, cluster=mydata$studyID)


The funnel plot is not symmetric and based on the cook's distance plot I have influential data points.

Questions:

1) Is the model correct based on the hierarchical structure in my data set (study > combination > trait > effect size)

2) Isn't it better to use a network meta analysis instead of a three level model for my data set?

3) Is it correct to use studyID as the cluster in robust() function and how should I interpret the output of robust() function?

I’m happy to provide any additional information to facilitate feedback.

Thank you for your help in advance.


Bests,

Neda N. Moghadam
Postdoctoral Researcher
Department of Biological and Environmental Science
P.O. Box 35, FI-40014
University of Jyväskylä, Finland
Mobile: +4550393628
Email: neda.n.nasiri-moghadam using jyu.fi<mailto:neda.n.nasiri-moghadam using jyu.fi>
Linkedin: linkedin.com/in/nedanasirimoghadam<http://linkedin.com/in/nedanasirimoghadam>






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20190529/56b36872/attachment-0001.html>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: NQZ6B.png
Type: image/png
Size: 123403 bytes
Desc: NQZ6B.png
URL: <https://stat.ethz.ch/pipermail/r-sig-meta-analysis/attachments/20190529/56b36872/attachment-0001.png>