<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Monaco;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-AU" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Dear James,<span style="font-size:12.0pt"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you for your detailed and very helpful reply! </p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have checked whether the degree of heterogeneity is constant across temperature differentials, and it is, so I don’t think having LnRR/LnSR as the response would be needed for this particular model, but thanks for letting me know about
that, as it might come in useful when I look at the effect of other moderators later!
</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have a further question about checking for normality of random effects. I have only checked for normality of the model as a whole and the response variable so far (I am not sure whether these things also are assumed to be normally distributed?)
My random effects are categorical, so I am not sure how these can end up as a distribution. Is it still expected that categorical random effects should be normally distributed? If so, are you able to let me know the code to use to check this?</p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Best wishes,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Bethan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div>
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:14.0pt;color:#A5A5A5">________________________________________<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:12.0pt;color:#ED7D31">Bethan Lang<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt">PhD Candidate<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="font-size:10.0pt">ARC Centre of Excellence for Coral Reef Studies<br>
James Cook University<br>
Townsville, QLD, Australia <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt">4811<o:p></o:p></span></p>
<p class="MsoNormal"><img width="242" height="96" style="width:2.5208in;height:1.0in" id="Picture_x0020_1" src="cid:image001.jpg@01D7A994.C87195A0" alt="signature_1454588885"><o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">James Pustejovsky <jepusto@gmail.com><br>
<b>Date: </b>Tuesday, 14 September 2021 at 5:33 am<br>
<b>To: </b>Bethan Lang <bethan.lang@my.jcu.edu.au><br>
<b>Cc: </b>"r-sig-meta-analysis@r-project.org" <r-sig-meta-analysis@r-project.org>, Jennifer Donelson <jennifer.donelson@my.jcu.edu.au><br>
<b>Subject: </b>Re: [R-meta] Meta-analysis questions<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Hi Bethan,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I'll respond to your first questions and add a query of my own. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">First, non-normality and high kurtosis are indeed problems for the modeling approach you've taken. One consequence is that you will likely have very high levels of estimated heterogeneity. Another consequence, and potential concern, is
that the standard errors and confidence intervals that come from <a href="https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Frma.mv%2F&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024790169%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=zfI7RIxL6czOcAeym2SfkfmOk%2FH9cPZtXTySiUQMkdo%3D&reserved=0">
rma.mv</a>() should probably not be trusted because they are predicated on assumptions about normality of the random effects in the specified model. There are (at least) two ways that you could deal with this issue. First, you could ignore the standard errors
from <a href="https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Frma.mv%2F&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024790169%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=zfI7RIxL6czOcAeym2SfkfmOk%2FH9cPZtXTySiUQMkdo%3D&reserved=0">
rma.mv</a>() and instead use robust variance estimation methods, which are asymptotically robust to non-normality as well as mis-specification of the model covariance structure. For example, the following will give you robust confidence intervals for your model:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">conf_int(Traitcat_model, vcov = "CR2")<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">An alternative to RVE is to use bootstrap confidence intervals, as you've attempted. However, the usual implementation of bootstrapping will not work here. Because you've got dependent effect sizes with a multi-level structure, you'll need
to bootstrap re-sample *at the study level* instead of re-sampling individual observations. Here's a rough sketch of how to cluster bootstrap:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">library(boot)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">study_ids <- unique(Traitcatdata$Study_number)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">boot.func <- function(study_ids, indices) {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> row_indices <- Traitcatdata$Study_number %in% study_ids[indices]</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> Traitcat_model2 <- try(suppressWarnings(</span><a href="https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Frma.mv%2F&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024800164%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=NgG7PipW0ZRmnmPNGHCLkZfkjyS%2FZEChmp3K44DMYyY%3D&reserved=0" target="_blank">rma.mv</a><span style="color:black">(yi=Ln_response_corrected,V=Variance,
data=Traitcatdata, mods=~LnSR:Trait_cat - 1, test="t", random = list(~1|Study_number/Response_id/Effect_size_id), method = "REML", subset=row_indices)))</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> if (inherits(Traitcat_model2, "try-error")) {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> NA</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> } else {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> c(coef(Traitcat_model2), Traitcat_model2$sigma2)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> }</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">}</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">res.boot2 <- boot(study_ids, boot.func, R=5000)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Cluster-bootstrapped confidence intervals will usually give you results that are quite similar to the RVE approach. </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">To your question about reporting the bootstrap CIs with the original model estimates versus with "bootstrapped estimates", I assume that "bootstrapped
estimates" means the average (arithmetic mean) of the bootstrap distribution. Usually these should be quite close to the point estimates from the original model, particularly with a linear model such as yours. If they're discrepant, then something weird is
going on that probably warrants seeking help from a statistician.</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">And an additional question for you: I see in your model specification that you've dropped the intercepts, so for each trait category, you're modeling the
slope of the relationship between the log response ratio and the log of the temperature differential. By dropping the intercept, you are assuming that the magnitude of the effect size is multiplicatively related to the magnitude of the temperature differential
(i.e., if you double the log-temperature difference, you should expect to get twice as large a log response ratio). By interacting the slope with trait category, you're allowing this multiplicative relationship to differ for each trait category. But then you're
also including random effects in the model, which are assumed to have a constant variance on the scale of the log response ratio and across trait categories. Let's ignore the hierarchical structure for the moment and just think about one effect per study.
For a given trait category, the model would be</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">LRR_i = beta * log( temp diff )_i + v_i + e_i</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">where e_i is the sampling error with known variance Var(e_i) = V_i and v_i is a random effect with variance Var(v_i) = tau^2. Note that this model assumes
that the degree of heterogeneity is constant across temperature differentials, so the degree of heterogeneity in a set of studies that all looked at very small temperature differentials is the same as the degree of heterogeneity in a set of studies that all
examined very large temperature differentials. Does that make theoretical sense in your scientific context? (This is an honest question--I don't know anything about your research area!) </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Alternatively, I wonder whether it might be plausible to assume that the degree of heterogeneity is *also* multiplicatively related to the magnitude of
the temperature differential. Under that assumption, you would divide the effect sizes and their standard errors by the log of the temperature differential, so the new model for a given category would become</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">[ LRR_i / log( temp diff )_i ] = beta + v_i + e_i, </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">where now Var(e_i) = V_i / [log( temp diff )_i]^2 and Var(v_i) = tau^2. Here, the variance parameter tau^2 represents heterogeneity in the response *per
unit change* in the log temperature differential. This implies that studies with larger log temperature differentials would have proportionately larger degrees of heterogeneity in their responses. To take into account multiple trait categories, you could fit
a model that has indicators for each category (dropping the intercept) but you would no longer necessarily need to include th interaction with lnSR. </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">James</span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Sun, Sep 12, 2021 at 8:42 PM Bethan Lang <<a href="mailto:bethan.lang@my.jcu.edu.au">bethan.lang@my.jcu.edu.au</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi there,</p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I am working on a meta-analyses looking at the effect of ocean warming on various traits of marine animals. My model is as follows:</p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Traitcat_model <-
<a href="https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Frma.mv%2F&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024800164%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=NgG7PipW0ZRmnmPNGHCLkZfkjyS%2FZEChmp3K44DMYyY%3D&reserved=0" target="_blank">
rma.mv</a>(yi = Ln_response_corrected, V = Variance, mods = ~LnSR:Trait_cat - 1, test="t", random = list(~1|Study_number/Response_id/Effect_size_id), method = "REML", data = Traitcatdata)</p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Ln_response_corrected is the lnRR, i.e. the natural logarithm of the difference between the experimental (high temperature) and control mean.
</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Trait_cat is the measure e.g. survival, metabolic rate, growth. I have added in the an interaction with LnSR (the natural logarithm of the difference between
the control and experimental temperature). I included this to account for the fact that some studies might test say a control and +10C, while others may only test at +2C. The effect size id is the number of the observation, which is nested within response_id.
All observations of one measure e.g. metabolic rate at the different experimental temperatures tested in a study will have the same response Id. This is nested within the study number, which is the number assigned to each paper included.
</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Firstly, when I test the normality and heteroskedasticity of the model as a whole as well as the response variable, there is a high level on non-normality
and heteroskedasticity (see attached screenshots for the diagnostic plots of the model). I am not sure if this means that the model output cannot be trusted? Or if this level of non-normality and heteroskedasticity is ok?</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">If not, I was thinking about bootstrapping the confidence intervals to account for the non-normality. However, I cannot seem to figure out the code to
do this. This is the code that I tried, at the moment I am getting the error: </span>
<span style="font-size:9.0pt;font-family:Monaco;color:#C800A4;background:#E5E5E5"><text>:1:6: unexpected symbol 1: .arg show_col_types ^</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">But I was getting a different error when I tried to run the code yesterday, I can’t remember what this one was.
</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">library(boot)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">boot.func <- function(dat, indices) {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> Traitcat_model2 <- try(suppressWarnings(</span><a href="https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Frma.mv%2F&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024810157%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=COVetfkKSkWV%2F4S6RSNO0PIRQ%2BsWhrqSL0Y2XQKl22w%3D&reserved=0" target="_blank">rma.mv</a><span style="color:black">(yi=Ln_response_corrected,V=Variance,
data=Traitcatdata, mods=~LnSR:Trait_cat - 1, test="t", random = list(~1|Study_number/Response_id/Effect_size_id), method = "REML", subset=indices)))</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> if (inherits(Traitcat_model2, "try-error")) {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> NA</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> } else {</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> c(coef(Traitcat_model2), vcov(Traitcat_model2), Traitcat_model2$sigma2)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> }</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">}</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">res.boot2 <- boot(Traitcatdata, boot.func, R=5000)</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">res.boot2</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Please let me know how I need to adjust this code to get the bootstrapped CI’s for each Trait_cat group.
</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Also, would it be ok to use bootstrapped CI’s along with the estimates from the original model, or should I use bootstrapped estimates too?</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Secondly, I am trying to figure out how to do an Orchard plot, which I know you cannot create from a model with two multiple moderators. I was wondering
whether there is any way to back calculate from the model to get data points that have been adjusted for LnSR, and then use them for the Orchard plots?</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Please let me know if you need any further details in order to help me with these queries.</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Best wishes,</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"> </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Bethan</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:14.0pt;color:#A5A5A5">________________________________________</span></b></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="color:#ED7D31">Bethan Lang</span></b></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.0pt">PhD Candidate</span></b></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt">ARC Centre of Excellence for Coral Reef Studies<br>
James Cook University<br>
Townsville, QLD, Australia </span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt">4811</span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><img border="0" width="242" height="96" style="width:2.5208in;height:1.0in" id="gmail-m_-4658590407325570331Picture_x0020_1" src="cid:image002.jpg@01D7A994.C87195A0" alt="signature_1249144060"></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
R-sig-meta-analysis mailing list<br>
<a href="mailto:R-sig-meta-analysis@r-project.org" target="_blank">R-sig-meta-analysis@r-project.org</a><br>
<a href="https://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=04%7C01%7Cbethan.lang%40my.jcu.edu.au%7C71cbd862a4f045a7780708d976ed3d34%7C2eba4cf8af764db3bcaf81b5592535ef%7C0%7C0%7C637671584024810157%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=XJZnVNhDNRbmQ3CfzN5LQxt6CZVoUDBpSgyvSmtyZvI%3D&reserved=0" target="_blank">https://stat.ethz.ch/mailman/listinfo/r-sig-meta-analysis</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</body>
</html>