<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Kaufmann Bd BT";}
@font-face
{font-family:"Lucida Console";
panose-1:2 11 6 9 4 5 4 2 2 4;}
@font-face
{font-family:"Segoe UI Symbol";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"Préformaté HTML Car";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Texte de bulles Car";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-US;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.PrformatHTMLCar
{mso-style-name:"Préformaté HTML Car";
mso-style-priority:99;
mso-style-link:"Préformaté HTML";
font-family:"Courier New";
mso-fareast-language:EN-CA;}
span.gghfmyibcpb
{mso-style-name:gghfmyibcpb;}
span.gghfmyibcob
{mso-style-name:gghfmyibcob;}
span.TextedebullesCar
{mso-style-name:"Texte de bulles Car";
mso-style-priority:99;
mso-style-link:"Texte de bulles";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-CA" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Dear metafor users,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I downloaded the data set (i.e., p154-dataset.csv) from Assinka and Wibbelink (2016) available from
<a href="http://www.tqmp.org/RegularArticles/vol12-3/p154/p154.pdf">http://www.tqmp.org/RegularArticles/vol12-3/p154/p154.pdf</a><o:p></o:p></p>
<pre><o:p> </o:p></pre>
<p class="MsoNormal">3-level model with multiple moderators (Listing 15 in the publication):
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt;background:white">
<tbody>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> multiplemoderator <- rma.mv(y, v, mods = ~ pyear + typeovert + typecovert,
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">+ random =list(~ 1 | effectsizeID, ~ 1 | studyID),
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">+ tdist=TRUE, data=dataset)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> summary(multiplemoderator, digits=3)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">Multivariate Meta-Analysis Model (k = 100; method: REML)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> logLik Deviance AIC BIC AICc
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> -63.375 126.750 138.750 154.136 139.694
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">Variance Components:
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> estim sqrt nlvls fixed factor<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">sigma^2.1 0.085 0.292 100 no effectsizeID<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">sigma^2.2 0.149 0.386 17 no studyID<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">Test for Residual Heterogeneity:
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">QE(df = 96) = 609.357, p-val < .001<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">Test of Moderators (coefficient(s) 2:4):
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">F(df1 = 3, df2 = 96) = 6.414, p-val < .001<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">Model Results:<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> estimate se tval pval ci.lb ci.ub<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">intrcpt 0.466 0.107 4.346 <.001 0.253 0.678<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">pyear -0.038 0.018 -2.077 0.040 -0.074 -0.002<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">typeovert -0.204 0.139 -1.473 0.144 -0.479 0.071<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">typecovert -0.709 0.191 -3.707 <.001 -1.089 -0.330<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt"></td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt">
<tbody>
<tr>
<td width="1" valign="top" style="width:.6pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-line-height-alt:0pt"><span style="font-size:12.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">>
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">To plot Cook’s Distance values for cluster studyID (17 levels) from model multiple moderator, I did:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt;background:white">
<tbody>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> #### Cook's distance ###<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> par(mfrow=c(1,1))<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> tmp.cook.studyID <- cooks.distance(multiplemoderator,
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">+ cluster=dataset$studyID,
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">+ progbar=TRUE)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> |=======================================================| 100%<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> plot(tmp.cook.studyID, type="o", pch=19)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> which(tmp.cook.studyID > 1)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">15
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">15
<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt"></td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt">
<tbody>
<tr>
<td width="1" valign="top" style="width:.6pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-line-height-alt:0pt"><span style="font-size:12.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">>
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-CA"><img border="0" width="638" height="505" id="Image_x0020_1" src="cid:image001.jpg@01D317FF.F01E6720"></span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt;background:white">
<tbody>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">> which(tmp.cook.studyID > 0)<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA">1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 17
<o:p></o:p></span></p>
<p class="MsoNormal" style="word-break:break-all"><span style="font-size:10.0pt;font-family:"Lucida Console";color:black;mso-fareast-language:EN-CA"> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 17
<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt"></td>
</tr>
<tr>
<td valign="top" style="padding:0cm 0cm 6.0pt 4.5pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1435" style="width:861.0pt">
<tbody>
<tr>
<td width="1" valign="top" style="width:.6pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-line-height-alt:0pt"><span style="font-size:12.0pt;font-family:"Lucida Console";color:blue;mso-fareast-language:EN-CA">><o:p> </o:p></span></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Effect sizes are unique among studies. Study 16 is missing despite there are 16 effect sizes in study 16. Any clue for that?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks in advance,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Roger <span style="font-family:"Segoe UI Symbol","sans-serif"">
☺<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Kaufmann Bd BT";color:navy;mso-fareast-language:FR-CA">Roger Martineau, mv Ph.D.</span><span style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Centre de recherche et de développement</span><span style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">sur le bov</span><span lang="FR-CA" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">in
laitier et le porc</span><span lang="FR-CA" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Agriculture et agroalimentaire Canada/Agriculture and Agri-Food Canada</span><span lang="FR-CA" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Téléphone/Telephone: 819-780-7319</span><span lang="FR-CA" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Télécopieur/Facsimile: 819-564-5507</span><span lang="FR-CA" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">2000, Rue Collège / 2000, College Street</span><span lang="EN-US" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Sherbrooke (Québec) J1M 0C8</span><span lang="EN-US" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA">Canada</span><span lang="EN-US" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy;mso-fareast-language:FR-CA"><a href="mailto:roger.martineau@agr.gc.ca"><span style="color:blue">roger.martineau@agr.gc.ca</span></a></span><span lang="EN-US" style="mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-CA"> <o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>