[R-meta] Meta-analysis of single group attitude scores

[Viechtbauer Wolfgang (SP)]

I agree that ideally one would want to use the raw mean (or raw mean minus neutral point) as the outcome measure. However, if studies differ in terms of the number of answering possibilities, then the raw values are not really comparable.

Two ideas:

1) Divide by the SD. So you then compute d = (mean - neutral point) / SD. Then the (large-sample) sampling variance can be estimated with:

1/n + d^2/(2*n)

2) Divide by the possible range (not the observed one!). So you then compute d = (mean - neutral point) / range. Then the sampling variance can be estimated with:

SD^2 / (n * range^2)

Best,
Wolfgang

>-----Original Message-----
>From: R-sig-meta-analysis [mailto:r-sig-meta-analysis-bounces at r-
>project.org] On Behalf Of Michael Dewey
>Sent: Friday, 24 November, 2017 15:02
>To: Tommy van Steen; r-sig-meta-analysis at r-project.org
>Subject: Re: [R-meta] Meta-analysis of single group attitude scores
>
>Dear Tommy
>
>If you subtract the neutral point fr each study then this will only make
>a difference if the studies have different neutral points but it would
>not harm things anyway.
>
>Dividing by the standard deviation seems unnecessary to me, and
>potentially harmful. Why not use the standard error of each mean? Then
>you would get the proper weights and an estimate of heterogeneity.
>
>Michael
>
>On 24/11/2017 12:26, Tommy van Steen wrote:
>> Dear all,
>>
>> I have a question about my meta-analytic approach in a project that I’m
>working on.
>> In this project, we are conducting a meta-analysis of attitudes. The
>study outcome variable is the mean attitude score on a scale (often a
>Likert-scale type survey or single item).
>>
>> I am trying to figure out what the best way is to conduct a meta-
>analysis based on this type of data as the data comes from single groups
>and studies vary in the number of answering possibilities on the Likert-
>scales.
>>
>> My thought would be to transform the study mean into a z-score by
>subtracting the neutral score (e.g. ‘3' in a 5-point scale study) from
>the study mean and divide the outcome by the standard deviation of the
>study mean. This way, the z-score reflects whether the attitude was
>positive (f the z-score is positive) or negative (if the z-score is
>negative), with 0 being neutral. I would then use this z-score as the
>effect size for my meta-analysis.
>>
>> Based on this, I have three questions:
>> 1. Is this a sensible option?
>> 2. If so, how should I calculate the study weights? (As z-scores
>typically have an SD of 1 if I understand correctly.)
>> 3. How would I run the meta-analysis based on these z-scores? (Simply
>loading the scores as effect sizes in an SMD meta-analysis using the
>metafor-package seems odd perhaps?)
>>
>> Thank you very much for your time and thoughts.
>>
>> With kind regards,
>> Tommy van Steen