[R-meta] Meta analysis of probability values (Ruscio's A/CLES)

[ian hussey]

Hi all,

I'm writing an R package to do robust analysis of A-B Single Case
Experimental Design data (https://github.com/ianhussey/SCED). I'm
estimating Ruscio's A effect size for each participant. These are
probability values and are akin to the Common Language Effect Size. I want
to add a RE meta analysis across participants to find the meta analytic
Ruscio's A, its CIs, and CRs.

I haven't managed to find any literature on the meta analysis of
probability values. I've read metafor's documentation (e.g.,
https://rdrr.io/cran/metafor/man/escalc.html) but haven't found specific
accommodations for probability values. I have considered analysing them
using the package defaults for ES, but this produces a forest plot with max
CI values above probability of 1.0, and measures of heterogeneity seem to
return extreme results. It also does not accommodate the fact that CIs on
probability values are frequently asymmetrical. Does anyone have any advice?

Here is a minimal reproducible example in case it's useful:
https://github.com/ianhussey/SCED/blob/master/vignettes/meta_analysis_development.Rmd

Thanks,
Ian

-- 
Ian Hussey
Postdoctoral research fellow
Department of Experimental-Clinical and Health Psychology
Ghent University

researchgate.net/profile/ian_hussey
mmmdata.io
twitter.com/ianhussey
osf.io/3kzh8
github.com/ianhussey
-- 
Ian Hussey
Postdoctoral research fellow
Department of Experimental-Clinical and Health Psychology
Ghent University

researchgate.net/profile/ian_hussey
mmmdata.io
twitter.com/ianhussey
osf.io/3kzh8
github.com/ianhussey

	[[alternative HTML version deleted]]