[R] OT: Likelihood ratio for the randomization/permutation test?

[Mike Lawrence]

Hi guRus,

My discipline (experimental psychology) is gradually moving away from
Null Hypothesis Testing and towards measures of evidence. One measure
of evidence that has been popular of late is the likelihood ratio.
Glover & Dixon (2005) demonstrate the calculation of the likelihood
ratio from ANOVA tables, but I'm also interested in non-parametric
statistics and wonder if anyone has any ideas on how to compute a
likelihood ratio from a randomization test (aka. permutation test)?

Say one had two groups and were interested in whether the mean scores
of the two groups differ in a manner consistent with random chance or
in a manner consistent with a non-null effect of some manipulation
applied to the two groups. The randomization test addresses this by
randomly re-assigning the participants to the groups, re-computing the
difference between means, and repeating many times, yielding a
distribution of simulated difference scores that represents the
distribution expected by chance.

Within a Null Hypothesis Testing framework you then estimate the
probability of the null by observing the proportion of simulated
difference scores that are greater in magnitude than the observed
difference score. Any guesses on how to translate this into a
quantification of evidence?

Mike

-- 
Mike Lawrence
Graduate Student
Department of Psychology
Dalhousie University

Looking to arrange a meeting? Check my public calendar:
http://tinyurl.com/mikes-public-calendar

~ Certainty is folly... I think. ~