[R] Computing Confidence Intervals for AUC in ROCR Package
Na'im R. Tyson
ntyson at clovermail.net
Fri Jan 22 09:53:39 CET 2010
Dear R-philes,
I am plotting ROC curves for several cross-validation runs of a
classifier (using the function below). In addition to the average
AUC, I am interested in obtaining a confidence interval for the
average AUC. Is there a straightforward way to do this via the ROCR
package?
plot_roc_curve <- function(roc.dat, plt.title) {
#print(str(vowel.ROC))
pred <- prediction(roc.dat$predictions, roc.dat$labels)
perf <- performance(pred, "tpr", "fpr")
perf.auc <- performance(pred, "auc")
perf.auc.areas <- slot(perf.auc, "y.values")
curve.area <- mean(unlist(perf.auc.areas))
#quartz(width=4, height=6)
plot(perf, col="grey82", lty=3)
plot(perf,lwd=3,avg="horizontal",spread.estimate="boxplot",
add=T)
title(main=plt.title)
mtext(sprintf("%s%1.4f", "Area under Curve = ", curve.area),
side=3, line=0, cex=0.8)
}
P.S. After years of studying statistical analysis as a student, I
still consider myself a novice.
More information about the R-help
mailing list