[R] randomForest question
Arne.Muller at sanofi-aventis.com
Arne.Muller at sanofi-aventis.com
Wed Jul 26 13:32:52 CEST 2006
Hello,
I've a question regarding randomForest (from the package with same name). I've 16 featurs (nominative), 159 positive and 318 negative cases that I'd like to classify (binary classification).
Using the tuning from the e1071 package it turns out that the best performance if reached when using all 16 features per tree (mtry=16). However, the documentation of randomForest suggests to take the sqrt(#features), i.e. 4. How can I explain this difference? When using all features this is the same as a classical decision tree, with the difference that the tree is built and tested with different data sets, right?
example (I've tried different configurations, incl. changing ntree):
> param <- try(tune(randomForest, class ~ ., data=d.all318, range=list(mtry=c(4, 8, 16), ntree=c(1000))));
>
> summary(param)
Parameter tuning of `randomForest':
- sampling method: 10-fold cross validation
- best parameters:
mtry ntree
16 1000
- best performance: 0.1571809
- Detailed performance results:
mtry ntree error
1 4 1000 0.1928635
2 8 1000 0.1634752
3 16 1000 0.1571809
thanks a lot for your help,
kind regards,
More information about the R-help
mailing list