[R] lda (MASS)

marquis2@etu.unige.ch marquis2 at etu.unige.ch
Thu Apr 21 12:01:12 CEST 2005


hi!

this is a question about lda (MASS) in R on a particular dataset.
I'm not a specialist about any of this but:
First with the well-known "iris" dataset, I tried using lda to discriminate 
versicolor from the other to classes and I got approx. 70% of accuracy
testing on train set. In iris, versicolor stands "between" the 2 other so
one can expect lda not to perform well since it cannot cluser the negative
instances (seposa+virginica) together (Is this correct?) (KNN=96% in xval.)

Now, I use my "real" dataset (900 instances, 21 attributes), which 2 classes
can be serparated with accuracy no more than 80% (10xval) with KNN, SVM, C4.5
and the like. 
So I was very surprised to see that lda also gets an accuracy of 80% on it,
because lda is very simple (finding the best line -- for a 2 classes 
problem -- and using projections on the line for classification.)

So my question is: how does lda (in MASS) use the projections to make
the decision? Usually the decision for a test instances is made
using means and variances of the 2 classes but there are other possibilites
(especially in higher dimensions.)

Thanks for any idea, the doc is a bit spares and Venebles&Ripley's book
also for this particular matter.

Samuel

PS: and does anybody know how to use the CV option of lda to make xval?
I can't get it.




More information about the R-help mailing list