[R] LSA package: problem with textmatrix()
Ashton, Triss
Triss.Ashton at unt.edu
Wed Feb 22 23:24:42 CET 2012
I have a problem with the textmatrix() function of the LSA package whenever I specify 'removeNumbers=TRUE'. The data for the function are stored in a directory LSAwork which consists of a series of files that houses the text in column form. As long as removeNumbers = FALSE or it is not present the textmatrix function works just fine. The error message I get seems to suggest it is finding the files empty after filtering. However, all of the files are primarily words with only a few numbers mixed in. Any help appreciated.
The data I am using is the MEDLINE data set and the first file in the data set med.000001 looks like this:
correlation
between
maternal
and
fetal
plasma
levels
of
glucose
and
free
fatty
acids
.
correlation
coefficients
have
been
determined
between
the
the command I am using looks like this, with the resulting error below:
>
> dtm <- textmatrix(LSAwork, stemming=TRUE, stopwords=StopListm, minGlobFreq=1, minWordLength=2, removeNumbers=TRUE)
Error in data.frame(docs = basename(file), terms = names(tab), Freq = tab, :
arguments imply differing number of rows: 1, 0
In addition: Warning message:
In FUN(c("LSAWork/med.000001", "LSAWork/med.000002", "LSAWork/med.000003", :
[textvector] - the file LSAWork/med.000001 contains no terms after filtering.
>
Triss Ashton
University of North Texas
More information about the R-help
mailing list