[R] LSA package: problem with textmatrix()

Ashton, Triss Triss.Ashton at unt.edu
Wed Feb 22 23:24:42 CET 2012


I have a problem with the textmatrix() function of the LSA package whenever I specify 'removeNumbers=TRUE'.  The data for the function are stored in a directory LSAwork which consists of a series of files that houses the text in column form.  As long as removeNumbers = FALSE or it is not present the textmatrix function works just fine.  The error message I get seems to suggest it is finding the files empty after filtering. However, all of the files are primarily words with only a few numbers mixed in.  Any help appreciated.

The data I am using is the MEDLINE data set and the first file in the data set med.000001 looks like this:
correlation
between
maternal
and
fetal
plasma
levels
of
glucose
and
free
fatty
acids
.
correlation
coefficients
have
been
determined
between
the

the command I am using looks like this, with the resulting error below:
> 
> dtm <- textmatrix(LSAwork, stemming=TRUE, stopwords=StopListm, minGlobFreq=1, minWordLength=2, removeNumbers=TRUE)
Error in data.frame(docs = basename(file), terms = names(tab), Freq = tab,  : 
  arguments imply differing number of rows: 1, 0
In addition: Warning message:
In FUN(c("LSAWork/med.000001", "LSAWork/med.000002", "LSAWork/med.000003",  :
  [textvector] - the file LSAWork/med.000001 contains no terms after filtering.
>

Triss Ashton
University of North Texas



More information about the R-help mailing list