[R] Large datasets under R

Stephen R. Laniel laniel at cmu.edu
Wed Feb 23 02:36:54 CET 2000


I recall reading a thread months ago on this mailing list about handling
very datasets under R, but I can't seem to find it.  This has become
particularly important recently, because I've been playing with a dataset
containing information about every fatal car accident in the U.S. since
1975; in total, the relevant files are about 120 megs.  I'd like to load
all of these into R at once and do some longitudinal analyses.  R seems to
choke on tables above a few megabytes.  From what I can tell, these are
memory management issues; the user must allocate memory using command-line

I'm using R 0.90 under Windows NT 4.0.  Have things improved in more recent
versions?  Are they expected to improve soon?  In the meantime, what can we
do to make large-dataset analysis more convenient?


Stephen R. Laniel            |  "Farewell Angelina
Carnegie Mellon University   |   The sky is erupting
laniel at cmu.edu               |   I must go where it's quiet."
www.stat.cmu.edu/~laniel/    |   --Bob Dylan
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch

More information about the R-help mailing list