[R] Large datasets under R
Stephen R. Laniel
laniel at cmu.edu
Wed Feb 23 02:36:54 CET 2000
I recall reading a thread months ago on this mailing list about handling
very datasets under R, but I can't seem to find it. This has become
particularly important recently, because I've been playing with a dataset
containing information about every fatal car accident in the U.S. since
1975; in total, the relevant files are about 120 megs. I'd like to load
all of these into R at once and do some longitudinal analyses. R seems to
choke on tables above a few megabytes. From what I can tell, these are
memory management issues; the user must allocate memory using command-line
I'm using R 0.90 under Windows NT 4.0. Have things improved in more recent
versions? Are they expected to improve soon? In the meantime, what can we
do to make large-dataset analysis more convenient?
Stephen R. Laniel | "Farewell Angelina
Carnegie Mellon University | The sky is erupting
laniel at cmu.edu | I must go where it's quiet."
www.stat.cmu.edu/~laniel/ | --Bob Dylan
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !) To: r-help-request at stat.math.ethz.ch
More information about the R-help