[R] Very Large Data Sets

Peter Malewski p.malewski at tu-bs.de
Thu Dec 23 08:32:11 CET 1999

Tony Fagan wrote:

> List, Can R handle very large data sets (say, 100 million records) for
> data mining applications? My understanding is that Splus can not, but
> SAS can easily. Thanks,Tony Fagan

>From a theoretical point of view yes, but practically:
1) you'll need plenty of memory
2) even than the computation time will be long

In past times I used SPSS to create summarized data file (Mostly there is much more data than really needed). Now I cut the data in a view records, write the syntax, and than run the code in the night.

I think the ++ of R is the flexibility of the analyses not the data preparation of very,very large data-bases.

Merry Xmas & a happy new year


** To YOU I'm an atheist; to God, I'm the Loyal Opposition. Woody Allen **
P.Malewski                                      Tel.: 0531 500965
Maschplatz 8                                    Email: P.Malewski at tu-bs.de
************************38114 Braunschweig********************************

r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch

More information about the R-help mailing list