[R] large dataset!

rdporto1 rdporto1 at terra.com.br
Mon Jul 3 17:46:52 CEST 2006


we had a little discussion about this topic
last May when I had a similar problem.
It is archived at


You can follow the thread to see the various 
arguments and solutions. I tried to summarize
the possible suggested approachs at



Rogerio Porto.

---------- Cabeçalho original -----------

De: r-help-bounces at stat.math.ethz.ch
Para: r-help at stat.math.ethz.ch
Data: Sun, 2 Jul 2006 10:12:25 -0400 (EDT)
Assunto: [R] large dataset!

> Hi, I need to analyze data that has 3.5 million observations and
> about 60 variables and I was planning on using R to do this but
> I can't even seem to read in the data.  It just freezes and ties
> up the whole system -- and this is on a Linux box purchased about
> 6 months ago on a dual-processor PC that was pretty much the top
> of the line.  I've tried expanding R the memory limits but it 
> doesn't help.  I'll be hugely disappointed if I can't use R b/c
> I need to do build tailor-made models (multilevel and other 
> complexities).   My fall-back is the SPlus big data package but
> I'd rather avoid if anyone can provide a solution....
> Thanks!!!!
> Jennifer Hill
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html

More information about the R-help mailing list