[R] Large Dataset

[Ben Bolker]

Edwin Sendjaja <edwin7 <at> web.de> writes:

> 
> Hi Simon,
> 
> My RAM is only 3.2 GB (actually it should be 4 GB, but my Motherboard doesnt 
> support it.
> 
> R use almost of all my RAM and half of my swap. I think memory.limit will not 
> solve my problem.  It seems that I need  RAM.
> 
> Unfortunately, I can't buy more RAM.
> 
> Why R is slow reading big data set?
> 
> Edwin
> 

  Start with FAQ 7.28 ,
http://cran.r-project.org/doc/FAQ/R-FAQ.html#Why-is-read_002etable_0028_0029-so-inefficient_003f

  However, I think you're going to have much bigger problems
if you have a 3.1G data set and a total of 3.2G of RAM: what do
you expect to be able to do with this data set once you've read
it in?  Have you considered storing it in a database and accessing
just the bits you need at any one time?

  Ben Bolker