[R] R and file size

ripley@stats.ox.ac.uk ripley at stats.ox.ac.uk
Tue Jan 7 11:53:05 CET 2003

On Mon, 6 Jan 2003, Greg Blevins wrote:

> I will be involved with an analysis based on a file that will be roughly 25 meg.  Assuming I have enough memory, is their any limitations to using R on a file this large.

That's a small file!

Seriously, people work on datasets of 100Mb or so in 1Gb (or even 512Mb)
machines.  However, some care is needed to select a good way to read the
data in (if read.table, do follow the advice on the help page), and it
would probably be better to use a database interface (see the Data
Import/Export manual).

Brian D. Ripley,                  ripley at stats.ox.ac.uk
Professor of Applied Statistics,  http://www.stats.ox.ac.uk/~ripley/
University of Oxford,             Tel:  +44 1865 272861 (self)
1 South Parks Road,                     +44 1865 272866 (PA)
Oxford OX1 3TG, UK                Fax:  +44 1865 272595

More information about the R-help mailing list