[R] Help with R

Prof Brian Ripley ripley at stats.ox.ac.uk
Thu May 5 14:56:23 CEST 2005


On Thu, 5 May 2005, Christoph Lehmann wrote:

>>> I heard that 'R' does not do a very good job at handling large 
>>> datasets, is this true?
>> 
> importing huge datasets in a data.frame with e.g. a subsequent step of 
> conversion of some columns into factors may lead into memory troubles 
> (probably due to memory overhead when building out factors). But we currently

Note that R's scan() does this very much more efficiently.  It is not fair 
to R to generalize from the method of a contributed package.

> succeeded in  importing 12 millions of data records stored in a MySQL 
> database, using RMySQL package.

-- 
Brian D. Ripley,                  ripley at stats.ox.ac.uk
Professor of Applied Statistics,  http://www.stats.ox.ac.uk/~ripley/
University of Oxford,             Tel:  +44 1865 272861 (self)
1 South Parks Road,                     +44 1865 272866 (PA)
Oxford OX1 3TG, UK                Fax:  +44 1865 272595




More information about the R-help mailing list