[R] how many records can R handle

[jim holtman]

Exactly what do you want to do with the data?  It is 5M rows with 100
columns of data?  Do you want to read it all in at once?  If so, and
if they are numeric, you will need 4GB to hold one copy, and be
running on a 64-bit version of R.  If you want to do any processing
with everything in memory, I would suggest you have at least 16GB of
real memory since copies may be made while processing. Can you put
this on a data base and only read in the columns you need.  I can
handle 5M rows with 10 columns on my laptop with 2GB easily.  So it
all depends on the problem you are trying to solve.

On Mon, Jan 24, 2011 at 12:34 PM, Richard White <rhwhite at ucdavis.edu> wrote:
> How many records can the R recursive partitioning software handle?
>
>
>
> We are analyzing 5,000,000 medical records looking at 100 risk factors for
> the outcome of interest
>
>
>
> Richard H. White, MD
>
> Hibbard E. Williams Endowed Professor of Medicine
>
> Chief, Division of General Medicine
>
> DIrector, Anticoagulation Service
>
> UC Davis Medical Center
>
> Suite 2400 PSSB
>
> 4150 V Street
>
> Sacramento, CA, 95817
>
> Phone 916-734-7005
>
> FAX 916-734-2732
>
> Email:  rhwhite at ucdavis.edu
>
>
>
>
>        [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>



-- 
Jim Holtman
Data Munger Guru

What is the problem that you are trying to solve?