[R] Can R handle medium and large size data sets?

Gabor Csardi csardi at rmki.kfki.hu
Tue Jan 24 17:20:00 CET 2006

Completely agree, i use R to analyze graphs with millions of vertices and
tens of millions of edges. (Of course this is a bit different than working
with data frames.)

I think your problem is that the foreign package parses/converts your data
file slowly, convert it to R format and it will be much faster. 
The conversion can be a pain, but ideally you have to do it only once.


On Tue, Jan 24, 2006 at 10:51:09AM -0500, Wensui Liu wrote:
> my experience is that 100,000 shouldn't be a problem. of course, it also
> depends on your computer configuration.
> On 1/24/06, Gueorgui Kolev <joro.kolev at gmail.com> wrote:
> >
> > Dear R experts,
> >
> > Is it true that R generally cannot handle  medium sized data sets(a
> > couple of hundreds of thousands observations) and threrefore large
> > date set(couple of millions of observations)?
> >

Csardi Gabor <csardi at rmki.kfki.hu>    MTA RMKI, ELTE TTK

More information about the R-help mailing list