[R] Reading large files quickly

Rob Steele freenx.10.robsteele at xoxy.net
Sat May 9 18:25:15 CEST 2009


I'm finding that readLines() and read.fwf() take nearly two hours to
work through a 3.5 GB file, even when reading in large (100 MB) chunks.
 The unix command wc by contrast processes the same file in three
minutes.  Is there a faster way to read files in R?

Thanks!




More information about the R-help mailing list