[R] Processing 10^8 rows and 1^3 columns

[Gabor Grothendieck]

The sqldf package makes it easy to use DBI, RSQLite and sqlite
to read a large file directly to an sqlite database without going through
R and then read all or a portion of it into R using an arbitrary SQL
statement.  See example 6 on the home page: http://sqldf.googlecode.com


On Wed, Jul 2, 2008 at 11:21 PM, Daren Tan <daren76 at hotmail.com> wrote:
>
> With smaller tab-limited files, I could load them using read.table and the likes. Now I have a gigantic 10^8 rows and 1^3 columns tab-limited file for processsing, please throw some ideas how to handle it.
>
> Thanks
> _________________________________________________________________
> Publish your photos to your Space easily with Photo Gallery.
>
>        [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>