[R] sqldf for Very Large Tab Delimited Files

Steve Lianoglou mailinglist.honeypot at gmail.com
Fri Feb 3 14:59:18 CET 2012


On Fri, Feb 3, 2012 at 7:37 AM, Gabor Grothendieck
<ggrothendieck at gmail.com> wrote:
> On Fri, Feb 3, 2012 at 6:03 AM, HC <hcatbr at yahoo.co.in> wrote:
>> Thank you for indicating that SQLite may not handle a file as big as 160 GB.
>>
>> Would you know of any utility for *physically splitting *the 160 GB text
>> file into pieces. And if one can control the splitting at the  end of a
>> record.
>>
>
> If they are csv files or similar data files then you could use R or
> any scripting language to do that.

Or even the *nix `split` command ...

-steve

-- 
Steve Lianoglou
Graduate Student: Computational Systems Biology
 | Memorial Sloan-Kettering Cancer Center
 | Weill Medical College of Cornell University
Contact Info: http://cbio.mskcc.org/~lianos/contact



More information about the R-help mailing list