Matthew,

Did you take a look at the R.huge package?  It works well with numerical
data.

If you describe the problem you're trying to solve in more detail, it may
help us give you a better solution.

Btw, we use the filehash package with great success in accessing very large
amounts of data.

Best,
Adrian Dragulescu


On 11/1/07, Matthew Keller <mckellercran@gmail.com> wrote:
>
> Hi all,
>
> I've had one of my most miserable R weeks in memory. I'm trying to
> deal with huge datasets (>1GB each) but am running up against those
> pesky memory limits. The libraries filehash and g.data are not very
> suitable for what I need. I haven't gotten into the sql thing yet.
> Most recently I've been trying to install the new package ff (not yet
> on the CRAN repository). I can't find emails of the folks developing
> ff, so I was hoping someone here might have an idea how to deal with
> this.
>
> >From http://wsopuppenkiste.wiso.uni-goettingen.de/ff/ I've downloaded
> the ff_1.0.tar.gz.
>
> > install.packages
> (pkgs="ff_1.0.tar.gz",repos=NULL,destdir="/temp",type="source")
> <much output omitted>
> g++-4.0: installation problem, cannot exec
> 'i686-apple-darwin8-g++-4.0.0': No such file or directory
> make: *** [Error.o] Error 255
> chmod:
> /Library/Frameworks/R.framework/Versions/2.5/Resources/library/ff/libs/i386/*:
> No such file or directory
> ERROR: compilation failed for package 'ff'
>
> So it cannot find i686-apple-darwin8-g++-4.0.0. What the hell is that?
> A compiler I suppose. I HAVE installed the Mac OS developer tools. I
> have an MacBook Pro with 4GB RAM and am using the 32bit R:
>
> sessionInfo()
> R version 2.5.1 (2007-06-27)
> i386-apple-darwin8.9.1
>
> locale:
> en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
>
> attached base packages:
> [1] "stats"     "graphics"  "grDevices" "utils"     "datasets"
> "methods"   "base"
>
>
> Any ideas how to get ff to install properly on my system? Most
> appreciative of any advice!
>
> Matt
>
>
> --
> Matthew C Keller
> Asst. Professor of Psychology
> University of Colorado at Boulder
> www.matthewckeller.com
>
> ______________________________________________
> R-help@r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>

	[[alternative HTML version deleted]]

