[R] Using very large matrix
jayemerson at gmail.com
Mon Mar 2 14:52:51 CET 2009
The old version is still on CRAN, but I strongly encourage anyone
interested to email me directly and I'll make the new version available.
In fact, I wouldn't mind just pulling the old version off of CRAN, but of course
that's not a great idea. !-)
On Mon, Mar 2, 2009 at 8:47 AM, <Steve_Friedman at nps.gov> wrote:
> I'm very interested in the bigmemory package for windows 32-bit
> environments. Who do I need to contact to request the Beta version?
> Steve Friedman Ph. D.
> Spatial Statistical Analyst
> Everglades and Dry Tortugas National Park
> 950 N Krome Ave (3rd Floor)
> Homestead, Florida 33034
> Steve_Friedman at nps.gov
> Office (305) 224 - 4282
> Fax (305) 224 - 4147
> <ct529 at york.ac.uk
> > To
> Sent by: john.emerson at yale.edu, Tony Breyal
> r-help-bounces at r- <tony.breyal at googlemail.com>
> project.org cc
> r-help at r-project.org
> 03/02/2009 10:46 Re: [R] Using very large matrix
> AM GMT
> Thanks a lot!
> Unfortunately, the R package I have to sue for my research was only
> on 32 bit R on 32 bit MS Windows and only closed source .... I normally
> 64 bit R on 64 bit Linux .... :)
> I tried to use the bigmemory in cran with 32 bit windows, but I had some
> serious problems.
> On Thursday 26 February 2009 15:43:11 Jay Emerson wrote:
>> Package bigmemory has undergone a major re-engineering and will be
>> available soon (available now in Beta version upon request). The version
>> currently on CRAN
>> is probably of limited use unless you're in Linux.
>> bigmemory may be useful to you for data management, at the very least,
>> x <- filebacked.big.matrix(80000, 80000, init=n, type="double")
>> would accomplish what you want using filebacking (disk space) to hold
>> the object.
>> But even this requires 64-bit R (Linux or Mac, or perhaps a Beta
>> version of Windows 64-bit
>> R that REvolution Computing is working on).
>> Subsequent operations (e.g. extraction of a small portion for analysis)
>> then easy enough:
>> y <- x[1,]
>> would give you the first row of x as an object y in R. Note that x is
>> not itself an R matrix,
>> and most existing R analytics can't work on x directly (and would max
>> out the RAM if they
>> tried, anyway).
>> Feel free to email me for more information (and this invitation
>> applies to anyone who is
>> interested in this).
>> #Dear friends,
>> #I have to use a very large matrix. Something of the sort of
>> #matrix(80000,80000,n) .... where n is something numeric of the sort
>> 0.xxxxxx #
>> #I have not found a way of doing it. I keep getting the error
>> #Error in matrix(nrow = 80000, ncol = 80000, 0.2) : too many elements
>> specified #
>> #Any suggestions? I have searched the mailing list, but to no avail.
>> #Corrado Topi
>> #Global Climate Change & Biodiversity Indicators
>> #Area 18,Department of Biology
>> #University of York, York, YO10 5YW, UK
>> #Phone: + 44 (0) 1904 328645, E-mail: ct529 at york.ac.uk
> Corrado Topi
> Global Climate Change & Biodiversity Indicators
> Area 18,Department of Biology
> University of York, York, YO10 5YW, UK
> Phone: + 44 (0) 1904 328645, E-mail: ct529 at york.ac.uk
> R-help at r-project.org mailing list
> PLEASE do read the posting guide
> and provide commented, minimal, self-contained, reproducible code.
John W. Emerson (Jay)
Assistant Professor of Statistics
Department of Statistics
More information about the R-help