[R] Reformulated matrices dimensions limitation problem
Mark Herzog
mherzog at prbo.org
Fri Mar 2 19:34:19 CET 2007
I don't have anything in front of me but just to make sure everyone knows thee are 2 rfp's out there right now from sea grant. 1 is a speceduc climate change and the other the normal RFP. I think the proopal would fit in either
Perhaps that is the discrepency in amounts?
-----------------------------------------------------------
Mark Herzog PhD
Program Director
San Francisco Bay Research, Wetlands Division
PRBO Conservation Science
(415) 893-7677 x308 (office)
mherzog at prbo.org
-----Original Message-----
From: "Petr Pikal" <petr.pikal at precheza.cz>
Date: Fri, 02 Mar 2007 15:22:06
To:"Bruno C." <bruno.c at inwind.it>, r-help <r-help at r-project.org>
Subject: Re: [R] Reformulated matrices dimensions limitation problem
I believe that due to memory management the size of biggest possible
matrix can change. But I probably am not the persou who can explain
it correctly.
Petr
On 2 Mar 2007 at 14:40, Bruno C. wrote:
Date sent: Fri, 2 Mar 2007 14:40:18 +0100
From: "Bruno C." <bruno.c at inwind.it>
To: "petr.pikal" <petr.pikal at precheza.cz>
Copies to: r-help <r-help at r-project.org>
Subject: Re: [R] Reformulated matrices dimensions limitation problem
> bigml is for generalized regression model. I need to use lars ans svm.
> Anway I am perfectly able to train my model: my training matrix is not
> so big. The big matrix is the test one then I can split it by rows
> into several matrices without affecting the results. The point is that
> I wanted to split it in an elegant way, mainimizing the needed
> submatrices wrt memory. But I have the impression I am asking R too
> much :D
>
>
> > Did you consider biglm package. I did not use it myself but from
> > its description it can be used for linear models on objects that do
> > not fit into memory.
> >
> > HTH
> > Petr
> >
> >
> > On 2 Mar 2007 at 13:12, Bruno C. wrote:
> >
> > Date sent: Fri, 2 Mar 2007 13:12:07 +0100
> > From: "Bruno C." <bruno.c at inwind.it>
> > To: "petr.pikal" <petr.pikal at precheza.cz>
> > Copies to: r-help <r-help at r-project.org>
> > Subject: Re: [R] Reformulated matrices dimensions
> > limitation problem
> >
> > > You are right. and I am aware of that.
> > >
> > > This is what I need to do:
> > > load a regression model
> > > load the bigget posible matrix
> > > do prediction on this matrix
> > >
> > > the first and 3rd step will not need to much memory...
> > >
> > > and I would really appreciate this degree of introspection from R:
> > > it would be great if there would be a package that could simulate
> > > the amount of memory needed from a process But I don't pretend
> > > that much, this is why I am asking only about a function able to
> > > build a matrix matrix, with size based on memory available...
> > >
> > >
> > >
> > >
> > > > Hi
> > > >
> > > > creating a biggest possible matrix does not automaticaly mean
> > > > you can do some computation with it.
> > > >
> > > > So the size will depend partly on what you want to do with it. I
> > > > presume that you do not want only to create a matrix just for
> > > > pleasure to be able to.
> > > >
> > > > Cheers
> > > > Petr
> > > >
> > > >
> > > > On 2 Mar 2007 at 10:15, Bruno C. wrote:
> > > >
> > > > Date sent: Fri, 2 Mar 2007 10:15:33 +0100
> > > > From: "Bruno C." <bruno.c at inwind.it>
> > > > To: "r-help" <r-help at r-project.org>
> > > > Subject: [R] Reformulated matrices dimensions
> > > > limitation problem
> > > >
> > > > > First I wanted to thank both Marc Schwartz Greg Snow and for
> > > > > their reply.
> > > > >
> > > > > Then I needed to add a level of complexity to the problem. I
> > > > > would be able to create the biggest possible matrix.
> > > > >
> > > > > In other way does it exist a method to ask smthing like the
> > > > > following :
> > > > >
> > > > > max number of rows for a matrix if column=x?
> > > > >
> > > > > Thank you
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > ------------------------------------------------------
> > > > > Passa a Infostrada. ADSL e Telefono senza limiti e senza
> > > > > canone Telecom http://click.libero.it/infostrada2marz07
> > > > >
> > > > > ______________________________________________
> > > > > R-help at stat.math.ethz.ch mailing list
> > > > > https://stat.ethz.ch/mailman/listinfo/r-help
> > > > > PLEASE do read the posting guide
> > > > > http://www.R-project.org/posting-guide.html and provide
> > > > > commented, minimal, self-contained, reproducible code.
> > > >
> > > > Petr Pikal
> > > > petr.pikal at precheza.cz
> > > >
> > > >
> > >
> > >
> > > ------------------------------------------------------
> > > Passa a Infostrada. ADSL e Telefono senza limiti e senza canone
> > > Telecom http://click.libero.it/infostrada2marz07
> > >
> > > ______________________________________________
> > > R-help at stat.math.ethz.ch mailing list
> > > https://stat.ethz.ch/mailman/listinfo/r-help
> > > PLEASE do read the posting guide
> > > http://www.R-project.org/posting-guide.html and provide commented,
> > > minimal, self-contained, reproducible code.
> >
> > Petr Pikal
> > petr.pikal at precheza.cz
> >
> >
>
>
> ------------------------------------------------------
> Passa a Infostrada. ADSL e Telefono senza limiti e senza canone
> Telecom http://click.libero.it/infostrada2marz07
>
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html and provide commented,
> minimal, self-contained, reproducible code.
Petr Pikal
petr.pikal at precheza.cz
______________________________________________
R-help at stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
More information about the R-help
mailing list