[R] Reformulated matrices dimensions limitation problem

[Petr Pikal]

I believe that due to memory management the size of  biggest possible 
matrix can change. But I probably am not the persou who can explain 
it correctly.

Petr


On 2 Mar 2007 at 14:40, Bruno C. wrote:

Date sent:      	Fri, 2 Mar 2007 14:40:18 +0100
From:           	"Bruno C." <bruno.c at inwind.it>
To:             	"petr.pikal" <petr.pikal at precheza.cz>
Copies to:      	r-help <r-help at r-project.org>
Subject:        	Re: [R] Reformulated  matrices dimensions limitation problem

> bigml is for generalized regression model. I need to use lars ans svm.
> Anway I am perfectly able to train my model: my training matrix is not
> so big. The big matrix is the test one then I can split it by rows 
> into several matrices without affecting the results. The point is that
> I wanted to  split it in an elegant way, mainimizing the needed
> submatrices wrt memory. But I have the impression I am asking R too
> much :D
> 
> 
> > Did you consider biglm  package. I did not use it myself but from
> > its description it can be used for linear models on objects that do
> > not fit into memory.
> > 
> > HTH
> > Petr
> > 
> > 
> > On 2 Mar 2007 at 13:12, Bruno C. wrote:
> > 
> > Date sent:      	Fri, 2 Mar 2007 13:12:07 +0100
> > From:           	"Bruno C." <bruno.c at inwind.it>
> > To:             	"petr.pikal" <petr.pikal at precheza.cz>
> > Copies to:      	r-help <r-help at r-project.org>
> > Subject:        	Re: [R] Reformulated  matrices dimensions
> > limitation problem
> > 
> > > You are right. and I am aware of that.
> > > 
> > > This is what I need to do:
> > > load a regression model
> > > load the bigget posible matrix
> > > do prediction on this matrix
> > > 
> > > the first and 3rd step will not need to much memory... 
> > > 
> > > and I would really appreciate this degree of introspection from R:
> > > it would be great if there would be a package that could simulate
> > > the amount of memory needed from a process But I don't pretend
> > > that much, this is why I am asking only about  a function able to
> > > build a matrix matrix, with size based on memory available...
> > > 
> > > 
> > > 
> > > 
> > > > Hi
> > > > 
> > > > creating a biggest possible matrix does not automaticaly mean
> > > > you can do some computation with it. 
> > > > 
> > > > So the size will depend partly on what you want to do with it. I
> > > > presume that you do not want only to create a matrix just for
> > > > pleasure to be able to.
> > > > 
> > > > Cheers
> > > > Petr
> > > >  
> > > > 
> > > > On 2 Mar 2007 at 10:15, Bruno C. wrote:
> > > > 
> > > > Date sent:      	Fri, 2 Mar 2007 10:15:33 +0100
> > > > From:           	"Bruno C." <bruno.c at inwind.it>
> > > > To:             	"r-help" <r-help at r-project.org>
> > > > Subject:        	[R] Reformulated  matrices dimensions
> > > > limitation problem
> > > > 
> > > > > First I wanted to thank both Marc Schwartz Greg Snow and for
> > > > > their reply.
> > > > > 
> > > > > Then I needed to add a level of complexity to the problem. I
> > > > > would be able to create the biggest possible matrix.
> > > > > 
> > > > > In other way does it exist a method to ask smthing like the
> > > > > following :
> > > > > 
> > > > > max number of rows for a matrix if column=x?
> > > > > 
> > > > > Thank you
> > > > > 
> > > > > 
> > > > > 
> > > > > 
> > > > > 
> > > > > ------------------------------------------------------
> > > > > Passa a Infostrada. ADSL e Telefono senza limiti e senza
> > > > > canone Telecom http://click.libero.it/infostrada2marz07
> > > > > 
> > > > > ______________________________________________
> > > > > R-help at stat.math.ethz.ch mailing list
> > > > > https://stat.ethz.ch/mailman/listinfo/r-help
> > > > > PLEASE do read the posting guide
> > > > > http://www.R-project.org/posting-guide.html and provide
> > > > > commented, minimal, self-contained, reproducible code.
> > > > 
> > > > Petr Pikal
> > > > petr.pikal at precheza.cz
> > > > 
> > > > 
> > > 
> > > 
> > > ------------------------------------------------------
> > > Passa a Infostrada. ADSL e Telefono senza limiti e senza canone
> > > Telecom http://click.libero.it/infostrada2marz07
> > > 
> > > ______________________________________________
> > > R-help at stat.math.ethz.ch mailing list
> > > https://stat.ethz.ch/mailman/listinfo/r-help
> > > PLEASE do read the posting guide
> > > http://www.R-project.org/posting-guide.html and provide commented,
> > > minimal, self-contained, reproducible code.
> > 
> > Petr Pikal
> > petr.pikal at precheza.cz
> > 
> > 
> 
> 
> ------------------------------------------------------
> Passa a Infostrada. ADSL e Telefono senza limiti e senza canone
> Telecom http://click.libero.it/infostrada2marz07
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html and provide commented,
> minimal, self-contained, reproducible code.

Petr Pikal
petr.pikal at precheza.cz