Hi Erin,

Okay so our question is about parallelization?  There are packages designed for this that handle distributing to the nodes nicely.  I'm not sure if they are the best but snow and snowfall come to mind.  Recently I just use the new parallel package but that only came out in R 2.14.0.

Basically you jut setup the 10000 loops or implicit loops and the package distributes to nodes as they become available (or you could pressing ate certain nodes to do x number of runs but I don't see a compelling reason why not to just send as they are available).

Cheers,

Josh

On Feb 4, 2012, at 15:41, "Hodgess, Erin" <HodgessE@uhd.edu> wrote:

> Hi Josh:
> 
> Thanks for your reply.....the answer to my original question is, of course, "it depends".
> 
> Anyhow, suppose I have something like this:
> 
> I want to run a simulation of 10,000 AR models and get an average of the phi coefficient and the error variance.
> 
> I have 12 nodes.
> 
> I was thinking of how best to ship out the reps to minimize the time.
> 
> Does this help, please?
> 
> Thanks again,
> Erin
> 
> 
> Erin M. Hodgess, PhD
> Associate Professor
> Department of Computer and Mathematical Sciences
> University of Houston - Downtown
> mailto: hodgesse@uhd.edu
> 
> 
> 
> -----Original Message-----
> From: Joshua Wiley [mailto:jwiley.psych@gmail.com]
> Sent: Sat 2/4/2012 5:34 PM
> To: Hodgess, Erin
> Cc: r-sig-hpc@r-project.org
> Subject: Re: [R-sig-hpc] an opinion question
> 
> Hi Erin,
> 
> What do you mean by 'start'?  That is much too vague to get a good
> reply.  We need information about what you are trying to do and what
> your situation is.  I typically ssh in, try simple stuff / verify
> everything works in a small case in interactive mode and then submit a
> batch job.
> 
> Josh
> 
> On Sat, Feb 4, 2012 at 3:25 PM, Hodgess, Erin <HodgessE@uhd.edu> wrote:
> > Hi everyone!
> >
> > Here is an opinion question please:  when using R on a cluster, what is the best way to start please?
> >
> > I learned a little bit a couple of years ago but have forgotten most of it.
> >
> > Thanks,
> > Erin
> >
> >
> > Erin M. Hodgess, PhD
> > Associate Professor
> > Department of Computer and Mathematical Sciences
> > University of Houston - Downtown
> > mailto: hodgesse@uhd.edu
> >
> >
> >        [[alternative HTML version deleted]]
> >
> > _______________________________________________
> > R-sig-hpc mailing list
> > R-sig-hpc@r-project.org
> > https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
> 
> 
> 
> --
> Joshua Wiley
> Ph.D. Student, Health Psychology
> Programmer Analyst II, Statistical Consulting Group
> University of California, Los Angeles
> https://joshuawiley.com/
> 

	[[alternative HTML version deleted]]