[R-SIG-Finance] Running R as a server or in a cluster

[Adrian Dragulescu]

Brian,

We're running Rscript, the "newer" version of R CMD BATCH.  We
have a big dependency graph, with many R jobs (+1000), spanning several
projects.  We split big problems into smaller ones and aggregate latter.
Since one project depends on others running successfuly, it's
important to monitor, recover jobs, restart the queue, etc.  Condor allows
us to do this quite well.

Regards,
Adrian


On Wed, 26 Sep 2007, Brian G. Peterson wrote:

> Adrian Dragulescu wrote:
> > We have set up a Condor cluster, see http://www.cs.wisc.edu/condor/ and we
> > submit R jobs to the cluster.  It works well because Condor has very
> > advanced scheduling capabilities, job monitoring, etc.
>
> Adrian,
>
> Could you provide more details?  Are you running Rserve on the cluster,
> running "R CMD BATCH", or using Parallel-R?
>
> I'd like to suggest that we use this thread to continue to develop the
> collective knowledge of the r-sig-finance community on distributed or
> high-throughput R calculations.
>
> Regards,
>
>     - Brian
>
> _______________________________________________
> R-SIG-Finance at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
> -- Subscriber-posting only.
> -- If you want to post, subscribe first.
>