[R-SIG-Finance] Running R as a server or in a cluster
adrian_d at eskimo.com
Wed Sep 26 15:08:12 CEST 2007
We have set up a Condor cluster, see http://www.cs.wisc.edu/condor/ and we
submit R jobs to the cluster. It works well because Condor has very
advanced scheduling capabilities, job monitoring, etc.
On Wed, 26 Sep 2007, Brian G. Peterson wrote:
> Ryan Sheftel wrote:
> > "There are also many methods available to make R run as
> > a server process listening on a socket or on a cluster. It would be
> > incorrect to simply classify R as a single-threaded application. There
> > is, as Ryan points out, programming effort involved to work in a
> > clustered or multi-core environment, and wrapping R/DCOM with an
> > event-based language is one approach to achieving this, but not the only
> > one."
> > Can you share your favorite method? I would be interested to learn as
> > this is a problem we are facing. If it is proprietary of involved I
> > understand.
> I believe in sharing "generally useful" approaches (and code). Trading
> models are, of course, proprietary. ;)
> Several groups I know make extensive use of the Rserve package
> The Rserve model fits in well with integration to some other programming
> language that would drive the interactions and fire off requests to some
> large server.
> There is also R.rsp for ASP/JSP like programming:
> One of the simplest approaches to clustering is to use the snow library:
> Since this doesn't require a formal cluster.
> Dirk's Quantian project installs the Mosix cluster and R by default.
> For true grid/cluster integration, the most advanced set of features I'm
> aware of is offered by the various Parallel-R libraries, which are used
> extensively in scientific computing clusters:
> Perhaps others on the list will fill us in on approaches I've missed.
> - Brian
> R-SIG-Finance at stat.math.ethz.ch mailing list
> -- Subscriber-posting only.
> -- If you want to post, subscribe first.
More information about the R-SIG-Finance