[R-sig-hpc] Recommended method for mutlithreaded, multinode in R?
bennet @end|ng |rom um|ch@edu
Mon Jun 10 21:53:45 CEST 2019
Are there standard combinations of packages that people use when they
want to use R on multiple nodes and have the R processes on those
nodes call threaded C++ libraries?
For example, if this were straight MPI, one might use a scheduler to
get 8 cores per node assigned to a job, but then only start two MPI
processes per node so that OpenMP for each of those process would have
access to 4 cores.
Most of the ways I've seen to get R going seem to assume that Rmpi
will be used, and that the master R process will be started and it
will in turn spawn one R process for each core in the job.
Has someone written a way to do this where one might do something like
this with OpenMPI ( or the equivalent with a different MPI)
$ mpirun -pernode R hybrid.R
where the hybrid.R would be able to come up and know how to find its
tasks and do them?
Thanks in advance for any pointers anyone might have.
More information about the R-sig-hpc