[R-sig-hpc] digesting "parallel" package in R-2.14. how about you?
Christophe Dutang
dutangc at gmail.com
Thu Jan 5 09:25:01 CET 2012
Dear Paul,
I have also started HPC few days ago. Please see my post https://stat.ethz.ch/pipermail/r-sig-hpc/2011-December/001186.html
where I have tested an example from http://www.informatik.uni-ulm.de/ni/staff/HKestler/Reisensburg2009/PDF/multicore.pdf .
See also, my reply here https://stat.ethz.ch/pipermail/r-sig-hpc/attachments/20111205/dbba522a/attachment.pl for HPC on windows 7.
Hope it helps
Christophe
--
Christophe Dutang
Ph.D. student at ISFA, Lyon, France
website: http://dutangc.free.fr
Le 5 janv. 2012 à 05:09, Paul Johnson a écrit :
> Have you been testing out R's new parallel package? I'm getting
> started and wonder about your experience. The help page is very brief
> because most of the functions are not exported, so I'm finding it a
> bit difficult to use.
>
> Our cluster runs RMPI over OpenMPI. Initially, I thought that would
> be a bad problem because parallel is intended for "sock" and "fork"
> clusters. That seemed bad, but parallel's makeCluster help page says
> it will call snow to make the cluster. So I think that's OK for me,
> if I were using a snow cluster. The parallel vignette also says its
> functions will work with clusters created by snow, so that's hopeful.
>
> In the past, I've blundered into conflicts between OpenMPI and the
> other frameworks that are drawn in by some packages. OpenMPI doesn't
> play well with libraries that want to spawn thread, for example.
> OpenMPI is not compatible with OpenMP and the multicore package, but
> the parallel package uses those things. I worry they will slide in
> where I don't want them.
>
> Here's an example of an error I got today, I don't know yet what
> causes it, but I'm suspicious :)
>
> --------------------------------------------------------------------------
> An MPI process has executed an operation involving a call to the
> "fork()" system call to create a child process. Open MPI is currently
> operating in a condition that could result in memory corruption or
> other system errors; your MPI job may hang, crash, or produce silent
> data corruption. The use of fork() (or system() or other calls that
> create child processes) is strongly discouraged.
>
> The process that invoked fork was:
>
> Local host: compute-2-11.local (PID 8290)
> MPI_COMM_WORLD rank: 0
>
> If you are *absolutely sure* that your application will successfully
> and correctly survive a call to fork(), you may disable this warning
> by setting the mpi_warn_on_fork MCA parameter to 0.
> --------------------------------------------------------------------------
>
>
>
> --
> Paul E. Johnson
> Professor, Political Science
> 1541 Lilac Lane, Room 504
> University of Kansas
>
> _______________________________________________
> R-sig-hpc mailing list
> R-sig-hpc at r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
More information about the R-sig-hpc
mailing list