[R] (correction) snowfall+Rmpi: sfExport error
Mario Valle
mvalle at cscs.ch
Tue Sep 22 16:56:24 CEST 2009
Sorry for wasting your time with an incorrect diagnosis in my previous mail!
I'm running my script using mpirun -mp 4 and using snowfall+Rmpi on
Linux 64bits. I receive the following error, that terminates the run.
Any idea?
I'm able to reproduce the problem with a minimal script (below).
If n < 16371 it completes 9 iterations without problems. Already at
16371 it dies at iteration 7 (with the error below).
This value of n is suspiciously close to 2^14 (16kb). So maybe it is a
configuration problem of my MPI installation. Or it is an undocumented
limitation of snowfall/snow/Rmpi. My real variable size is around
100000, so I prefer not to implement workarounds to sfExport variables
whose size is < 16k.
If you can point me in the right direction will be really helpful.
Thanks!
mario
TERM: Undefined variable.
TERM: Undefined variable.
TERM: Undefined variable.
TERM: Undefined variable.
Loading required package: utils
Loading required package: utils
Loading required package: utils
Loading required package: utils
Library Rmpi loaded.
snowfall 1.70 initialized: parallel execution on 3 CPUs.
Error in unserialize(obj) : unknown input format
Calls: sfExport ... mpi.recv.Robj -> .mpi.unserialize -> unserialize ->
.Call
Execution halted
MPI Application rank 0 exited before MPI_Finalize() with status 1
/users/mvalle/snow/snow/inst/RMPISNOW: line 40: 15028
Terminated R --no-save $*
/users/mvalle/snow/snow/inst/RMPISNOW: line 40: 23906
Terminated R --no-save $*
/users/mvalle/snow/snow/inst/RMPISNOW: line 40: 22094
Terminated R --no-save $*
--- script ------------------------------------
library('Rmpi')
library('snowfall')
sfInit(parallel=TRUE, cpus=3, type="MPI")
for(i in 1:9) {
n <- 20000
logx <- runif(n, 0.02, 0.54)
sfExport("logx")
}
sfStop()
--
Ing. Mario Valle
Data Analysis and Visualization Group |
http://www.cscs.ch/~mvalle
Swiss National Supercomputing Centre (CSCS) | Tel: +41 (91) 610.82.60
v. Cantonale Galleria 2, 6928 Manno, Switzerland | Fax: +41 (91) 610.82.82
______________________________________________
R-help at r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
More information about the R-help
mailing list