[R-sig-hpc] Broadcast large matrix to slaves. A similar problem with snow

[jgarcia at ija.csic.es]

Hello all,
I'm also having problems with library snow 0.3-3 an R

I'm using

makeSOCKcluster(...)

and the cluster is a TORQUE PBS. In the past (last year) I used to pass
complete lists of parameters to conduct Monte Carlo runs in slave nodes,
up to for 8000 simulations. Now if I use > 1000 the system has an SIGKILL.
The administrators are helping but they do not know R nor snow(). Thus we
are are not sure if the problem is with Torque or with R-snow().

Do you know of any related problem, and if this may be ocurring with snow?

Thanks,

Best regards,
Javier García-Pintado
---------



> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> I'd like to broadcast a large matrix symmetrical matrix (17190 x 17190) to
> all
> slaves. However I get the following error:
> Error: serialization is too large to store in a raw vector
>
> Is there any way I could send such a large matrix to the slaves? Since
> it's
> symmetrical I could send just one triangle along with the diagonal, but
> I'd like
> to know why a large matrix can't be sent and if it can be circumvented!
>
> Cheers,
> Nath
>
> - --
> - --------------------------------------------------------
> Dr. Nathan S. Watson-Haigh
> OCE Post Doctoral Fellow
> CSIRO Livestock Industries
> Queensland Bioscience Precinct
> St Lucia, QLD 4067
> Australia
>
> Tel: +61 (0)7 3214 2922
> Fax: +61 (0)7 3214 2900
> Web: http://www.csiro.au/people/Nathan.Watson-Haigh.html
> - --------------------------------------------------------
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (MingW32)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAkn/ueAACgkQ9gTv6QYzVL6ZcgCcC65KI9C0ZI6y2AFiNjx4Inr9
> 1GMAoNRzjLv9F8dFAqlhaxz5XpgTyefg
> =yse5
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> R-sig-hpc mailing list
> R-sig-hpc at r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
>