[Rd] parallel::mclapply() dummy function on Windows?
Prof Brian Ripley
ripley at stats.ox.ac.uk
Fri Oct 7 21:40:39 CEST 2011
On Fri, 7 Oct 2011, Tim Triche, Jr. wrote:
> On Thu, Oct 6, 2011 at 11:25 PM, Prof Brian Ripley <ripley at stats.ox.ac.uk>
> wrote:
>
> Why would it make it easier? And how could using a dummy for 'most
> users' (who are on Windows) offer them 'good parallel support'?
>
>
> Good point. Most of my users are on unix, because my use of mclapply() is
> primarily to expedite processing of raw scanner data. Only a handful of
> users for the packages that call mclapply() are on Windows. Right now, I
> default to having parallel=FALSE flags all over the place, but I'd prefer
> for the default to be "go as fast as practical in the common case", i.e.,
> Unix. It would have been more accurate for me to say "I would like to
> parallelize by default, without having the methods fail on Windows in the
> default configuration" than to claim that I want "good parallel support" for
> Windows. When I have tried using the foreach/doMC combination in the past,
> it has not worked out satisfactorily, so I don't know how well I can support
> Windows users... period.
>
> Take a look at e.g. package 'boot' to see how to offer
> alternatives. (A version that uses 'parallel' is pending on
> CRAN, or see http://www.stats.ox.ac.uk/pub/R/boot_1.3-3.tar.gz
> .) Package 'parallel' may in future offer a higher-level
> abstraction layer that makes offers such a choice, but as the
> 'boot' code shows, deciding what to send to the workers in a
> snow-style cluster is not simple.
>
>
> It seems similar to what I do (off topic: why do you use the file extension
> '.q' for all of the R/S code files?): pass flags around. I suppose I was
*I* don't: the author did. It was the recommendation for S long ago:
.S is taken and .q stood for qpe, at one time (mind 1980s, AFAIR) the
proposed name for 'new S'.
> just being lazy, but I would love to default to "go as fast as possible"
> without having Windows users get left out in the cold (unless they add flags
> to their function calls).
>
> Thank you for your suggestions, I will look into this further.
>
> --
> Tim Triche, Jr.
> USC Biostatistics
>
>
--
Brian D. Ripley, ripley at stats.ox.ac.uk
Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/
University of Oxford, Tel: +44 1865 272861 (self)
1 South Parks Road, +44 1865 272866 (PA)
Oxford OX1 3TG, UK Fax: +44 1865 272595
More information about the R-devel
mailing list