[R-sig-hpc] "chunking" parallel tasks
Brian G. Peterson
brian at braverock.com
Tue Jan 26 15:44:01 CET 2010
Mark Kimpel wrote:
> I have seen references on this list to "chunking" parallel tasks. If I am
> interpreting this correctly that is to decrease the overhead of multiple
> system calls. For instance, if I have a loop of 10000 simple tasks and 10
> processors, then 10 chunks of 1000 would be processed.
> Which of the parallel packages has the ability to take "chunk" (or its
> equivalent) as an argument? I've googled chunk with R and come up with
> everything but want I'm interested in.
Google "nesting foreach loops"
The foreach package will do what you want. Steve Weston has posted some
examples to this list on this topic as well.
More information about the R-sig-hpc