[R-sig-hpc] "chunking" parallel tasks

Brian G. Peterson brian at braverock.com
Tue Jan 26 15:44:01 CET 2010

Mark Kimpel wrote:
> I have seen references on this list to "chunking" parallel tasks. If I am
> interpreting this correctly that is to decrease the overhead of multiple
> system calls. For instance, if I  have a loop of 10000 simple tasks and 10
> processors, then 10 chunks of 1000 would be processed.
> Which of the parallel packages has the ability to take "chunk" (or its
> equivalent) as an argument? I've googled chunk with R and come up with
> everything but want I'm interested in.
Google "nesting foreach loops"

The foreach package will do what you want.  Steve Weston has posted some 
examples to this list on this topic as well.


   - Brian

More information about the R-sig-hpc mailing list