[R-sig-hpc] "chunking" parallel tasks

Brian G. Peterson brian at braverock.com
Tue Jan 26 15:44:01 CET 2010


Mark Kimpel wrote:
> I have seen references on this list to "chunking" parallel tasks. If I am
> interpreting this correctly that is to decrease the overhead of multiple
> system calls. For instance, if I  have a loop of 10000 simple tasks and 10
> processors, then 10 chunks of 1000 would be processed.
>
> Which of the parallel packages has the ability to take "chunk" (or its
> equivalent) as an argument? I've googled chunk with R and come up with
> everything but want I'm interested in.
>   
Google "nesting foreach loops"

The foreach package will do what you want.  Steve Weston has posted some 
examples to this list on this topic as well.

Regards,

   - Brian



More information about the R-sig-hpc mailing list