[R-sig-hpc] "chunking" parallel tasks
Brian G. Peterson
brian at braverock.com
Tue Jan 26 15:44:01 CET 2010
Mark Kimpel wrote:
> I have seen references on this list to "chunking" parallel tasks. If I am
> interpreting this correctly that is to decrease the overhead of multiple
> system calls. For instance, if I have a loop of 10000 simple tasks and 10
> processors, then 10 chunks of 1000 would be processed.
>
> Which of the parallel packages has the ability to take "chunk" (or its
> equivalent) as an argument? I've googled chunk with R and come up with
> everything but want I'm interested in.
>
Google "nesting foreach loops"
The foreach package will do what you want. Steve Weston has posted some
examples to this list on this topic as well.
Regards,
- Brian
More information about the R-sig-hpc
mailing list