[Rd] ShortRead::FastqStreamer and parallelization
Cook, Malcolm
MEC at stowers.org
Tue Nov 18 18:00:53 CET 2014
Hi,
I understand ShortRead::FastqStreamer will read chunks in parallel depending on the value of ShortRead:::.set_omp_threads
I see this discussed here: https://stat.ethz.ch/pipermail/bioc-devel/2013-May/004355.html and nowhere else.
It probably should be documented in ShortRead.
Possibly this has already changed for I am using still R 3.1.0. I thought I'd check.
Oh, and, in my hands/hardware, the value of this FastqStreamer's use of srapply's parallelization is negligible, at least if the consumer of successive yields is in the main process. I see that the new bpiterate appears to take advantage of yielding in forked processes, which sounds promising. Is that the idea?
Looking forward....
Malcolm Cook
More information about the R-devel
mailing list