[R-sig-hpc] R-sig-hpc Digest, Vol 87, Issue 6

[patric zhao]

Hi John,

Could you provide more details about what do you want to do on GPU
(may code examples)?
I have provided the case of using 'multicore' with multiple GPUs for
DNN in GTC16.

The second slide in below link, hopes it's helpful.
http://www.parallelr.com/training/

BR,

-Patric

On Tue, Apr 26, 2016 at 6:00 PM,  <r-sig-hpc-request at r-project.org> wrote:
> Send R-sig-hpc mailing list submissions to
>         r-sig-hpc at r-project.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
> or, via email, send a message with subject or body 'help' to
>         r-sig-hpc-request at r-project.org
>
> You can reach the person managing the list at
>         r-sig-hpc-owner at r-project.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of R-sig-hpc digest..."
>
>
> Today's Topics:
>
>    1. gpus with foreach (John Denton)
>    2. Re: gpus with foreach (Brian G. Peterson)
>    3. Re: gpus with foreach (Charles Determan)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 25 Apr 2016 17:04:47 +0000
> From: John Denton <jdenton at amnh.org>
> To: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org>
> Subject: [R-sig-hpc] gpus with foreach
> Message-ID:
>         <9DB18CB85B13594BA44ADD67DC99C602017947059E at MAIL-MBX-004.internal.amnh.org>
>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi, all.
>
> Does anybody know of a library that allows foreach to be called over GPUs, specifically? I'm interested in parallelizing a very large number of calls to system(), and am still debugging a cluster issue, so doMPI, etc are not working at the moment.
>
> Thanks.
>
> John S. S. Denton, Ph.D.
> Department of Vertebrate Paleontology
> American Museum of Natural History
> www.johnssdenton.com
>
>
> ------------------------------
>
> Message: 2
> Date: Mon, 25 Apr 2016 12:11:52 -0500
> From: "Brian G. Peterson" <brian at braverock.com>
> To: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org>
> Subject: Re: [R-sig-hpc] gpus with foreach
> Message-ID: <1461604312.8091.304.camel at brian-rcg>
> Content-Type: text/plain; charset="UTF-8"
>
> On Mon, 2016-04-25 at 17:04 +0000, John Denton wrote:
>> Does anybody know of a library that allows foreach to be called over
>> GPUs, specifically? I'm interested in parallelizing a very large number
>> of calls to system(), and am still debugging a cluster issue, so doMPI,
>> etc are not working at the moment.
>
> There's no reason you can't call system() from inside your foreach loop,
> so you could, for example, use foreach with a socket cluster, or a redis
> cluster, to send jobs to workers on different physical machines, and
> call system() in the body of the foreach loop.
>
> Or perhaps your questions isn't specific enough for me to understand
> what you're trying to do?
>
> Regards,
>
> Brian
>
> --
> Brian G. Peterson
> http://braverock.com/brian/
> Ph: 773-459-4973
> IM: bgpbraverock
>
>
>
> ------------------------------
>
> Message: 3
> Date: Mon, 25 Apr 2016 12:16:17 -0500
> From: Charles Determan <cdetermanjr at gmail.com>
> To: John Denton <jdenton at amnh.org>
> Cc: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org>
> Subject: Re: [R-sig-hpc] gpus with foreach
> Message-ID:
>         <CAKxd1KMH+ke2ewHiEc+AWaDpKOj7w8i91dU3ZEydxMzy818FvA at mail.gmail.com>
> Content-Type: text/plain; charset="UTF-8"
>
> Hi John,
>
> I'm not sure about a package designed specifically for this but I have been
> toying with the idea about how I could implement it with my GPU package
> gpuR (https://cran.r-project.org/web/packages/gpuR/index.html).  Do you
> have at least as many CPUs and GPUs?  If so, that should make the
> implementation easier.  Essentially this would consist of using the
> 'setContext' function within each fork generated by foreach corresponding
> to different GPU.  There is an existing issue on my it repo regarding
> selection of specific GPUs (https://github.com/cdeterman/gpuR/issues/9).
> Once I have a user willing to test my code (I only have one GPU personally)
> I can finalize that feature and it is theoretically plausible to use
> foreach with my package on your GPUs.
>
> If you are interested we may want to move this conversation off-list since
> this would be developmental.
>
> Regards,
>
> Charles Determan PhD
> Data Scientist
>
>
> On Mon, Apr 25, 2016 at 12:04 PM, John Denton <jdenton at amnh.org> wrote:
>
>> Hi, all.
>>
>> Does anybody know of a library that allows foreach to be called over GPUs,
>> specifically? I'm interested in parallelizing a very large number of calls
>> to system(), and am still debugging a cluster issue, so doMPI, etc are not
>> working at the moment.
>>
>> Thanks.
>>
>> John S. S. Denton, Ph.D.
>> Department of Vertebrate Paleontology
>> American Museum of Natural History
>> www.johnssdenton.com
>> _______________________________________________
>> R-sig-hpc mailing list
>> R-sig-hpc at r-project.org
>> https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
>>
>
>         [[alternative HTML version deleted]]
>
>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> R-sig-hpc mailing list
> R-sig-hpc at r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
>
> ------------------------------
>
> End of R-sig-hpc Digest, Vol 87, Issue 6
> ****************************************