Hi John, Could you provide more details about what do you want to do on GPU (may code examples)? I have provided the case of using 'multicore' with multiple GPUs for DNN in GTC16. The second slide in below link, hopes it's helpful. http://www.parallelr.com/training/ BR, -Patric
On Tue, Apr 26, 2016 at 6:00 PM, <r-sig-hpc-request at r-project.org> wrote:
Send R-sig-hpc mailing list submissions to
r-sig-hpc at r-project.org
To subscribe or unsubscribe via the World Wide Web, visit
https://stat.ethz.ch/mailman/listinfo/r-sig-hpc or, via email, send a message with subject or body 'help' to r-sig-hpc-request at r-project.org You can reach the person managing the list at r-sig-hpc-owner at r-project.org When replying, please edit your Subject line so it is more specific than "Re: Contents of R-sig-hpc digest..." Today's Topics: 1. gpus with foreach (John Denton) 2. Re: gpus with foreach (Brian G. Peterson) 3. Re: gpus with foreach (Charles Determan) ---------------------------------------------------------------------- Message: 1 Date: Mon, 25 Apr 2016 17:04:47 +0000 From: John Denton <jdenton at amnh.org> To: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org> Subject: [R-sig-hpc] gpus with foreach Message-ID: <9DB18CB85B13594BA44ADD67DC99C602017947059E at MAIL-MBX-004.internal.amnh.org> Content-Type: text/plain; charset="us-ascii" Hi, all. Does anybody know of a library that allows foreach to be called over GPUs, specifically? I'm interested in parallelizing a very large number of calls to system(), and am still debugging a cluster issue, so doMPI, etc are not working at the moment. Thanks. John S. S. Denton, Ph.D. Department of Vertebrate Paleontology American Museum of Natural History www.johnssdenton.com ------------------------------ Message: 2 Date: Mon, 25 Apr 2016 12:11:52 -0500 From: "Brian G. Peterson" <brian at braverock.com> To: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org> Subject: Re: [R-sig-hpc] gpus with foreach Message-ID: <1461604312.8091.304.camel at brian-rcg> Content-Type: text/plain; charset="UTF-8" On Mon, 2016-04-25 at 17:04 +0000, John Denton wrote: Does anybody know of a library that allows foreach to be called over GPUs, specifically? I'm interested in parallelizing a very large number of calls to system(), and am still debugging a cluster issue, so doMPI, etc are not working at the moment. There's no reason you can't call system() from inside your foreach loop, so you could, for example, use foreach with a socket cluster, or a redis cluster, to send jobs to workers on different physical machines, and call system() in the body of the foreach loop. Or perhaps your questions isn't specific enough for me to understand what you're trying to do? Regards, Brian -- Brian G. Peterson http://braverock.com/brian/ Ph: 773-459-4973 IM: bgpbraverock ------------------------------ Message: 3 Date: Mon, 25 Apr 2016 12:16:17 -0500 From: Charles Determan <cdetermanjr at gmail.com> To: John Denton <jdenton at amnh.org> Cc: "r-sig-hpc at r-project.org" <r-sig-hpc at r-project.org> Subject: Re: [R-sig-hpc] gpus with foreach Message-ID: <CAKxd1KMH+ke2ewHiEc+AWaDpKOj7w8i91dU3ZEydxMzy818FvA at mail.gmail.com> Content-Type: text/plain; charset="UTF-8" Hi John, I'm not sure about a package designed specifically for this but I have been toying with the idea about how I could implement it with my GPU package gpuR (https://cran.r-project.org/web/packages/gpuR/index.html). Do you have at least as many CPUs and GPUs? If so, that should make the implementation easier. Essentially this would consist of using the 'setContext' function within each fork generated by foreach corresponding to different GPU. There is an existing issue on my it repo regarding selection of specific GPUs (https://github.com/cdeterman/gpuR/issues/9). Once I have a user willing to test my code (I only have one GPU personally) I can finalize that feature and it is theoretically plausible to use foreach with my package on your GPUs. If you are interested we may want to move this conversation off-list since this would be developmental. Regards, Charles Determan PhD Data Scientist On Mon, Apr 25, 2016 at 12:04 PM, John Denton <jdenton at amnh.org> wrote: Hi, all. Does anybody know of a library that allows foreach to be called over GPUs, specifically? I'm interested in parallelizing a very large number of calls to system(), and am still debugging a cluster issue, so doMPI, etc are not working at the moment. Thanks. John S. S. Denton, Ph.D. Department of Vertebrate Paleontology American Museum of Natural History www.johnssdenton.com _______________________________________________ R-sig-hpc mailing list R-sig-hpc at r-project.org https://stat.ethz.ch/mailman/listinfo/r-sig-hpc [[alternative HTML version deleted]] ------------------------------ Subject: Digest Footer _______________________________________________ R-sig-hpc mailing list R-sig-hpc at r-project.org https://stat.ethz.ch/mailman/listinfo/r-sig-hpc ------------------------------ End of R-sig-hpc Digest, Vol 87, Issue 6 ****************************************