[R-sig-hpc] [zeromq-dev] rzmq package

Whit Armstrong armstrong.whit at gmail.com
Thu Sep 29 15:45:23 CEST 2011


yes, indeed.  just need to hammer out the man pages for the R package.
 then I'll move on to the zmq bindings site.

Cheers,
Whit


On Thu, Sep 29, 2011 at 9:29 AM, Martin Sustrik <sustrik at 250bpm.com> wrote:
> Hi Whit,
>
> Nice! We've used R to process results from 0MQ benchmarking. Now we're back
> from a different direction.
>
> Would you mind creating a page on zero.mq website (it's a wiki) so that
> people know that the binding exists?
>
> Martin
>
> On 09/29/2011 05:03 AM, Daniel Cegiełka wrote:
>>
>> I will send your message to zmq-list!
>>
>> thx  Armstrong!
>> daniel
>>
>>
>> 2011/9/29 Whit Armstrong <armstrong.whit at gmail.com
>> <mailto:armstrong.whit at gmail.com>>
>>
>>    Just a quick post on a new package I've been wrapping up, rzmq.
>>
>>    https://github.com/armstrtw/rzmq
>>
>>    Finding inspiration in JD Long's segue package, and frustration with
>>    the config steps involved in dynamically updating the older debian
>>    distribution that Amazon uses for it's emr machines, I decided to try
>>    to hit the ec2 machines directly using my own ami.
>>
>>    The zmq messaging patterns allow one to distribute jobs across many
>>    nodes, but for now a simple example with only 1 micro instance.
>>
>>    the remote server:
>>
>>    ubuntu at ip-10-243-90-36:~$ cat remote.server2.r
>>    #!/usr/bin/env Rscript
>>
>>    library(rzmq)
>>    context = init.context()
>>    in.socket = init.socket(context,"ZMQ_PULL")
>>    bind.socket(in.socket,"tcp://*:5557")
>>
>>    out.socket = init.socket(context,"ZMQ_PUSH")
>>    bind.socket(out.socket,"tcp://*:5558")
>>
>>    while(1) {
>>        msg = receive.socket(in.socket);
>>        fun <- msg$fun
>>        args <- msg$args
>>        print(args)
>>        ans <- do.call(fun,args)
>>        send.socket(out.socket,ans);
>>    }
>>    ubuntu at ip-10-243-90-36:~$
>>
>>
>>    and the locally executed code:
>>
>>    estimatePi <- function(seed) {
>>        set.seed(seed)
>>        numDraws <- 1e5
>>
>>        r <- .5 #radius... in case the unit circle is too boring
>>        x <- runif(numDraws, min=-r, max=r)
>>        y <- runif(numDraws, min=-r, max=r)
>>        inCircle <- ifelse( (x^2 + y^2)^.5 < r , 1, 0)
>>
>>        sum(inCircle) / length(inCircle) * 4
>>    }
>>
>>
>>    print(system.time(ans <- zmq.lapply(as.list(1:1e2),
>>                                        estimatePi,
>>
>>    execution.server="tcp://ec2-184-73-102-95.compute-1.amazonaws.com:5557
>>    <http://ec2-184-73-102-95.compute-1.amazonaws.com:5557>",
>>
>>    sink.server="tcp://ec2-184-73-102-95.compute-1.amazonaws.com:5558
>>    <http://ec2-184-73-102-95.compute-1.amazonaws.com:5558>")))
>>
>>    print(mean(unlist(ans)))
>>
>>    yields:
>>    warmstrong at krypton:~/dvl/zmq.test/test.ec2$ Rscript lapply.exmaple.r
>>       user  system elapsed
>>      0.010   0.010   7.007
>>    [1] 3.140964
>>
>>
>>    Anyway, I'll post up a better example tomorrow that actually uses more
>>    than one machine.
>>
>>    -Whit
>>
>>    _______________________________________________
>>    R-sig-hpc mailing list
>>    R-sig-hpc at r-project.org <mailto:R-sig-hpc at r-project.org>
>>    https://stat.ethz.ch/mailman/listinfo/r-sig-hpc
>>
>>
>>
>>
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>



More information about the R-sig-hpc mailing list