[R-SIG-Finance] High performance computing with R

Markus Schmidberger schmidbe at in.tum.de
Mon Jun 27 14:22:13 CEST 2011

Yes, there are some problems with Rstudio and multicore or computer
cluster systems. I hope they will fix that in one of the next releases!

If there is no computer cluster available you should try
cloudnumbers.com. You will get access to a computer cluster in the cloud
in less than 10 minutes. Everything is pre-configured, including R, all
R packages and parallel computing technologies. Actually the beta phase
is running. You will get free resources!


Date: Sun, 26 Jun 2011 21:39:38 -0400
From: Zachary Mayer <zach.mayer at gmail.com>
To: r-sig-finance at r-project.org
Subject: Re: [R-SIG-Finance] High performance computing with R
Message-ID: <BANLkTi=Az-bXKujR=_wawz0sy2U3Nzo4qA at mail.gmail.com>
Content-Type: text/plain; charset=windows-1252


I'm not 100% sure how to respond to an individual message from the
daily digest, so I apologize if I am violating protocol here.

Ben-- I suggest you do a little research into the foreach package for
R, as well as the various foreach backends, which include doMC, doSMP,
doSnow, doMPI and doRedis. foreach is a generalized framework to
parallelize for loops in r. The various backends enable that
parallelism using different technologies: doMC uses the "fork" command
on linux, doSnow uses a "Snow" cluster, and doRedis uses a redis
server.  Each backend has various pros and cons. As stated before,
doMC (and it's sister package multicore) are probably the best
solution for a single machine: you can use the function 'mclapply' to
replace the vanilla function 'lapply' and have instant parallelism
with almost no extra work, but neither package works on windows or
with Rstudio.   doRedis is my current favorite solution for clusters
of multiple machines on amazon EC2, but it takes a small amount of
extra work to setup a redis server.

The answer to your question really depends on your operating system,
how many machines you have, and what technologies you are comfortable
with.  Do a some research before you commit to hardware, and re-write
your code to make use of the 'foreach' looping structure.

Good luck!

Dr. rer. nat. Markus Schmidberger 
Senior Community Manager 

Cloudnumbers.com GmbH
Chausseestraße 6
10119 Berlin 

E-Mail: markus.schmidberger at cloudnumbers.com 

Amtsgericht München, HRB 191138 
Geschäftsführer: Erik Muttersbach, Markus Fensterer, Moritz v. 

Diese Nachricht kann vertrauliche Informationen enthalten. Sollten Sie 
nicht der vorgesehene Empfänger sein, so bitten wir um eine kurze 
Nachricht. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist 
unzulässig. Da wir nicht die Echtheit oder  Vollständigkeit der in 
dieser Nachricht enthaltenen Informationen garantieren können, 
schließen wir die rechtliche Verbindlichkeit der vorstehenden 
Erklärungen und Äußerungen aus. 
This message may contain confidential information. If yo...{{dropped:6}}

More information about the R-SIG-Finance mailing list