[R-SIG-Finance] parallel processing
Gambulator Gambulator
gambulator at gmail.com
Wed Oct 28 18:10:37 CET 2015
I used the AMI image and kickoff the parallel processing. It works well.
Thanks everyone for your help
On Tue, Oct 27, 2015 at 7:28 AM, Gambulator Gambulator <gambulator at gmail.com
> wrote:
> thanks. I was trying this last night and I think R just released 3.2.2 and
> nothing seems to be compatible with it... I gave up last night.... but now
> that you showed me this post, I am going to try it again.
>
> thanks
>
> On Tue, Oct 27, 2015 at 5:26 AM, Erol Biceroglu <
> erol.biceroglu at alumni.utoronto.ca> wrote:
>
>> FYI, this gentleman has setup R studio AWS images for everyone to use.
>> So there's no "pain" to set it up:
>>
>> http://www.louisaslett.com/RStudio_AMI/
>>
>>
>>
>> On Monday, October 26, 2015, Gambulator Gambulator <gambulator at gmail.com>
>> wrote:
>>
>>> I tried to use the parallel core again and I get this error message. Note
>>> that the non-parallel version works fine for me and I am using the
>>> optimization feature.
>>>
>>>
>>> This is how I call the parallel version:
>>>
>>> if( Sys.info()['sysname'] == "Windows" )
>>> {
>>> library(doParallel)
>>> cl=makeCluster(detectCores())
>>> registerDoParallel(cl)
>>> #registerDoSEQ()
>>> } else {
>>> library(doMC)
>>>
>>> registerDoMC(cores=detectCores())
>>> }
>>>
>>> This is how I call the serial version:
>>>
>>> if( Sys.info()['sysname'] == "Windows" )
>>> {
>>> library(doParallel)
>>>
>>> registerDoSEQ()
>>> } else {
>>> library(doMC)
>>>
>>> registerDoMC(cores=detectCores())
>>> }
>>>
>>> ****************************error message for parallel below:
>>>
>>> error calling combine function:
>>> <simpleError in fun(result.1, result.2, result.3, result.4, result.5,
>>> result.6, result.7, result.8, result.9, result.10, result.11,
>>> result.12, result.13, result.14, result.15, result.16, result.17,
>>> result.18, result.19, result.20, result.21, result.22, result.23,
>>> result.24, result.25, result.26, result.27, result.28, result.29,
>>> result.30, result.31, result.32, result.33, result.34, result.35,
>>> result.36, result.37, result.38, result.39, result.40, result.41,
>>> result.42, result.43, result.44, result.45, result.46, result.47,
>>> result.48, result.49, result.50, result.51, result.52, result.53,
>>> result.54, result.55, result.56, result.57, result.58, result.59,
>>> result.60, result.61, result.62, result.63, result.64, result.65,
>>> result.66, result.67, result.68, result.69, result.70, result.71,
>>> result.72, result.73, result.74, result.75, result.76, result.77,
>>> result.78, result.79, result.80, result.81, result.82, result.83,
>>> result.84, result.85, result.86, result.87, result.88, result.89,
>>> result.90, result.91, result.92, result.93, result.94, result.95,
>>> result.96, result.97, result.98, result.99, result.100, result.101,
>>> result.102, result.103, result.104, result.105, result.106,
>>> result.107,
>>> result.108, result.109, result.110, result.111, result.112,
>>> result.113,
>>> result.114, result.115, result.116, result.117, result.118,
>>> result.119,
>>> result.120, result.121, result.122, result.123, result.124,
>>> result.125,
>>> result.126, result.127, result.128, result.129, result.130,
>>> result.131,
>>> result.132, result.133, result.134, result.135, result.136,
>>> result.137, result.138, result.139, result.140, result.141,
>>> result.142,
>>> result.143, result.144, result.145, result.146, result.147,
>>> result.148,
>>> result.149, result.150, result.151, result.152, result.153,
>>> result.154,
>>> result.155, result.156, result.157, result.158, result.159,
>>> result.160,
>>> result.161, result.162, result.163, result.164, result.165,
>>> result.166,
>>> result.167, result.168, result.169, result.170, result.171,
>>> result.172, result.173, result.174, result.175, result.176,
>>> result.177,
>>> result.178, result.179, result.180, result.181, result.182,
>>> result.183,
>>> result.184, result.185, result.186, result.187, result.188,
>>> result.189,
>>> result.190, result.191, result.192, result.193, result.194,
>>> result.195,
>>> result.196, result.197, result.198, result.199, result.200,
>>> result.201,
>>> result.202, result.203, result.204, result.205, result.206,
>>> result.207, result.208, result.209, result.210, result.211,
>>> result.212,
>>> result.213, result.214, result.215, result.216, result.217,
>>> result.218,
>>> result.219, result.220, result.221, result.222, result.223,
>>> result.224,
>>> result.225, result.226, result.227, result.228, result.229,
>>> result.230,
>>> result.231, result.232, result.233, result.234, result.235,
>>> result.236,
>>> result.237, result.238, result.239, result.240, result.241,
>>> result.242, result.243, result.244, result.245, result.246,
>>> result.247,
>>> result.248, result.249, result.250, result.251, result.252,
>>> result.253,
>>> result.254, result.255, result.256, result.257, result.258,
>>> result.259,
>>> result.260, result.261, result.262, result.263, result.264,
>>> result.265,
>>> result.266, result.267, result.268, result.269, result.270,
>>> result.271,
>>> result.272, result.273, result.274, result.275, result.276,
>>> result.277, result.278, result.279, result.280, result.281,
>>> result.282,
>>> result.283, result.284, result.285, result.286, result.287,
>>> result.288): attempt to select less than one element>
>>> >
>>>
>>> On Mon, Oct 26, 2015 at 3:31 PM, Gambulator Gambulator <
>>> gambulator at gmail.com
>>> > wrote:
>>>
>>> > thanks. I am running the optimization and yeah it is pretty slow so I
>>> > figure that I should put it on more cores. It seems/sounds like it 'd
>>> work
>>> > fine on Linux but now that you mention Windows, may be I will give it a
>>> > shot before firing up AWS and go through the pain to make an image and
>>> all
>>> > that.
>>> >
>>> > thx
>>> >
>>> > On Mon, Oct 26, 2015 at 11:28 AM, Bos, Roger <roger.bos at rothschild.com
>>> >
>>> > wrote:
>>> >
>>> >> Not all of the parallel packages with in Windows, but doParallel is
>>> one
>>> >> that does. Here is how to start it with 3 cores:
>>> >>
>>> >> library(doParallel)
>>> >> cl <- makeCluster(3)
>>> >> registerDoParallel(cl)
>>> >>
>>> >> It will automatically load the foreach package provided you have it
>>> >> installed. Please see the documentation for foreach for examples.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Roger
>>> >>
>>> >>
>>> >>
>>> >> ***************************************************************
>>> >> This message and any attachments are for the intended recipient's use
>>> >> only.
>>> >> This message may contain confidential, proprietary or legally
>>> privileged
>>> >> information. No right to confidential or privileged treatment
>>> >> of this message is waived or lost by an error in transmission.
>>> >> If you have received this message in error, please immediately
>>> >> notify the sender by e-mail, delete the message, any attachments and
>>> all
>>> >> copies from your system and destroy any hard copies. You must
>>> >> not, directly or indirectly, use, disclose, distribute,
>>> >> print or copy any part of this message or any attachments if you are
>>> not
>>> >> the intended recipient.
>>> >>
>>> >>
>>> >> -----Original Message-----
>>> >> From: R-SIG-Finance [mailto:r-sig-finance-bounces at r-project.org] On
>>> >> Behalf Of Gambulator Gambulator
>>> >> Sent: Monday, October 26, 2015 2:21 PM
>>> >> To: r-sig-finance at r-project.org
>>> >> Subject: [R-SIG-Finance] parallel processing
>>> >>
>>> >> I did quite a bit of googling. it is not clear to me if it works now
>>> on
>>> >> Windows or not. it is pretty slow even if I have turned off my
>>> >> debug,verbose or print. any idea?
>>> >>
>>> >> [[alternative HTML version deleted]]
>>> >>
>>> >> _______________________________________________
>>> >> R-SIG-Finance at r-project.org mailing list
>>> >> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>>> >> -- Subscriber-posting only. If you want to post, subscribe first.
>>> >> -- Also note that this is not the r-help list where general R
>>> questions
>>> >> should go.
>>> >>
>>> >
>>> >
>>>
>>> [[alternative HTML version deleted]]
>>>
>>> _______________________________________________
>>> R-SIG-Finance at r-project.org mailing list
>>> https://stat.ethz.ch/mailman/listinfo/r-sig-finance
>>> -- Subscriber-posting only. If you want to post, subscribe first.
>>> -- Also note that this is not the r-help list where general R questions
>>> should go.
>>>
>>
>>
>> --
>>
>> Erol Biceroglu
>>
>>
>> *erol.biceroglu at alumni.utoronto.ca
>> <erol.biceroglu at alumni.utoronto.ca>416-275-7970 <416-275-7970>*
>>
>
>
[[alternative HTML version deleted]]
More information about the R-SIG-Finance
mailing list