[R] Optimization with Parallel Processing Functions/Packages

Doran, Harold HDor@n @ending from @ir@org
Wed Nov 7 19:24:33 CET 2018


More of a general query, but looking to see if others have successfully used something like the foreach package (or other parallel style functions) with certain functions that minimize likelihood or objective functions (e.g., optim/nlminb).

I have had great success with embarrassingly parallel problems and my R packages have benefited greatly. However, optimization doesn't fit as nicely within that context as the values at iteration t depend on the values found at iteration t-1 and such. So, I'm assuming the cost of splitting and combining might be more expensive in this context that simply doing minimization on a single core.

If others have experiences or even possibly R-specific resources that implement this that I would be able to study, I would appreciate seeing how this might be implemented.

Regards
Harold



More information about the R-help mailing list