[R] Problem with memory consuming algorithm

Simon Zehnder szehnder at uni-bonn.de
Fri Sep 16 22:45:43 CEST 2011


Hi guyz,

I have serious problems with an algorithm I let run on a supercomputer:

You find the functions under the following URLs:

simuFunctionCaller: http://pastebin.com/6gw2fJFb

calls Function simuFunctionNBM (http://pastebin.com/QeJDUnqx) 

after reading a csv-file ordered like the following:

,name,theta,std_error_theta,theta_phi,std_error_theta_phi,phi,N,sigma_epsilon,sigma_eta
31,25%,0.003044,2.28E-09,0.00742575,4.71E-09,0.00452525,68164.75,0.008706072,0.00774016
32,50%,0.004536,3.22E-09,0.01045,7.94E-09,0.0052762,110150,0.012387386,0.011169953
33,75%,0.007356625,1.24E-08,0.014249075,3.16E-08,0.007518,178840.5,0.018471461,0.016058424

Reading and running without an exception is no problem. But the algorithm needs hours to run and seems to use more memory than available:

I have given a time limit of 48 h and a memory limit of 128 GB RAM on the supercomputer (it is a cluster, a BATCH System)…..nevertheless the computer shuts down the algorithm after a certain time because of memory problems. 

Does anyone of u guys see a problem in the algorithm? Especially with so much RAM and time available?

I am very thankful for your suggestions!

Simon


More information about the R-help mailing list