[R] lpSolve space problem in R 2.4.1 on Windows XP
topkatz at msn.com
Fri Mar 9 17:20:42 CET 2007
I am trying to use the linear optimizer from package lpSolve in R 2.4.1 on
Windows XP (Version 5.1). The problem I am trying to solve has 2843
variables (2841 integer, 2 continuous) and 8524 constraints, and I have 2 Gb
of memory. After I load the input data into R, I have at most 1.5 Gb of
memory available. If I start the lp with significantly less memory
available (say 1 Gb), I get an error message from R:
"Error: cannot allocate vector of size 189459 Kb"
If I close all my other windows and try to maximize the available memory to
the full 1.5 Gb, I can watch the memory get filled up until only about 400
Mb is left, at which point I get a Windows error message:
"R for Windows GUI front-end has encountered a problem and needs to close.
We are sorry for the inconvenience."
This behavior persists even when I relax the integer constraints, and
eliminate the 2841 constraints that restrict the integer variables to values
<= 1, so I'm just running a standard lp with 2843 variables and 5683
I have been able to get the full MIP formulation to work correctly on some
very small problems (~10 variables and 25 constraints).
Here is the code for a working example:
 8 7 6 5 4 3 2 1
 8 15 21 26 30 33 35 36
 0.6666667 1.2500000 1.7500000 2.1666667 2.5000000 2.7500000 2.9166667
 0.0000000 0.9166667 0.0000000 1.0000000 0.0000000 1.0000000 0.0000000
 0.0000000 0.0000000
What this is doing is taking the points of v1 and dividing them into
contiguous groups (the variable ngp is the number of groups) such that the
sums of the v1 values are as close as possible to equal within the three
groups. So, for v1 = c(8,7,6,5,4,3,2,1), the groups c(8,7), c(6,5),
c(4,3,2,1), with sums 15,11,10 is the best such split, and the solution
vector shows that the splitting occurs after the second and fourth elements.
Anyway, I am wondering... Are 3000 variables and 8500 constraints usually
too much for lpSolve to handle in 1.5 Gb of memory? Is there a possible bug
(in R or in Windows) that leads to the Windows error when the memory falls
below 400 Mb? Is there a problem with my formulation that makes it unstable
even after the integer constraints are removed?
-- TMK --
More information about the R-help