Hi
 
I rbind data frames in a loop in a cumulative way and the performance
detriorates very quickly. 
 
My code looks like this:
 
for( k in 1:N)
{
    filename <- paste("/tmp/myData_",as.character(k),".txt",sep="")
    myDataTmp <- read.table(filename,header=TRUE,sep=",")
    if( k == 1) {
        myData <- myDataTmp
    }
    else{
        myData <- rbind(myData,myDataTmp)
    }  
}
 
Some more details:
- the size of the stored text files is about 100,000 rows and 50 columns
each
- for k=1: rbind takes 0.0004 seconds
- for k=2: rbind takes 13 seconds
- for k=3: rbind takes 30 seconds
- for k=4: rbind takes 36 seconds
etc
 
Any suggestions to improve speed?
 
Thanks
 
Zava
--------------------------------------------------------

This is not an offer (or solicitation of an offer) to buy/se...{{dropped}}

