[BioC] matrix transformation

Ido M. Tamir tamir at imp.ac.at
Mon Oct 18 12:50:02 CEST 2010


> Dear Mailing List,
> 
> I wrote the following function "matrix2tuple.sf" to translate a "cartesian
> xy matrix" as a "tuple matrix", to store it in relational database. The
> code works fine for a test set. My problem is, my real matrix is 7000 x
> 10000 big, which ends up in 70'000'0000' tuples. Transformation takes days
> X(...
> Has anyone an idea, how I can optimize the described functions for speed?
> 
> Best Wishes, Elmar Bucher

I didnt look at the R code, but the inserts could be sped up if you would
do it in batches and not individual inserts.

Something like:
AUTOCOMMIT OFF
100 x insert..
COMMIT

Maybe do a cheap profiling by just commenting out the db code to see
if the db is slowing it down.

best,
ido



More information about the Bioconductor mailing list