[R] my RMySQL connections are so SLOW
laurent.faisnel at ariase.com
Mon May 5 11:55:48 CEST 2003
Thank you for your fast answer. I work on a 450MHz Pentium II with 192
dbListTables() takes about 3 seconds. For direct use it's OK, but when
requests become included in programs, it makes very slow programs !
I had to calculate an average score for each value of a column (i=1:12)
to fill an array, and so the operation (pretty simple) took more than 30
seconds (almost 3 seconds per "select avg(score)..." request).
I don't think my dataset is huge enough to make it worth using ODBC,
which would cause other problems. I do not start R for each query. I
have the same slowness when sending the requests to R directly (without
using source code).
What makes me hope for a solution is when you say "For me running a
query is instant". What could be the difference between our systems ?
The CPU speed does not explain all, in my opinion.
system i686, linux-gnu
Prof Brian Ripley wrote:
>What exactly are you timing? For me running a query is instant.
>Are you starting R for each query, for example? What OS and what hardware
>are you using?
>People have reported that RODBC is a lot faster than RMySQL for some tasks
>involving large datasets.
>On Mon, 5 May 2003, Laurent Faisnel wrote:
>>I'm using the latest RMySQL to send requests to a MySQL database (which
>>is quite small for the time - let's say 20 tables with a total of 1000
>>rows), and this should be part of a whole decisionnal system. It
>>produces results which are displayed on a website, and therefore I need
>>fast results (the database being quite small, I think this must be
>>Unfortunately, a simple request to the database, and R needs more than
>>10 seconds. Even dbListTables() takes a long while. Imagine the problem
>>with more data ! Can I hope something better with RMySQL ? Did anyone
>>have the same problem ?
>>If RMySQL (or is it MySQL's fault ?) is so slow, I could replace MySQL
>>with Postgres, but this would imply a lot of extra work. R is perhaps
>>very slow anyway ? Any piece of advice ?
More information about the R-help