[R-sig-DB] RSQLite and transparent compression
Kasper Daniel Hansen
k@@perd@n|e|h@n@en @end|ng |rom gm@||@com
Tue Aug 6 06:02:02 CEST 2013
What do you mean by large? You are aware you can have an in-memory version
of a SQLite database (whether that helps depends on the size of course)?
If you operate on a disk based database, fast I/O helps a lot, perhaps
even copying the database to a local drive. I don't know anything about
compression though, but in general I have found the sqlite.org website and
its mailing list to be super helpful.
Kasper
On Mon, Aug 5, 2013 at 8:23 PM, Grant Farnsworth <gvfarns using gmail.com> wrote:
> I frequently create, write to, and read from large SQLite databases
> from within R using RSQLite, sometimes across the network. As
> size/performance can be a consideration for me, I find myself wishing
> I could compress my sqlite database files and interact with them
> directly, the way one can interact with a gzipped text file using
> read.table() or scan(). In case anyone wasn't aware, you can read
> from a gzipped text file without any additional arguments
>
> G <- read.table("myfile.txt.gz")
>
> and so forth.
>
> The syntax doesn't have to be that simple, but does anyone know of a
> workaround to allow me to read from an SQLite database that has been
> compressed? Or if you have a different solution/workaround, I would
> love to hear it. Thanks!
>
> _______________________________________________
> R-sig-DB mailing list -- R Special Interest Group
> R-sig-DB using r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-db
>
[[alternative HTML version deleted]]
More information about the R-sig-DB
mailing list