[R-sig-DB] RSQLite and transparent compression

[Kasper Daniel Hansen]

What do you mean by large?  You are aware you can have an in-memory version
of a SQLite database (whether that helps depends on the size of course)?
 If you operate on a disk based database, fast I/O helps a lot, perhaps
even copying the database to a local drive. I don't know anything about
compression though, but in general I have found the sqlite.org website and
its mailing list to be super helpful.

Kasper


On Mon, Aug 5, 2013 at 8:23 PM, Grant Farnsworth <gvfarns using gmail.com> wrote:

> I frequently create, write to, and read from large SQLite databases
> from within R using RSQLite, sometimes across the network.  As
> size/performance can be a consideration for me, I find myself wishing
> I could compress my sqlite database files and interact with them
> directly, the way one can interact with a gzipped text file using
> read.table() or scan().  In case anyone wasn't aware, you can read
> from a gzipped  text file without any additional arguments
>
> G <- read.table("myfile.txt.gz")
>
> and so forth.
>
> The syntax doesn't have to be that simple, but does anyone know of a
> workaround to allow me to read from an SQLite database that has been
> compressed?   Or if you have a different solution/workaround, I would
> love to hear it.  Thanks!
>
> _______________________________________________
> R-sig-DB mailing list -- R Special Interest Group
> R-sig-DB using r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-db
>

	[[alternative HTML version deleted]]