[R-sig-DB] RSQLite RAM use never exceeding ~1900 mb in Windows even with high cache_size?

[Nick Eubank]

Great! I can answer my own question (based on exchanges on SQLite listserv):

The 32 bit SQLite build on windows cannot allocate more than ~1900 mb to a
single process due to a limitation in the variable types used to store
memory addresses in 32 bit windows. The problem is fixed in 64 bit builds.


On Sun, Jun 29, 2014 at 10:19 PM, Nick Eubank <nickeubank using gmail.com> wrote:

> Hi All,
>
> I've been playing with RSQLite for a week or so, and am finding even when
> I up the PRAGMA cache_size to 8000, R memory limits set to 12gb, and really
> large datasets (30 gb), my ram use never exceeds ~1900mb in Windows 8.
>
> This seems quite problematic -- any thoughts? I know that 32 bit windows
> didn't allow per-thread memory allocations to exceed about this amount due
> to address storage types -- is RSQLite built on 32 bit SQLite even for 64
> bit R (I just ran install.packages("sqldf", dep=T) to install RSQLite.
>
> Thanks!
>
> NIck
>

	[[alternative HTML version deleted]]