[Rd] Reducing RAM usage using UKSM
srinathsmn at gmail.com
Wed Jul 16 18:18:05 CEST 2014
> Linux uses a copy-on-write for the memory image of forked processes. Thus, you may also get significant memory savings by launching a single R process, loading your large data object, and then using fork::fork() to split off the other worker process.
True. The problem is each and every instance has its own dataset (but
they are only similar). For example, QA environment might have about
90% of the rows similar to Showcase environment. Hence we need to have
multiple instances instantiated with its own nearly similar dataset.
This in turn makes it necessary to have some kind of de-duplication
running on the entire memory image.
More information about the R-devel