[Rd] Suggestion for serialization performance improvement on Windows
Bryan W. Lewis
bwaynelewis at gmail.com
Fri Jul 9 06:49:29 CEST 2010
Dear R developers,
The slow performance of serializing to a raw vector on Windows is an
issue that has appeared in this list before. It appears to be due to
the frequent use of realloc from the resize_buffer method in
serialize.c.
I suggest a more granular, but still incremental, re-allocation of
memory. For example change near the top of resize_buffer to:
R_size_t newsize = needed + 65536 - (needed % 65536);
or some other similar small multiple of a typical system page size.
I have found this to dramatically improve performance of serialization
to raw vectors on Windows.
Best,
Bryan
More information about the R-devel
mailing list