lazyarray: Persistent Large Data Array with Lazy-Loading on Demand

Multi-threaded serialization of compressed array that fully utilizes modern solid state drives. It allows to store and load extremely large data on demand within seconds without occupying too much memories. With data stored on hard drive, a lazy-array data can be loaded, shared across multiple R sessions. For arrays with partition mode on, multiple R sessions can write to a same array simultaneously along the last dimension (partition). The internal storage format is provided by 'fstcore' package geared by 'LZ4' and 'ZSTD' compressors.

Version: 1.1.0
Imports: Rcpp (≥ 1.0.4), R6, fstcore, yaml
LinkingTo: Rcpp, fstcore
Suggests: testthat, knitr, fst, rmarkdown, dipsaus (≥ 0.0.8)
Published: 2020-07-18
Author: Zhengjia Wang [aut, cre, cph], Mark Klik [ctb, cph] (Copyright holder of fstcore package)
Maintainer: Zhengjia Wang <dipterix.wang at gmail.com>
BugReports: https://github.com/dipterix/lazyarray/issues
License: AGPL-3
URL: https://github.com/dipterix/lazyarray
NeedsCompilation: yes
SystemRequirements: C++11 little-endian platform
Language: en-US
Materials: NEWS
CRAN checks: lazyarray results

Documentation:

Reference manual: lazyarray.pdf
Vignettes: A Basic Usage of 'LazyArray'

Downloads:

Package source: lazyarray_1.1.0.tar.gz
Windows binaries: r-devel: lazyarray_1.1.0.zip, r-release: lazyarray_1.1.0.zip, r-oldrel: lazyarray_1.1.0.zip
macOS binaries: r-release (arm64): lazyarray_1.1.0.tgz, r-oldrel (arm64): lazyarray_1.1.0.tgz, r-release (x86_64): lazyarray_1.1.0.tgz
Old sources: lazyarray archive

Linking:

Please use the canonical form https://CRAN.R-project.org/package=lazyarray to link to this page.