[R-sig-Geo] strange issue of memory converting a raster to a data frame

[Vlad Amihaesei]

You can try converting each layer to data frame instead of all the layers
at once time. You can do this using a loop.

r <- terra::rast(file.nc)

df<- NULL

for( i in 1:nlyr(r)){
r1 <-  r[[i]]
r1.df <- as.data.frame(r1,xy =T)
df <- rbind(df, r1.df)
}

Best  regards

Vlad Alexandru AMIHAESEI


On Mon, Jan 23, 2023 at 10:33 AM Sebastiano Trevisani <strevisani using iuav.it>
wrote:

> Hi  Loïc,
>
> thank you for your suggestion! this was one of the possibilities I checked.
> However, I tried with terra.options() to change the memfrac parameter from
> 0.6 to 0.1, so as to force the writing on disc, but things didn't work.
> It seems like it is working as 32 bit system, but the R the installation
> seems right to 64. Probably I'm missing something very obvious.
> I will try to build a reproducible example without the need to upload all
> the file.
>
> Thanks again,
>
> Sebastiano
>
> *      Sebastiano Trevisani, Ph.D.*
> *            Associate Professor*
> *Applied and Environmental Geology*
>
>
> *  https://orcid.org/0000-0001-8436-7798
> <https://orcid.org/0000-0001-8436-7798>*
> *IUAV University of Venice: www.iuav.it <http://www.iuav.it/>*
>
> *Address: Dorsoduro 2206,  Venice 30123, Italy Tel:    +39. 041. 257
> 1299Mail:    strevisani using iuav.it <strevisani using iuav.it> *
> *"Le opinioni espresse sono riferibili esclusivamente all'autore e non *
> * riflettono in alcun modo una posizione ufficiale dello IUAV "*
> *"The views expressed are purely those of the writer and may not in
> any circumstances be regarded as stating an official position of the
> IUAV."*
>
>
> On Mon, Jan 23, 2023 at 5:36 PM DUTRIEUX Loic <Loic.DUTRIEUX using ec.europa.eu>
> wrote:
>
> > Hi Sebastiano,
> >
> > Try comparing terra::terraOptions() and terra::mem_info(r) on both
> > systems. Just guessing there but it could be that terra is trying to do
> > everything in memory and failing on your 16GB system, while taking a
> memory
> > friendly route on your 8GB system.
> >
> > Cheers,
> > Loïc
> > ________________________________________
> > From: R-sig-Geo <r-sig-geo-bounces using r-project.org> on behalf of
> Sebastiano
> > Trevisani <strevisani using iuav.it>
> > Sent: 23 January 2023 12:30:14
> > To: r-sig-geo
> > Subject: [R-sig-Geo] strange issue of memory converting a raster to a
> data
> > frame
> >
> > Dear list members,
> >
> > In converting a raster as the one below to a data frame, I have an issue
> of
> > memory allocation only when I use a specific pc, and in particular the
> one
> > with more memory. To be more precise (using same version of R 4.2.2 and
> > Terra terra 1.6.47, by means of as.data.frame() function):
> >
> > with a I5 processor with 8Gb of memory, windows 10 it works
> >
> > with a I7 processor with 16gb of memory, windows 11 it doesn't
> >
> > I'm not able to figure out a possible explanation!
> > Any suggestions on what to check?
> >
> >
> > SpatRaster
> > dimensions  : 5000, 5000, 18  (nrow, ncol, nlyr)
> > resolution  : 30, 30  (x, y)
> > extent      : -8526.878, 141473.1, 4110588, 4260588  (xmin, xmax, ymin,
> > ymax)
> > coord. ref. : WGS 84 / UTM zone 45N (EPSG:32645)
> > source      : multyMadRes2c.tif
> >
> >
> >
> > Sebastiano
> >
> > *      Sebastiano Trevisani, Ph.D.*
> > *            Associate Professor*
> > *Applied and Environmental Geology*
> >
> >
> > *
> >
> https://urldefense.com/v3/__https://orcid.org/0000-0001-8436-7798__;!!DOxrgLBm!H86VAGwO3fNqAu4LS2hmv13aheZ9hGMiMmD7ZTN2sVxV-iuyV04Q_dV_lK5KNQauD3mFclNlC8a2LSlyZehq9YxpzJmj$
> > <
> >
> https://urldefense.com/v3/__https://orcid.org/0000-0001-8436-7798__;!!DOxrgLBm!H86VAGwO3fNqAu4LS2hmv13aheZ9hGMiMmD7ZTN2sVxV-iuyV04Q_dV_lK5KNQauD3mFclNlC8a2LSlyZehq9YxpzJmj$
> > >*
> > *IUAV University of Venice:
> >
> https://urldefense.com/v3/__http://www.iuav.it__;!!DOxrgLBm!H86VAGwO3fNqAu4LS2hmv13aheZ9hGMiMmD7ZTN2sVxV-iuyV04Q_dV_lK5KNQauD3mFclNlC8a2LSlyZehq9ag_1m0F$
> > <
> >
> https://urldefense.com/v3/__http://www.iuav.it/__;!!DOxrgLBm!H86VAGwO3fNqAu4LS2hmv13aheZ9hGMiMmD7ZTN2sVxV-iuyV04Q_dV_lK5KNQauD3mFclNlC8a2LSlyZehq9cV-rY9s$
> > >*
> >
> > *Address: Dorsoduro 2206,  Venice 30123, Italy Tel:    +39. 041. 257
> > 1299Mail:    strevisani using iuav.it <strevisani using iuav.it> *
> > *"Le opinioni espresse sono riferibili esclusivamente all'autore e non *
> > * riflettono in alcun modo una posizione ufficiale dello IUAV "*
> > *"The views expressed are purely those of the writer and may not in
> > any circumstances be regarded as stating an official position of the
> > IUAV."*
> >
> >         [[alternative HTML version deleted]]
> >
> > _______________________________________________
> > R-sig-Geo mailing list
> > R-sig-Geo using r-project.org
> >
> >
> https://urldefense.com/v3/__https://stat.ethz.ch/mailman/listinfo/r-sig-geo__;!!DOxrgLBm!H86VAGwO3fNqAu4LS2hmv13aheZ9hGMiMmD7ZTN2sVxV-iuyV04Q_dV_lK5KNQauD3mFclNlC8a2LSlyZehq9ScsuXEI$
> >
>
>         [[alternative HTML version deleted]]
>
> _______________________________________________
> R-sig-Geo mailing list
> R-sig-Geo using r-project.org
> https://stat.ethz.ch/mailman/listinfo/r-sig-geo
>

	[[alternative HTML version deleted]]