strange issue of memory converting a raster to a data frame
You can try converting each layer to data frame instead of all the layers
at once time. You can do this using a loop.
r <- terra::rast(file.nc)
df<- NULL
for( i in 1:nlyr(r)){
r1 <- r[[i]]
r1.df <- as.data.frame(r1,xy =T)
df <- rbind(df, r1.df)
}
Best regards
Vlad Alexandru AMIHAESEI
On Mon, Jan 23, 2023 at 10:33 AM Sebastiano Trevisani <strevisani at iuav.it>
wrote:
Hi Lo?c, thank you for your suggestion! this was one of the possibilities I checked. However, I tried with terra.options() to change the memfrac parameter from 0.6 to 0.1, so as to force the writing on disc, but things didn't work. It seems like it is working as 32 bit system, but the R the installation seems right to 64. Probably I'm missing something very obvious. I will try to build a reproducible example without the need to upload all the file. Thanks again, Sebastiano * Sebastiano Trevisani, Ph.D.* * Associate Professor* *Applied and Environmental Geology* * https://orcid.org/0000-0001-8436-7798 <https://orcid.org/0000-0001-8436-7798>* *IUAV University of Venice: www.iuav.it <http://www.iuav.it/>* *Address: Dorsoduro 2206, Venice 30123, Italy Tel: +39. 041. 257 1299Mail: strevisani at iuav.it <strevisani at iuav.it> * *"Le opinioni espresse sono riferibili esclusivamente all'autore e non * * riflettono in alcun modo una posizione ufficiale dello IUAV "* *"The views expressed are purely those of the writer and may not in any circumstances be regarded as stating an official position of the IUAV."* On Mon, Jan 23, 2023 at 5:36 PM DUTRIEUX Loic <Loic.DUTRIEUX at ec.europa.eu> wrote:
Hi Sebastiano, Try comparing terra::terraOptions() and terra::mem_info(r) on both systems. Just guessing there but it could be that terra is trying to do everything in memory and failing on your 16GB system, while taking a
memory
friendly route on your 8GB system. Cheers, Lo?c
________________________________________ From: R-sig-Geo <r-sig-geo-bounces at r-project.org> on behalf of
Sebastiano
Trevisani <strevisani at iuav.it> Sent: 23 January 2023 12:30:14 To: r-sig-geo Subject: [R-sig-Geo] strange issue of memory converting a raster to a
data
frame Dear list members, In converting a raster as the one below to a data frame, I have an issue
of
memory allocation only when I use a specific pc, and in particular the
one
with more memory. To be more precise (using same version of R 4.2.2 and Terra terra 1.6.47, by means of as.data.frame() function): with a I5 processor with 8Gb of memory, windows 10 it works with a I7 processor with 16gb of memory, windows 11 it doesn't I'm not able to figure out a possible explanation! Any suggestions on what to check? SpatRaster dimensions : 5000, 5000, 18 (nrow, ncol, nlyr) resolution : 30, 30 (x, y) extent : -8526.878, 141473.1, 4110588, 4260588 (xmin, xmax, ymin, ymax) coord. ref. : WGS 84 / UTM zone 45N (EPSG:32645) source : multyMadRes2c.tif Sebastiano * Sebastiano Trevisani, Ph.D.* * Associate Professor* *Applied and Environmental Geology* *
<
*
*IUAV University of Venice:
<
*
*Address: Dorsoduro 2206, Venice 30123, Italy Tel: +39. 041. 257
1299Mail: strevisani at iuav.it <strevisani at iuav.it> *
*"Le opinioni espresse sono riferibili esclusivamente all'autore e non *
* riflettono in alcun modo una posizione ufficiale dello IUAV "*
*"The views expressed are purely those of the writer and may not in
any circumstances be regarded as stating an official position of the
IUAV."*
[[alternative HTML version deleted]]
_______________________________________________ R-sig-Geo mailing list R-sig-Geo at r-project.org
_______________________________________________ R-sig-Geo mailing list R-sig-Geo at r-project.org https://stat.ethz.ch/mailman/listinfo/r-sig-geo