Skip to content

Error in memory allocation

2 messages · Vito Ricci, Jason Barnhart

Original
Vito Ricci
# 
Dear UseRs,

I need a litle help. 
I'm trying to read a .dat file of about 71 MB using
read.fwf (as data recorded are in fixed width
formatted data). R starts in reading data, but after
some time, about 1/2 hour, I get this error:

Error in .signalSimpleWarning("Reached total
allocation of 510: see help(memory.size)"

memory.size()
529880586

R is running under windows:

sysname                       release 
"Windows"                      "NT 5.1" 
version                      nodename 
"(build 2600) Service Pack 2"  "PC-TULIP" 
machine                         login 
"x86"                   "Utente-01" 
user                   "Utente-01" 

Can anyone help me? I need to read those data!

Thanks in advance.

Regards.

Vito Ricci




Se non ora, quando?
Se non qui, dove?
Se non tu, chi?
Jason Barnhart
# 
My guess is memory is not the issue here.  It appears that you 500+MB of 
system memory and that should suffice for a 71MB dataset.  Additionally, a 
dataset of that size should load in much less time than 30 minutes.

You should read-up on the read.fwf options to ensure that the file is being 
read correctly.  Submitting your read.fwf code fragment and a fragment of 
the data file (like the top 10 lines) will help us diagnose the situation.

Also, if you reduce your data file to something like 10 lines, it's easier 
and quicker to iterate and trouble shoot the loading process.

----- Original Message ----- 
From: "Vito Ricci" <vito_ricci at yahoo.com>
To: <r-help at stat.math.ethz.ch>
Sent: Thursday, August 31, 2006 4:47 AM
Subject: [R] Error in memory allocation