Skip to content

Problem to read file with filehash

2 messages · Rock Ouimet, Seth Falcon

Original
Rock Ouimet
# 
Dear R users,

I try to use a very large file (~3 Gib) with the *filehash* package. The
length of the dataset is around 4,000,000 obs. I get this message from R
while trying to "load" the dataset (named "cc084.csv"):

I launched the following codes:
library(*filehash*)
dumpDF(read.csv("cc084.csv", header=T), dbName="db01")
mydb <- db2env("db01")

R replied:
Erreur : impossible d'allouer un vecteur de taille 15.6 Mo (French)
Error: impossible to allow a vector of size 15.6 Meg (my English
translation)

There must be something I'm doing wrong...  I would appreciate any help.
Thank you.
My R version is 2.8.1.

Rock
Seth Falcon
# 
Hi Rock,

I'm not sure why you are sending this message to R-sig-DB.
* On 2009-05-23 at 09:30 -0400 Rock Ouimet wrote:
Perhaps you simply do not have enough memory available to accomplish
this task?  You have not provided much information about your
installation.  sessionInfo() output is always helpful.

+ seth