Message-ID: <CAP01uRngCLe-gfCFZV_EKRY3v8yQA2grRr3UdkCo1V792c05FQ@mail.gmail.com>
Date: 2012-02-03T15:40:48Z
From: Gabor Grothendieck
Subject: sqldf for Very Large Tab Delimited Files
In-Reply-To: <1328274485727-4354556.post@n4.nabble.com>
On Fri, Feb 3, 2012 at 8:08 AM, HC <hcatbr at yahoo.co.in> wrote:
> This is a 160 GB tab-separated .txt file. It has 9 columns and 3.25x10^9
> rows.
>
> Can R handle it?
>
You can process a file N lines at time like this:
con <- file("myfile.dat", "r")
while(length(Lines <- readLines(con, n = N)) > 0) {
... whatever...
}
--
Statistics & Software Consulting
GKX Group, GKX Associates Inc.
tel: 1-877-GKX-GROUP
email: ggrothendieck at gmail.com