Raw Message

Message-ID: <gu4apd$en0$1@ger.gmane.org>
Date: 2009-05-09T16:25:15Z
From: Rob Steele
Subject: Reading large files quickly

I'm finding that readLines() and read.fwf() take nearly two hours to
work through a 3.5 GB file, even when reading in large (100 MB) chunks.
 The unix command wc by contrast processes the same file in three
minutes.  Is there a faster way to read files in R?

Thanks!