Help with R
On Thu, 5 May 2005, Christoph Lehmann wrote:
I heard that 'R' does not do a very good job at handling large datasets, is this true?
importing huge datasets in a data.frame with e.g. a subsequent step of conversion of some columns into factors may lead into memory troubles (probably due to memory overhead when building out factors). But we currently
Note that R's scan() does this very much more efficiently. It is not fair to R to generalize from the method of a contributed package.
succeeded in importing 12 millions of data records stored in a MySQL database, using RMySQL package.
Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UK Fax: +44 1865 272595