An embedded and charset-unspecified text was scrubbed... Name: not available URL: <https://stat.ethz.ch/pipermail/r-help/attachments/20110518/c644feb5/attachment.pl>
Help, please
4 messages · Julio César Flores Castro, Brian Ripley, David Winsemius +1 more
On Wed, 18 May 2011, Julio C?sar Flores Castro wrote:
Hi, I am using R 2.10.1 and I have a doubt. Do you know how many cases can R handle?
At least millions.
I want to use the library npmc but if I have more than 4,500 cases I get an error message. If I use less than 4500 cases I don?t have problems with this library.
So you are not asking about R but about a contributed package. Clearly you have not read the posting guide (you sent HTML), so please do so and follow its advice. That amounts to preparing a documented and reproducible example and sending it to the package maintainer in a properly signed email which makes clear your affiliation (which appears to be a company).
Is there any way to increase the number of cases in order to use this library. Thanks in advance Julio Flores [[alternative HTML version deleted]]
Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UK Fax: +44 1865 272595
On May 18, 2011, at 6:29 PM, Julio C?sar Flores Castro wrote:
Hi, I am using R 2.10.1 and I have a doubt. Do you know how many cases can R handle?
I was able to handle (meaning do Cox proportional hazards work with the 'rms' package which adds extra memory overhead with a datadist object) a 5.5 million rows by 100 columns dataframe without difficulty using 24 GB on a Mac (BSD UNIX kernel). I was running into performance slow downs related to paging out to virtual memory at 150 columns, but after expanding to 32 GB can now handle 5.5 MM records with 200 columns without paging.
I want to use the library npmc but if I have more than 4,500 cases I get an error message. If I use less than 4500 cases I don?t have problems with this library. Is there any way to increase the number of cases in order to use this library.
64 bit OS, 64 bit R, and more memory.
David Winsemius, MD West Hartford, CT
----------------------------------------
From: dwinsemius at comcast.net To: julio.flores at spss.com.mx Date: Thu, 19 May 2011 10:40:08 -0400 CC: r-help at r-project.org Subject: Re: [R] Help, please On May 18, 2011, at 6:29 PM, Julio C?sar Flores Castro wrote:
Hi, I am using R 2.10.1 and I have a doubt. Do you know how many cases can R handle?
I was able to handle (meaning do Cox proportional hazards work with the 'rms' package which adds extra memory overhead with a datadist object) a 5.5 million rows by 100 columns dataframe without difficulty using 24 GB on a Mac (BSD UNIX kernel). I was running into performance slow downs related to paging out to virtual memory at 150 columns, but after expanding to 32 GB can now handle 5.5 MM records with 200 columns without paging.
I want to use the library npmc but if I have more than 4,500 cases I get an error message. If I use less than 4500 cases I don?t have problems with this library. Is there any way to increase the number of cases in order to use this library.
64 bit OS, 64 bit R, and more memory.
The longer term solution is implementation and algorithm designed to increase coherence of memory accesses ( firefox is doing this to me now dropping every few chars and ?getting many behind as it thrashes with memory leak, LOL).