Vector binding on harddisk
On Thu, Feb 14, 2008 at 7:23 AM, Jeffrey Horner
<jeff.horner at vanderbilt.edu> wrote:
Paul Gilbert wrote on 02/14/2008 09:14 AM:
> _ wrote:
>> Hi all, >> Using big vectors (more than 4GB) is unfortunately not possible under >> Windows or other OS's if not enough RAM exists.
> > This is NOT true. It is not limited by RAM, but rather by RAM and swap > space. With 500G hard disks at about $100, the more serious limitation > is a 32bit OS. Speed is a different consideration, but I doubt that > taking over what the OS is suppose to do will be the real answer.
Umm... swap... yeah... My experience with any code that I write that needs to use swap is to reboot the machine and rewrite my code NOT to use swap.
...and the OS can never predict how you are going to access the data - as a developer you will always be able to write a much faster file-based "database" compared with a generic swap that you have little control over. /Henrik
Jeff
> > Paul >
>> Could it be possible to implement an a new data type in R, like a >> vector, but instead holding the information in memory, the data lies on >> an file. If data is accessed, the data type vector get the information >> automatically from the file. >> There is a package out there (named ff) but the accessed boundary have >> to be declared by the user this is a disadvantage. >> >> Greetings. >> >> ______________________________________________ >> R-devel at r-project.org mailing list >> https://stat.ethz.ch/mailman/listinfo/r-devel
> ====================================================================================
>
> La version fran?aise suit le texte anglais.
>
> ------------------------------------------------------------------------------------
>
> This email may contain privileged and/or confidential ...{{dropped:23}}
______________________________________________ R-devel at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-devel