Skip to content
Back to formatted view

Raw Message

Message-ID: <alpine.LRH.2.01.1001190805260.13781@hymn11.u.washington.edu>
Date: 2010-01-19T16:05:26Z
From: Thomas Lumley
Subject: Server hanging despite efforts to correct memory limits
In-Reply-To: <10dd42481001190658h31096379m24fec3e71beedfc0@mail.gmail.com>

You should be able to set limits on memory use for a process in the operating system, eg with limits or ulimits under Unix-alike shells.

      -thomas

On Tue, 19 Jan 2010, Nathan Stephens wrote:

> My group is working with datasets between 100 Mb and 1 GB in size, using
> multiple log ins.  From the documentation, it appears that vsize is limited
> to 2^30-1, which tends to prove too restrictive for our use.  When we drop
> that restriction (set vsize = NA) we end up hanging the server, which
> requires a restart.  Is there any way to increase the memory limits on R
> while keeping our jobs from hanging?  Having to restart the server is a
> major inconvenience, second only to memory limitations in R.
>
>> mem.limits()
>    nsize     vsize
> 100000000        NA
>
>> mem.limits(vsize=2^30)
>     nsize      vsize
> 100000000 1073741824
>
>> mem.limits(vsize=2^31)
>     nsize      vsize
> 100000000 1073741824
> Warning message:
> In structure(.Internal(mem.
> limits(as.integer(nsize), as.integer(vsize))),  :
>  NAs introduced by coercion
>
> 	[[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>

Thomas Lumley			Assoc. Professor, Biostatistics
tlumley at u.washington.edu	University of Washington, Seattle