Skip to content

check does not check that package examples remove tempdir()

6 messages · Henrik Bengtsson, William Dunlap, danlrobertson89 at gmail.com +2 more

#
I was looking at the CRAN package 'bfork-0.1.2', which exposes the Unix
fork() and waitpid() calls at the R code level, and noticed that the help
file example for bfork::fork removes R's temporary directory, the value of
tempdir().   I think it happens because the forked process shares the value
of tempdir() with the parent process and removes it when it exits.

This seems like a serious problem - should 'check' make sure that running
code in a package's examples, vignettes, etc. leaves tempdir() intact?
[1] TRUE
fork>     ## create a function to be run as a separate process
fork>     fn <- function() {
fork+         Sys.sleep(4)
fork+         print("World!")
fork+     }

fork>     ## fork the process
fork>     pid <- fork(fn)

fork>     ## do work in the parent process
fork>     print("Hello")
[1] "Hello"

fork>     ## wait for the child process
fork>     waitpid(pid)
[1] "World!"
[1] 7063
[1] FALSE


Bill Dunlap
TIBCO Software
wdunlap tibco.com
#
Related to this problem - from R-devel NEWS
(https://cran.r-project.org/doc/manuals/r-devel/NEWS.html):

* tempdir(check = TRUE) recreates the tmpdir() if it is no longer
valid (e.g. because some other process has cleaned up the ?/tmp?
directory).

Not sure if there's a plan to make check = TRUE the default though.

/Henrik

On Wed, Nov 8, 2017 at 4:43 PM, William Dunlap via R-devel
<r-devel at r-project.org> wrote:
#
I think recreating tempdir() is ok in an emergency situation, but package
code
should not be removing tempdir() - it may contain important information.

Bill Dunlap
TIBCO Software
wdunlap tibco.com

On Wed, Nov 8, 2017 at 4:55 PM, Henrik Bengtsson <henrik.bengtsson at gmail.com

  
  
#
This is very likely the case. Pretty much the entire library can be
summed up by bfork_fork, which is the following.

    SEXP res;
    pid_t pid;
    if((pid = fork()) == 0) {
        PROTECT(res = eval(lang1(fn), R_GlobalEnv));
        PROTECT(res = eval(lang2(install("q"), mkString("no")), R_GlobalEnv));
        UNPROTECT(2);
    }

    return ScalarInteger(pid);

I wrote this lib when I was still in school and can see several issues
with the implementation of `bfork_fork`. This issue happens because
we do not exit with _exit, but by essentially calling q("no").

Cheers,

Dan
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: Digital signature
URL: <https://stat.ethz.ch/pipermail/r-devel/attachments/20171109/6a98e5e2/attachment.sig>
1 day later
#
Please note there is parallel::mcparallel/mccollect in R which provides 
similar functionality, mcparallel starts a new job and mccollect allows 
to wait for it.

You are right about _exit, but there are additional issues which cannot 
be solved independently in an external package, and, such a low level 
interface cannot be used without race conditions from R anyway.

Best
Tomas
On 11/09/2017 02:55 AM, danlrobertson89 at gmail.com wrote:

  
  
#
On Thu, Nov 9, 2017 at 1:43 AM, William Dunlap via R-devel
<r-devel at r-project.org> wrote:
This has come up a few times:

 - https://stat.ethz.ch/pipermail/r-devel/2017-February/073748.html
 - https://stat.ethz.ch/pipermail/r-devel/2017-April/074149.html

You may want to read up on the latter discussion.