Skip to content
Prev 232 / 2152 Next

openmpi/rmpi/snow: current puzzles, possible improvements [diagnosis]

I think there were several things wrong.
1) I wasn't exporting R_PROFILE to the remote nodes.
2) R CMD BATCH's output file was the same file for all processes, given
NFS.
3) The remote nodes did not have Rmpi installed!

3) is obviously crucial; I'm not sure how significant the other problems
are.  I diagnosed it by changing the output file to /tmp/foo and running
only one job on each node.

Is there a good way to get unique file names per process on the command
line?  The only way I can think of is to determine the output file
inside the batch script invoked by mpirun and using an env variable, if
one is available (i.e., OpenMPI 1.3 or 1.2 in some scenarios)

My new invocation looks like this:
R_PROFILE=/usr/lib/R/site-library/snow/RMPISNOWprofile; export R_PROFILE
mpirun -np 2 -host n5,n7 -x R_PROFILE /usr/bin/R CMD BATCH silly.R

I think the R CMD BATCH will send output to stdout and mpi will redirect
to the invoking terminal.  Since I can't actually run because of 3),
this is speculative.

Ross
On Wed, 2009-05-13 at 21:52 -0700, Ross Boylan wrote: