Skip to content
Prev 868 / 2152 Next

R on a Beowulf Cluster

"Beowulf" is a generic term, it does not mean in particular what kind
of cluster framework your school has. For example, we run "Rocks"
cluster linux. You might contact your folks, find out what they are
doing. Or, if you can log in, you will be able to tell by snooping
around a bit in /etc, or by running

$ uname -a

You need to find out what scheduling framework your administrators
have set up and which system is your "head node" where you can log in
and submit jobs to the queue.

For work with R, you need the ordinary stuff for compiling R programs
(as you would in any workstation) and for the communications between
systems, get  OpenMPI.  Rmpi compiles against that, so don't bother
trying to make R go parallel until you have a working OpenMPI.  It is
possible to install that in a user account, but usually a sysadmin
will put it somewhere and tell you where the lib dir is for compiling
apps.  it will supply an executable "mpirun" or such that is named in
your scripts.

We have a new HPC system here and I've been trying to build user
documentaiton from the ground up because most of the students I'm
trying to help are not programmers either.

I have some online "working examples" I'm cultivating.  I work on this
pretty hard for a few weeks and then I get so frustrated I do other
things for a month or two. Parallel programming is very frustrating,
compared with the ordinary kind.

This URL should be all on one line:

/http://pj.freefaculty.org/cgi-bin/mw/index.php?title=Main_Page#2._High_Performance_Computing_on_a_Linux_Cluster
On Mon, Dec 20, 2010 at 1:54 PM, Michael D <mike409 at gmail.com> wrote: