Running R as a server or in a cluster
We recently set up a similar environment using Amazon's EC2 service. They charge $0.1 per CPU hour. I can't say what our results have been like yet - still ironing out the kinks in our R code. But I will certainly let you all know how it goes. Our 'clustering' mechanism is very simple. We have written perl scripts that receive data over HTTP, start R, process the data, and then post the results back via HTTP to a central server. Josh -----Original Message----- From: r-sig-finance-bounces at stat.math.ethz.ch [mailto:r-sig-finance-bounces at stat.math.ethz.ch] On Behalf Of Jeff Ryan Sent: Wednesday, September 26, 2007 10:08 AM To: Brian G. Peterson Cc: r-sig-finance at stat.math.ethz.ch Subject: Re: [R-SIG-Finance] Running R as a server or in a cluster Hi all, Short of answers, but I do wonder if anyone has used Sun Microsystems www.network.com for grid work with R. At 1USD a CPU hr, with R already built - and a working example script on the service - it seems like a path worth exploring. Has anyone given it a try. I set up an account, but have yet to get the opportunity to try it out. Here is the link: http://www.network.com/apps/r_project.html Jeff Ryan
On 9/26/07, Brian G. Peterson <brian at braverock.com> wrote:
Adrian Dragulescu wrote:
We have set up a Condor cluster, see http://www.cs.wisc.edu/condor/ and we submit R jobs to the cluster. It works well because Condor has very advanced scheduling capabilities, job monitoring, etc.
Adrian, Could you provide more details? Are you running Rserve on the cluster, running "R CMD BATCH", or using Parallel-R? I'd like to suggest that we use this thread to continue to develop the
collective knowledge of the r-sig-finance community on distributed or
high-throughput R calculations.
Regards,
- Brian
_______________________________________________ R-SIG-Finance at stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-sig-finance -- Subscriber-posting only. -- If you want to post, subscribe first.
_______________________________________________ R-SIG-Finance at stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-sig-finance -- Subscriber-posting only. -- If you want to post, subscribe first.