Skip to content
Back to formatted view

Raw Message

Message-ID: <501AE5A0.9090705@stats.ox.ac.uk>
Date: 2012-08-02T20:40:00Z
From: Brian Ripley
Subject: parallel SNOW slower than single core?
In-Reply-To: <CACXG3Gi3uqK6Y_X0v_F8cBuXUe4edi2v0tgc0V5T0pRP0-8jGA@mail.gmail.com>

On 02/08/2012 19:13, Jie wrote:
> Dear All,
>
> I am learning parallel in R and start with the package "snow". I did a test
> about running time and the parallel version is much slower than the regulat
> code. My laptop is X200s with dual core intel L9400 cpu.

The OS matters far more.  Overheads on Windows are much higher than on 
Linux for example.

> Should I make more clusters than 2? Or how to improve the performance?

Not use such small tasks.  This is discussed in the 'parallel' vignette 
(and we do suggest you start with 'parallel' these days).

> # install.packages("snow")
> library(snow)
> cl <- makeCluster(2)
> t1 <- proc.time()
> a <- c()
> for (i in 1:1000)
> {
> a[i] <- sum(parSapply(cl, 1:15, get("+"), 2))
> }
> proc.time()-t1
> t2 <- proc.time()

See ?system.time

> a <- c()
> for (i in 1:1000)
> {
> a[i] <- sum(sapply(1:15, "+", 2))
> }
> proc.time()-t2



-- 
Brian D. Ripley,                  ripley at stats.ox.ac.uk
Professor of Applied Statistics,  http://www.stats.ox.ac.uk/~ripley/
University of Oxford,             Tel:  +44 1865 272861 (self)
1 South Parks Road,                     +44 1865 272866 (PA)
Oxford OX1 3TG, UK                Fax:  +44 1865 272595