Message-ID: <50494073.9050909@braverock.com>
Date: 2012-09-07T00:31:47Z
From: Brian G. Peterson
Subject: Problems parallelizing glmnet
In-Reply-To: <CA+hbrhXuqqnGXUvXG7ZK9vOL=x5ApE3PdR6QcPEq2VBOQ6s5-Q@mail.gmail.com>
On 09/06/2012 04:09 PM, Peter Langfelder wrote:
> FWIW, the foreach construct itself (without any parallel backend) is
> quite slow and I would not use to loop over a large number of quick
> calculations.
Peter, this is right. It is not a general replacement for a for
loop.... there's too much infrastructure involved. However, we
typically write all of our code that will be parallelized for deployment
using %dopar% and then use registerDoSEQ() and run single threaded on a
smaller test set while debugging.
Regards,
- Brian
--
Brian G. Peterson
http://braverock.com/brian/
Ph: 773-459-4973
IM: bgpbraverock