Error: serialization is too large to store in a raw vector

Hi all,

I am getting this serialization error when I am trying to run a simple
parallel process script. ?I just want to test if it works.

foreach (i = 1:length(U133_ps), .combine="rbind") %dopar% {
+ ps <- U133_ps[i]
+ ps
+ }
Error: serialization is too large to store in a raw vector

U133_ps is a single column vector of length 40503. ?Is this too large of a
dataset to iterate over? ?If not, how can I get around this problem?

Thanks,

Fong

? ? ? ?[[alternative HTML version deleted]]

Thanks for the reply Steve.? I actually finally managed to figure out what
was going on.? The U133_ps was a single column factor actually.? Once I
converted it into a single column character vector, I didn't have any more
problems

Do you know why the factor class was causing so many issues?

Fong


On Tue, Aug 10, 2010 at 7:03 PM, Stephen Weston <stephen.b.weston at gmail.com>
wrote:

Hi Fong,

A vector of length 40503 is definitely not too large. ?The code that
you included looks fine. ?Is it possible that in the full version of the
script the variable "ps" is defined outside of the foreach loop?
It would be automatically exported in that case, and if it was large
enough, it could cause the serialization error. ?If that is the case,
you could fix the problem by using the foreach argument
".noexport='ps'".

If that isn't the case, could you post a complete, self-contained
example that demonstrates the problem?

- Steve


On Tue, Aug 10, 2010 at 4:07 PM, Fong Chun Chan
<fongchun at interchange.ubc.ca> wrote:

Hi all,

I am getting this serialization error when I am trying to run a simple
parallel process script. ?I just want to test if it works.

foreach (i = 1:length(U133_ps), .combine="rbind") %dopar% {
+ ps <- U133_ps[i]
+ ps
+ }
Error: serialization is too large to store in a raw vector

U133_ps is a single column vector of length 40503. ?Is this too large of
a
dataset to iterate over? ?If not, how can I get around this problem?

Thanks,

Fong

? ? ? ?[[alternative HTML version deleted]]