Skip to content
Prev 3309 / 5632 Next

[R-meta] Pseudoreplication

Dear all,

I am contacting you to have your advice about a reviewer comment on a
meta-analysis. The reviewer said that as we used multiple comparisons from
within studies (e.g., five effect sizes from one particular paper
comparisons), this raises the potential of pseudoreplication issue and
he/she suggests to do the following:  recalculate the overall effect sizes
after sampling one comparison from each separate study and calculate the
estimated mean and 95% CI of effect size by bootstrap resampling 1,000
times in R.
However, I think I've already taken into account non-independence of the
data by including three random effects using metafor to control for
multiple data from the same article, multiple data from same participants
from the same study and multiple estimates within a study within a lab. So
I coded random effect as follows: ~1|articleID/studyID/estID. I think this
is the right way to take into account heterogeneity of the data but I would
like to know if I am correct or if the pseudoreplication techniques gave
something different and/or complementary?
Thanks in advance for your help!
Best,
Gladys