Skip to content

[R-meta] Can correlation coefficients be used as moderator in meta-regression model when effect size is also from correlation coefficient

3 messages · Zach Simpson, Mike Cheung, 何先进

#
Hey Xianjin,

[I'm no expert but I'm currently pulling together a meta-analysis
myself and so I thought I'd share my thoughts.]

I think yours is a tricky situation since you mentioned:
Therefore, you're wanting to use those moderators to explain variance
in SMB, rather than explain variance in the correlation between SMB
and elevation. But maybe it does make sense: the effect size (SMB
dependence on elevation) may be related to the effects of moderators
(as driven by elevation). I would just worry about whether the primary
data come from areas where the main source of moderator variances is
from elevation and not some other variable.

Also, you could consider transforming the correlations into Fisher's z
to account for how correlations become skewed at higher magnitudes
(i.e., make a more statstically ideal effect size). More detail is in:

Rosenberg MS, Rothstein HR, Gurevitch J (2013) Effect sizes:
conventional choices and calculations. In: Handbook of Meta-analysis
in Ecology and Evolution. pp 61?71

That's just my 2 cents. Hopefully someone more knowledgeable shares
some insight.

Cheers and good luck with the analysis,
Zach Simpson
Lincoln University, New Zealand
2 days later
#
Hi Xianjin,


Yes, effect sizes can be used as predictors, and even mediators provided
that you have a good theory. One issue in yi ~ temperature.r +
precipitation.r + ph.r is that temperature.r, precipitation.r, and ph.r are
assumed measured with the same precision, which is not true in a
meta-analysis. A better approach is to use the ?true? effect sizes as the
predictors. Here are some discussions on how to do it.


StackExchange discussion:

https://stats.stackexchange.com/questions/58310/can-i-incude-an-effect-size-as-an-independent-variable-in-a-meta-regression/58534#58534


Section 5.6 Extensions: mediation and moderation models on the effect sizes
in Cheung (2015) Meta-Analysis: A Structural Equation Modeling Approach:

https://books.google.com.sg/books?id=Pw7QBwAAQBAJ&pg=PA140&lpg=PA140&dq=%225.6+Extensions:+mediation+and+moderation+models+on+the+effect+sizes%22&source=bl&ots=zDiS8mnCN4&sig=ACfU3U11T2b31X3uGWHRcydSQays6Joy6w&hl=en&sa=X&ved=2ahUKEwiKjdLF8ozgAhUQbo8KHarBDaUQ6AEwAHoECAAQAQ#v=onepage&q=%225.6%20Extensions%3A%20mediation%20and%20moderation%20models%20on%20the%20effect%20sizes%22&f=false


R code for the above analyses:

https://htmlpreview.github.io/?https://github.com/mikewlcheung/metaSEM-book/blob/master/metaSEMbook.html#mediation-and-moderation-models


Best,

Mike
On Fri, Jan 25, 2019 at 7:47 AM Zach Simpson <zpsimpso at gmail.com> wrote:

            

  
  
1 day later
#
Thanks to Zach and Mike for your thoughtful answers.
Especial thanks to Mike, whose answer solved my problem.


Best,
Xianjin


| |
???
|
|
chatinger at 163.com
|
???????????
On 1/27/2019 10:26?Mike Cheung<mikewlcheung at gmail.com> wrote?

Hi Xianjin,




Yes, effect sizes can be used as predictors, and even mediators provided that you have a good theory. One issue in yi ~ temperature.r + precipitation.r + ph.r is that temperature.r, precipitation.r, and ph.r are assumed measured with the same precision, which is not true in a meta-analysis. A better approach is to use the ?true? effect sizes as the predictors. Here are some discussions on how to do it.




StackExchange discussion:

https://stats.stackexchange.com/questions/58310/can-i-incude-an-effect-size-as-an-independent-variable-in-a-meta-regression/58534#58534




Section 5.6 Extensions: mediation and moderation models on the effect sizes in Cheung (2015) Meta-Analysis: A Structural Equation Modeling Approach:

https://books.google.com.sg/books?id=Pw7QBwAAQBAJ&pg=PA140&lpg=PA140&dq=%225.6+Extensions:+mediation+and+moderation+models+on+the+effect+sizes%22&source=bl&ots=zDiS8mnCN4&sig=ACfU3U11T2b31X3uGWHRcydSQays6Joy6w&hl=en&sa=X&ved=2ahUKEwiKjdLF8ozgAhUQbo8KHarBDaUQ6AEwAHoECAAQAQ#v=onepage&q=%225.6%20Extensions%3A%20mediation%20and%20moderation%20models%20on%20the%20effect%20sizes%22&f=false




R code for the above analyses:

https://htmlpreview.github.io/?https://github.com/mikewlcheung/metaSEM-book/blob/master/metaSEMbook.html#mediation-and-moderation-models




Best,

Mike
On Fri, Jan 25, 2019 at 7:47 AM Zach Simpson <zpsimpso at gmail.com> wrote:

            
Hey Xianjin,

[I'm no expert but I'm currently pulling together a meta-analysis
myself and so I thought I'd share my thoughts.]

I think yours is a tricky situation since you mentioned:
Therefore, you're wanting to use those moderators to explain variance
in SMB, rather than explain variance in the correlation between SMB
and elevation. But maybe it does make sense: the effect size (SMB
dependence on elevation) may be related to the effects of moderators
(as driven by elevation). I would just worry about whether the primary
data come from areas where the main source of moderator variances is
from elevation and not some other variable.

Also, you could consider transforming the correlations into Fisher's z
to account for how correlations become skewed at higher magnitudes
(i.e., make a more statstically ideal effect size). More detail is in:

Rosenberg MS, Rothstein HR, Gurevitch J (2013) Effect sizes:
conventional choices and calculations. In: Handbook of Meta-analysis
in Ecology and Evolution. pp 61?71

That's just my 2 cents. Hopefully someone more knowledgeable shares
some insight.

Cheers and good luck with the analysis,
Zach Simpson
Lincoln University, New Zealand

_______________________________________________
R-sig-meta-analysis mailing list
R-sig-meta-analysis at r-project.org
https://stat.ethz.ch/mailman/listinfo/r-sig-meta-analysis