________________________________
De: R-sig-meta-analysis<r-sig-meta-analysis-bounces at r-project.org> <mailto:r-sig-meta-analysis-bounces at r-project.org> en nombre der-sig-meta-analysis-request at r-project.org <mailto:r-sig-meta-analysis-request at r-project.org> <r-sig-meta-analysis-request at r-project.org> <mailto:r-sig-meta-analysis-request at r-project.org>
Enviado: mi?rcoles, 15 de abril de 2020 07:00
Para:r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org> <r-sig-meta-analysis at r-project.org> <mailto:r-sig-meta-analysis at r-project.org>
Asunto: R-sig-meta-analysis Digest, Vol 35, Issue 8
Send R-sig-meta-analysis mailing list submissions to
r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org>
To subscribe or unsubscribe via the World Wide Web, visit
https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=02%7C01%7C%7C7f93a72da7b64707fe6d08d7e12439ac%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637225418004815037&sdata=Wed2UnN%2FV4z79%2Bb555NuEz7%2Fs9ta97aXHc18%2BxjrLLk%3D&reserved=0 <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=02%7C01%7C%7Cb7b04d24edb749d80fd808d7e61baa75%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637230879022575464&sdata=j0c9KS7Ko%2B3dLj6cQS%2Fdm1Sx3TnXVmYsUqJX6mQZpVk%3D&reserved=0>
or, via email, send a message with subject or body 'help' to
r-sig-meta-analysis-request at r-project.org <mailto:r-sig-meta-analysis-request at r-project.org>
You can reach the person managing the list at
r-sig-meta-analysis-owner at r-project.org <mailto:r-sig-meta-analysis-owner at r-project.org>
When replying, please edit your Subject line so it is more specific
than "Re: Contents of R-sig-meta-analysis digest..."
Today's Topics:
1. Re: Dear Wolfgang (Viechtbauer, Wolfgang (SP))
2. Re: Dear Wolfgang (Ju Lee)
----------------------------------------------------------------------
Message: 1
Date: Tue, 14 Apr 2020 20:43:51 +0000
From: "Viechtbauer, Wolfgang (SP)"
<wolfgang.viechtbauer at maastrichtuniversity.nl> <mailto:wolfgang.viechtbauer at maastrichtuniversity.nl>
To: Ju Lee<juhyung2 at stanford.edu> <mailto:juhyung2 at stanford.edu>,
"r-sig-meta-analysis at r-project.org" <mailto:r-sig-meta-analysis at r-project.org>
<r-sig-meta-analysis at r-project.org> <mailto:r-sig-meta-analysis at r-project.org>
Subject: Re: [R-meta] Dear Wolfgang
Message-ID:<b411740819d1411da87d505cdeceb3e6 at UM-MAIL3214.unimaas.nl> <mailto:b411740819d1411da87d505cdeceb3e6 at UM-MAIL3214.unimaas.nl>
Content-Type: text/plain; charset="iso-8859-1"
Yes, if the effect size measure is the same, one can make such a comparison. Also, there should not be any overlap in the studies included in the two meta-analyses (as otherwise the two estimates are not independent, as assumed by the test). And yes, you don't need sample sizes or tau^2 values or anything else - just the two estimates and their corresponding standard errors. And it doesn't depend on what random effects structure was used in the two meta-analyses -- assuming that the structures used in the two meta-analyses were appropriate for the studies at hand.
Best,
Wolfgang
-----Original Message-----
From: Ju Lee [mailto:juhyung2 at stanford.edu]
Sent: Tuesday, 14 April, 2020 18:54
To: Viechtbauer, Wolfgang (SP);r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org>
Subject: Re: Dear Wolfgang
Dear Wolfgang,
Thanks for your insights.
I am reaching out to my colleagues to see how they have made such
transformation.
In the meantime, based on the information that you have sent, it is possible
to compare two different meta-analyses if they are using the same effect
size, say lnRR? and this wald-type test can be performed only with grand
mean effect sizes and their standard error, without sample sizes or tau
value, if I understood correctly?
How would this approach be actually applicable to publications that
seemingly used similar mixed-effect models but there is no guarantee that
random effect structures are standardized between the two?
[[elided Hotmail spam]]
Best,
JU
________________________________________
From: Viechtbauer, Wolfgang (SP)
<wolfgang.viechtbauer at maastrichtuniversity.nl> <mailto:wolfgang.viechtbauer at maastrichtuniversity.nl>
Sent: Tuesday, April 14, 2020 7:04 AM
To: Ju Lee<juhyung2 at stanford.edu> <mailto:juhyung2 at stanford.edu>;r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org> <r-
sig-meta-analysis at r-project.org <mailto:sig-meta-analysis at r-project.org>>
Subject: RE: Dear Wolfgang
Dear Ju,
In principle, this might be of interest to you:
https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.metafor-project.org%2Fdoku.php%2Ftips%3Acomp_two_independent_estimates&data=02%7C01%7C%7C7f93a72da7b64707fe6d08d7e12439ac%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637225418004815037&sdata=Tqgh0WpvUo70JTaihNWcZcbVQCQRpbprCYAxGKtlBGY%3D&reserved=0 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.metafor-project.org%2Fdoku.php%2Ftips%3Acomp_two_independent_estimates&data=02%7C01%7C%7Cb7b04d24edb749d80fd808d7e61baa75%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637230879022585452&sdata=a8wDXFJooyKG3NkPWEVrtzN1MGFywU6ha8574C%2F0W2c%3D&reserved=0>
However, a standardized mean difference is given by (m1-m2)/sd, while a
(log) response ratio is log(m1/m2). I see no sensible way of converting the
former to the later.
Best,
Wolfgang
-----Original Message-----
From: R-sig-meta-analysis [mailto:r-sig-meta-analysis-bounces at r-
project.org]
On Behalf Of Ju Lee
Sent: Monday, 13 April, 2020 22:47
To:r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org>
Subject: [R-meta] Dear Wolfgang
Dear Wolfgang,
I hope you are doing well.
My research group is currently working on a project where they are trying
to
compare effect sizes generated from their current mixed-effect meta-
analysis
with effect sizes (based on similar response variables) calculated in other
meta-analysis publications.
We are currently using log response ratio and are trying to make some
statement or analysis to compare our grand mean effect sizes with other
studies. In more details, we are examining how herbivorous animal control
plant growth in degraded environment. Now, there is already a meta-analysis
out there that has examined this (in comparable manner) in natural
environment as opposed to our study.
My colleagues want to know if there is a way to make some type of
comparison
(ex. whether responses are stronger in degraded vs. natural environemnts)
between two effect sizes from these different studies using statistical
approaches.
So far what they have from other meta-analysis publication is grand mean
hedges'd and var which they transformed to lnRR and var in hopes to compare
with our lnRR effect sizes.
My view is that this is not possible unless we can have their actual raw
dataset and run a whole new model combining with our original raw dataset.
But I wanted to reach out to you and the community if there is an
alternative approaches to compare mean effect sizes among different meta-
analysis which are assumed to have used similar approaches in study
selection and models (another issue being different random effect
structures
used in different meta-analysis which may not be very apparent from method
description).
[[elided Hotmail spam]]
Best,
JU
------------------------------
Message: 2
Date: Wed, 15 Apr 2020 05:33:16 +0000
From: Ju Lee<juhyung2 at stanford.edu> <mailto:juhyung2 at stanford.edu>
To: "Viechtbauer, Wolfgang (SP)"
<wolfgang.viechtbauer at maastrichtuniversity.nl> <mailto:wolfgang.viechtbauer at maastrichtuniversity.nl>,
"r-sig-meta-analysis at r-project.org" <mailto:r-sig-meta-analysis at r-project.org>
<r-sig-meta-analysis at r-project.org> <mailto:r-sig-meta-analysis at r-project.org>
Subject: Re: [R-meta] Dear Wolfgang
Message-ID:
<BYAPR02MB5559407370455A06F0B047A8F7DB0 at BYAPR02MB5559.namprd02.prod.outlook.com> <mailto:BYAPR02MB5559407370455A06F0B047A8F7DB0 at BYAPR02MB5559.namprd02.prod.outlook.com>
Content-Type: text/plain; charset="utf-8"
Dear Wolfgang,
[[elided Hotmail spam]]
I am not sure how my colleagues have transformed hedges' d to lnRR, based on what sources, but I will reach out again once I have more details. I, too, have not known if there is a way to make such effect size transformation.
Thank you very much!
Best wishes,
JU
________________________________
From: Viechtbauer, Wolfgang (SP)<wolfgang.viechtbauer at maastrichtuniversity.nl> <mailto:wolfgang.viechtbauer at maastrichtuniversity.nl>
Sent: Tuesday, April 14, 2020 1:43 PM
To: Ju Lee<juhyung2 at stanford.edu> <mailto:juhyung2 at stanford.edu>;r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org> <r-sig-meta-analysis at r-project.org> <mailto:r-sig-meta-analysis at r-project.org>
Subject: RE: Dear Wolfgang
Yes, if the effect size measure is the same, one can make such a comparison. Also, there should not be any overlap in the studies included in the two meta-analyses (as otherwise the two estimates are not independent, as assumed by the test). And yes, you don't need sample sizes or tau^2 values or anything else - just the two estimates and their corresponding standard errors. And it doesn't depend on what random effects structure was used in the two meta-analyses -- assuming that the structures used in the two meta-analyses were appropriate for the studies at hand.
Best,
Wolfgang
-----Original Message-----
From: Ju Lee [mailto:juhyung2 at stanford.edu]
Sent: Tuesday, 14 April, 2020 18:54
To: Viechtbauer, Wolfgang (SP);r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org>
Subject: Re: Dear Wolfgang
Dear Wolfgang,
Thanks for your insights.
I am reaching out to my colleagues to see how they have made such
transformation.
In the meantime, based on the information that you have sent, it is possible
to compare two different meta-analyses if they are using the same effect
size, say lnRR? and this wald-type test can be performed only with grand
mean effect sizes and their standard error, without sample sizes or tau
value, if I understood correctly?
How would this approach be actually applicable to publications that
seemingly used similar mixed-effect models but there is no guarantee that
random effect structures are standardized between the two?
[[elided Hotmail spam]]
Best,
JU
________________________________________
From: Viechtbauer, Wolfgang (SP)
<wolfgang.viechtbauer at maastrichtuniversity.nl> <mailto:wolfgang.viechtbauer at maastrichtuniversity.nl>
Sent: Tuesday, April 14, 2020 7:04 AM
To: Ju Lee<juhyung2 at stanford.edu> <mailto:juhyung2 at stanford.edu>;r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org> <r-
sig-meta-analysis at r-project.org <mailto:sig-meta-analysis at r-project.org>>
Subject: RE: Dear Wolfgang
Dear Ju,
In principle, this might be of interest to you:
https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.metafor-project.org%2Fdoku.php%2Ftips%3Acomp_two_independent_estimates&data=02%7C01%7C%7C7f93a72da7b64707fe6d08d7e12439ac%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637225418004815037&sdata=Tqgh0WpvUo70JTaihNWcZcbVQCQRpbprCYAxGKtlBGY%3D&reserved=0 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.metafor-project.org%2Fdoku.php%2Ftips%3Acomp_two_independent_estimates&data=02%7C01%7C%7Cb7b04d24edb749d80fd808d7e61baa75%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637230879022595432&sdata=PMzH%2FelqtN5EAhFmK6pqcyq%2FLNGyHonwyBdWtal57Mo%3D&reserved=0>
However, a standardized mean difference is given by (m1-m2)/sd, while a
(log) response ratio is log(m1/m2). I see no sensible way of converting the
former to the later.
Best,
Wolfgang
-----Original Message-----
From: R-sig-meta-analysis [mailto:r-sig-meta-analysis-bounces at r-
project.org]
On Behalf Of Ju Lee
Sent: Monday, 13 April, 2020 22:47
To:r-sig-meta-analysis at r-project.org <mailto:r-sig-meta-analysis at r-project.org>
Subject: [R-meta] Dear Wolfgang
Dear Wolfgang,
I hope you are doing well.
My research group is currently working on a project where they are trying
to
compare effect sizes generated from their current mixed-effect meta-
analysis
with effect sizes (based on similar response variables) calculated in other
meta-analysis publications.
We are currently using log response ratio and are trying to make some
statement or analysis to compare our grand mean effect sizes with other
studies. In more details, we are examining how herbivorous animal control
plant growth in degraded environment. Now, there is already a meta-analysis
out there that has examined this (in comparable manner) in natural
environment as opposed to our study.
My colleagues want to know if there is a way to make some type of
comparison
(ex. whether responses are stronger in degraded vs. natural environemnts)
between two effect sizes from these different studies using statistical
approaches.
So far what they have from other meta-analysis publication is grand mean
hedges'd and var which they transformed to lnRR and var in hopes to compare
with our lnRR effect sizes.
My view is that this is not possible unless we can have their actual raw
dataset and run a whole new model combining with our original raw dataset.
But I wanted to reach out to you and the community if there is an
alternative approaches to compare mean effect sizes among different meta-
analysis which are assumed to have used similar approaches in study
selection and models (another issue being different random effect
structures
used in different meta-analysis which may not be very apparent from method
description).
[[elided Hotmail spam]]
Best,
JU
[[alternative HTML version deleted]]
------------------------------
Subject: Digest Footer
_______________________________________________
R-sig-meta-analysis mailing list
R-sig-meta-analysis at r-project.org <mailto:R-sig-meta-analysis at r-project.org>
https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=02%7C01%7C%7C7f93a72da7b64707fe6d08d7e12439ac%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637225418004815037&sdata=Wed2UnN%2FV4z79%2Bb555NuEz7%2Fs9ta97aXHc18%2BxjrLLk%3D&reserved=0 <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=02%7C01%7C%7Cb7b04d24edb749d80fd808d7e61baa75%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637230879022605420&sdata=Qem1YzPqTFwQjzV91N%2B2Z5xJgF%2Foy7V5tUXsutkobRg%3D&reserved=0>
------------------------------
End of R-sig-meta-analysis Digest, Vol 35, Issue 8
**************************************************
[[alternative HTML version deleted]]
_______________________________________________
R-sig-meta-analysis mailing list
R-sig-meta-analysis at r-project.org <mailto:R-sig-meta-analysis at r-project.org>
https://stat.ethz.ch/mailman/listinfo/r-sig-meta-analysis <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstat.ethz.ch%2Fmailman%2Flistinfo%2Fr-sig-meta-analysis&data=02%7C01%7C%7Cb7b04d24edb749d80fd808d7e61baa75%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637230879022615400&sdata=RV3ZpwL%2Fq5jTIe1zM240Rq2bBB%2BTENsszuY1YRNNyJA%3D&reserved=0>