[R-meta] Calculating SMD from posttest only - is this possible?

Roberto,

Just to add a bit to Wolfgang's response: I think it is helpful to consider
this question under the framework of risk of bias.

If an experiment is properly randomized and there is no attrition, then the
difference in post-test means is an unbiased estimator of the average
treatment effect (ATE). The same is true in a pre/post experiment: if the
randomization is properly conducted and there is not attrition, then the
difference in mean change scores is an unbiased estimator of the ATE
(because the difference in pre-test means has expectation zero). In other
words, both designs are used to estimate the same target parameter (albeit
with different degrees of precision).

Where discrepancies might arise is if the design isn't perfect, such as if
the randomization might have been faulty (due to lack of allocation
concealment or something) or if there is substantial attrition, either of
which could lead to bias in the estimate of the ATE. The pre-post design is
probably more robust to such imperfections because it adjusts for baseline
differences. The post-test only design is likely less robust because
there's no baseline covariates that could be used to adjust for differences
between groups at post-test. Considered in light, whether it's a good idea
to include post-test only designs depends on whether the post-test only
designs are at low risk of bias.

James

On Sat, Oct 5, 2019 at 4:46 PM Viechtbauer, Wolfgang (SP) <

[R-meta] Calculating SMD from posttest only - is this possible?

Thread (7 messages)