[R-meta] Random-effects meta-analyses with inverse-variance weights cannot include studies with sample sizes of two?

I see. This assumes independence between trials and is typically used when measuring a dichotomous outcome on N different subjects. But here it seems like a single subject went through N different trials. In that case, the independence assumption seems tenuous.

How does this relate to the two subjects you talked about earlier? Or is X based on the sum of two subjects?

Also, I don't see how you then derived the equation for the variance of z/sqrt(N). You wrote:

Variance = Sqr(1/(1-q)*(1-1/(1-q))/N

But let's go through this step-by-step:

Leaving aside the independence issue, we assume (for large enough N):

p ~ N(?, ?(1-?)/N)

Then we compute:

z = (p - ??) / sqrt(??(1-??)/N)

Under H0: ? = ??, it is easy to see that z ~ N(0,1), so z/sqrt(N) ~ N(0, 1/N).

But if H0 is not true, then some simple algebra shows:

Var(z) = ?(1-?) / (??(1-??))

and hence Var(z/sqrt(N)) = ?(1-?) / (N * ??(1-??)), which we could estimate with:

Var(z/sqrt(N)) = p(1-p) / (N * ??(1-??)).

Best,
Wolfgang

-----Original Message-----
From: Patrizio Tressoldi [mailto:patrizio.tressoldi at unipd.it]
Sent: Friday, 09 November, 2018 13:01
To: Viechtbauer, Wolfgang (SP); r-sig-meta-analysis at r-project.org
Subject: Re: [R-meta] Random-effects meta-analyses with inverse-variance weights cannot include studies with sample sizes of two?

Il 09/11/2018 12:05, Viechtbauer, Wolfgang (SP) ha scritto:

Maybe I am a bit dense here, but I still do not fully understand what you are computing. You wrote earlier that there are two participants that "contributed to a percentage of hits, e.g. .30 and .40". Ok, that sounds like these participants did a series of trials that could yield hits/successes. I assume N is the number of trials. So the first participant had .3*N hits and the second participant had .4*N hits. So far so good. But what is 'z = binomial z'? Where does that equation for the variance come from? It would also help if you could provide a fully reproducible example of the computations.

This is the z score obtained from a normal approximation of the binomial test binomial test: z= (X - ?)/? ; where X = observed percentage;? ? = chance percentage; ? = Sqr(?(1-?)/N

ex. X= 31; N= 49; p = .5 = (31/46 - .5)/Sqr(.5*.5/49) = 2.4

Patrizio

--
Patrizio E. Tressoldi Ph.D.
Dipartimento di Psicologia Generale
Universit? di Padova
via Venezia 8
35131 Padova - ITALY
http://www.patriziotressoldi.it
https://orcid.org/0000-0002-6404-0058

Science of Consciousness Research Group
http://dpg.unipd.it/en/soc

Make war history
support http://www.emergency.it