Skip to content

post hoc statistical power

4 messages · Charles C. Berry, John Fox, Yuelin Li

#
I remember reading about post hoc statistical power on R-help.  But I
can't seem to find them with RSiteSearch("post hoc statistical power")
and variations of it.

I would like to learn more about post hoc statistical power, its
meaningfulness, advantages and disadvantages.  I thought the issue was
settled after Tukey's 1993 paper about post hoc statistical power
being "essentially meaningless once the experiment has been done".
But they seem to be used, and sometimes encouraged 
(e.g., http://www.informaworld.com/smpp/content~content=a787469931).

I do not intend to start a debate.  I simply would like to learn
more.  Can anyone suggest a few articles?  Thanks,

Yuelin.

Tukey JW. Tightening the clinical trial. Control Clin Trials. 1993;14:266-285.

 
     =====================================================================
     
     Please note that this e-mail and any files transmitted with it may be 
     privileged, confidential, and protected from disclosure under 
     applicable law. If the reader of this message is not the intended 
     recipient, or an employee or agent responsible for delivering this 
     message to the intended recipient, you are hereby notified that any 
     reading, dissemination, distribution, copying, or other use of this 
     communication or any of its attachments is strictly prohibited.  If 
     you have received this communication in error, please notify the 
     sender immediately by replying to this message and deleting this 
     message, any attachments, and all copies and backups from your 
     computer.
#
On Tue, 8 Apr 2008, Yuelin Li wrote:

            
Start here:

Hoenig, John M. and Heisey, Dennis M. (2001)
The abuse of power: The pervasive fallacy of power calculations for data 
analysis
The American Statistician, 55, 19-24
Keywords: bioequivalence testing; BURDEN OF PROOF; OBSERVED POWER; 
RETROSPECTIVE POWER ANALYSIS; statistical power; Type II error
CISid: 222509

HTH,

Chuck
Charles C. Berry                            (858) 534-2098
                                             Dept of Family/Preventive Medicine
E mailto:cberry at tajo.ucsd.edu	            UC San Diego
http://famprevmed.ucsd.edu/faculty/cberry/  La Jolla, San Diego 92093-0901
#
Dear Yuelin,

Another paper critical of post-hoc power calculations is Hoenig and Heisey,
2001. "The Abuse of Power: The Pervasive Fallacy of Power Calculations for
Data Analysis." The American Statistician, 55, 19-24. Hoenig and Heisey show
that so-called "observed power" is simply a re-expression of the p-value.

I hope this helps,
 John

--------------------------------
John Fox, Professor
Department of Sociology
McMaster University
Hamilton, Ontario, Canada L8S 4M4
905-525-9140x23604
http://socserv.mcmaster.ca/jfox
#
Many thanks to John Fox and Charles C. Berry.  Both point to the paper
by Hoenig and Heisey (email from John Fox below):
=====================================================================
     
     Please note that this e-mail and any files transmitted with it may be 
     privileged, confidential, and protected from disclosure under 
     applicable law. If the reader of this message is not the intended 
     recipient, or an employee or agent responsible for delivering this 
     message to the intended recipient, you are hereby notified that any 
     reading, dissemination, distribution, copying, or other use of this 
     communication or any of its attachments is strictly prohibited.  If 
     you have received this communication in error, please notify the 
     sender immediately by replying to this message and deleting this 
     message, any attachments, and all copies and backups from your 
     computer.