Skip to content
Prev 189363 / 398498 Next

Proper / Improper scoring Rules

Donald Catanzaro, PhD wrote:
use == to check equality
Percent correct will give you misleading answers and is game-able.  It 
is also ultra-high-variance.  Though not a truly proper scoring rule, 
Somers' Dxy rank correlation (generalization of ROC area) is helpful. 
Better still: use the log-likelihood and related quantities (deviance, 
adequacy index as described in my book).

Frank