Skip to content
Prev 171674 / 398503 Next

statistical significance of accuracy increase in classification

Monica Pisica 
Max,
 
thanks for the reply. Yes, the models are done outside R (i will see what i can do to run some of them inside R in the future ....) and the sampling is extremely skewed. But we use as truth or reference results from a field exercise where people actually went and gave detailed description of the locations visited. This was very much depended on accessibility of the site, .... which in majority is not. Unfortunately when results get reported to managers .... they do care about accuracy for example, but less about CI .... and even less about the skewed sampling .... unless i can prove that this gives unacceptable results. 
 
Do you know about any good reference that discusses kappa for classification and maybe CI for kappa???
 
Thanks again for your input,
 
Monica
_________________________________________________________________


ore_022009

Thread (7 messages)

Monica Pisica statistical significance of accuracy increase in classification Feb 24 Max Kuhn statistical significance of accuracy increase in classification Feb 25 Monica Pisica statistical significance of accuracy increase in classification Feb 25 Max Kuhn statistical significance of accuracy increase in classification Feb 26 Stefan Evert statistical significance of accuracy increase in classification Feb 26 Monica Pisica statistical significance of accuracy increase in classification Feb 27 Monica Pisica statistical significance of accuracy increase in classification Feb 27