ROC or TSS?
Dear List Members, I have some troubles with models evaluation. I'm using biomod2 package and I'm comparing 7 models with an Evaluation dataset. I obtain very different results between ROC and TSS as shown here:
myBiomodModelEval["ROC","Evaluating.data",,,]
RUN1 RUN2 RUN3 Full GLM 0.642 0.651 0.673 0.654 GAM 0.522 0.493 0.495 0.509 GBM 0.582 0.576 0.580 0.581 ANN 0.760 0.613 0.671 0.801 MARS 0.902 0.892 0.898 0.902 RF 0.814 0.809 0.770 0.800 MAXENT 0.638 0.616 0.606 0.614
myBiomodModelEval["TSS","Evaluating.data",,,]
RUN1 RUN2 RUN3 Full GLM 0.023 0.014 0.000 0.007 GAM -0.093 -0.095 -0.095 -0.099 GBM 0.202 -0.134 0.244 0.204 ANN 0.386 0.311 0.257 0.469 MARS 0.614 0.402 0.608 0.634 RF 0.469 0.389 0.349 0.406 MAXENT 0.219 0.326 0.259 0.280 How good are my models? Should I use ROC or TSS? Many thanks,
Maurizio Marchi, Ph.D. student Florence, Italy ID skype: maurizioxyz Ubuntu 14.04 LTS linux user 552742 [[alternative HTML version deleted]]