Skip to content
Prev 21802 / 29559 Next

ROC or TSS?

Dear List Members,
I have some troubles with models evaluation. I'm using biomod2 package and
I'm comparing 7 models with an Evaluation dataset. I obtain very different
results between ROC and TSS as shown here:
RUN1  RUN2  RUN3  Full
GLM        0.642 0.651 0.673 0.654
GAM        0.522 0.493 0.495 0.509
GBM        0.582 0.576 0.580 0.581
ANN         0.760 0.613 0.671 0.801
MARS      0.902 0.892 0.898 0.902
RF            0.814 0.809 0.770 0.800
MAXENT 0.638 0.616 0.606 0.614
RUN1   RUN2   RUN3   Full
GLM        0.023  0.014  0.000  0.007
GAM       -0.093 -0.095 -0.095 -0.099
GBM         0.202 -0.134  0.244  0.204
ANN          0.386  0.311  0.257  0.469
MARS       0.614  0.402  0.608  0.634
RF            0.469  0.389  0.349  0.406
MAXENT  0.219  0.326  0.259  0.280

How good are my models? Should I use ROC or TSS?

Many thanks,