AUC: a misleading measure of the performance of predictive distribution models

Keywords

Receiver operating characteristic, Measure (data warehouse), Statistics, Reliability (semiconductor), Goodness of fit

References

• Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual EntailmentJoaquin Quiñonero Candela, Magnini Dagan I, d'Alché-Buc, Florence — 2006
• Modifying ROC Curves to Incorporate Predicted ProbabilitiesCèsar Ferri, Peter Flach, José Hernández‐Orallo — 2005
• Evaluating presence-absence models in ecology: the need to account for prevalenceStéphanie Manel, Hywel C Williams, S. J. Ormerod — 2001
• The continuing challenges of testing species distribution modelsIan P. Vaughan, S. J. Ormerod — 2005
• The effects of species’ range sizes on the accuracy of distribution models: ecological phenomenon or statistical artefact?Jana McPherson, Walter Jetz, David J. Rogers — 2004
• Comparing classifiers when the misallocation costs are uncertainNiall M. Adams, David J. Hand — 1999
• The use of genetic algorithms and Bayesian classification to model species distributionsMette Termansen, Colin J. McClean, Christopher Preston — 2006
• Measuring the accuracy of diagnostic systems.John A. Swets — 1988
• On the statistical analysis of ROC curves.Mary Lou Thompson, Walter Zucchini — 1989
• Receiver Operating Characteristic MethodologyMargaret S. Pepe — 2000
• Sources, Sinks, and Population RegulationH. Ronald Pulliam — 1988
• Species diversity in ecological communities: edited by Robert E. Ricklefs and Dolph Schluter University of Chicago Press, 1993. 105.00 hbk, 35.00 pbk (414 pages) ISBN 0 226 71822 0/0 226 71823 9John A. Wiens — 1994
• Goodness of fit tests for the multiple logistic regression modelDavid W. Hosmer, Stanley Lemesbow — 1980
• Verification, Validation, and Confirmation of Numerical Models in the Earth SciencesНаоми Орескес, Kristin Shrader‐Frechette, Kenneth Belitz — 1994
• A Coefficient of Agreement for Nominal ScalesJacob Cohen — 1960
• A Proposed Design and Analysis for Comparing Digital and Analog MammographyStuart G. Baker, Paul F. Pinsky — 2001
• Selecting thresholds of occurrence in the prediction of species distributionsCanran Liu, Pam Berry, Terence P. Dawson — 2005
• Evaluating the predictive performance of habitat models developed using logistic regressionJennie Pearce, Simon Ferrier — 2000
• An improved approach for predicting the distribution of rare and endangered species from occurrence and pseudo-absence dataRobin Engler, Antoine Guisan, Luca Rechsteiner — 2004
• Robust Classification for Imprecise EnvironmentsFoster Provost, Tom Fawcett — 2000

Cited by

• Population distribution models: species distributions are better modeled using biologically relevant data partitionsJoaquín García Sánchez — 2011
• Mapping Reef Fish and the Seascape: Using Acoustics and Spatial Modeling to Guide Coastal ManagementPaul Tranter — 2014
• Using Landscape and Bioclimatic Features to Predict the Distribution of Lions, Leopards and Spotted Hyaenas in Tanzania's Ruaha LandscapeVicki VanTuyle, Sandra Watkins — 2014
• Predicting hospital aggression in secure psychiatric careTony Bastick — 2016
• The evolutionary history of Eugenia sect. Phyllocalyx (Myrtaceae) corroborates historically stable areas in the southern Atlantic forests.Mariana de Oliveira Bünger, Fiorella Fernanda Mazine, Félix Forest — 2016
• How sensitive are temperate tadpoles to climate change? The use of thermal physiology and niche model tools to assess vulnerability.Pablo Jesús Caballero Blanco, Carlos de Teresa Galván, María del Carmen Vargas Corzo — 2018
• Future effects of climate and land-use change on terrestrial vertebrate community diversity under different scenariosTim Newbold — 2018
• Differentiation of Predominantly Solid Enhancing Lipid-Poor Renal Cell Masses by Use of Contrast-Enhanced CT: Evaluating the Role of Texture in Tumor Subtyping.Carmen Blanco García — 2018
• Leishmaniasis in Eurasia and Africa: geographical distribution of vector species and pathogens一也 富成 — 2019
• Social contextuality and conversational recommender systemsEoin Hurrell — 2013
• Eco-Epidemiology of Eastern Equine Encephalitis VirusPatrick Vander Kelen — 2013
• Automatic Detection and Intensity Estimation of Spontaneous SmilesJeffrey M. Girard — 2014
• Modelando ocorrência e abundância de espécies arbóreas no entorno de uma usina hidroelétrica no sul do BrasilE. de S. G. Guarino — 2010
• Modeling the distribution of meadows in arid and semi-arid Patagonia, Argentina: assessing current distribution and predicting response to climate changeRamiro D. Crego — 2012
• Predictive distribution modeling for rare Himalayan medicinal plant Berberis aristata DC.Rajasri Ray, KV Gururaja, T V Ramchandra — 2011
• Beyond simple means: integrating extreme events and biotic interactions in species distribution models: conservation implications for the northern bettong (Bettongia tropica) under climate changeBrooke L. Bateman — 2010
• TIME SERIES ANALYSIS AS INPUT FOR PREDICTIVE MODELING: PREDICTING CARDIAC ARREST IN A PEDIATRIC INTENSIVE CARE UNITCurtis Kennedy — 2010
• Understanding fish-habitat associations using video observations and sonar imagingJ. Monk — 2011
• DNA-based Population Estimation, Harvest Vulnerability, and Home Range Dynamics of Black Bears in Western MarylandMichael Jones — 2012
• Detecting Command and Control Channels of a Botnet Using a N-packet-based ApproachFélix Brezo, José Gaviria de la Puerta, Pablo G. Bringas — 2013

Related papers

• Estimating Mahler's measureGraham Everest — 1995
• Measure Zero Sets with Non-Measurable SumKrzysztof Ciesielski, Chris Freiling, Hajrudin Fejzić — 2002
• Assessing the goodness of fit of forest models estimated by nonlinear mixed-model methodsShongming Huang, Shawn X. Meng, Yuqing Yang — 2009
• Goodness-of-fit tests for correlated paired binary dataMan‐Lai Tang, Yan-Bo Pei, Weng Kee Wong — 2012
• Evaluation of a pseudo-R2 measure for panel probit models.Martin Spieß — 2001
• A comparison of factor‐analytic and equal diagonal factor‐analytic models in multi‐location trials analysesXiyuan Hu, Dejun Han, Renhe Zhang — 2020
• An Evaluation of Fit Indices Used in Model Selection of Dichotomous Mixture IRT ModelsSedat Şen, Allan S. Cohen — 2023
• 부산 아파트 실거래가를 이용한 전통적 헤도닉모형과 공간계량모형간의 적합도에 관한 비교 연구Sung Woo Kim, 정건섭 — 2010
• Fixed-effect variable selection in linear mixed models using R2 statisticsJean G. Orelien, Lloyd J. Edwards — 2008