A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection

Keywords

Cross-validation, Naive Bayes classifier, Model selection, Computer science, Classifier (UML)

References

• Stacked generalizationDavid H. Wolpert — 1992
• Decision Tree Pruning: Biased or Optimal?Sholom M. Weiss, Nitin Indurkhya — 1994
• MLC++, A Machine Learning Library in C++.Nils J. Nilsson — 1995
• Classification and regression treesAlexander Gordon, Leo Breiman, Jerome H. Friedman — 1983
• An Analysis of Bayesian ClassifiersPat Langley, and Wayne Iba, Kevin Thompson — 1992
• Estimating the Accuracy of Learned ConceptsTimothy L. Bailey, Charles Elkan — 1993
• Bootstrap Techniques for Error EstimationAnil K. Jain, Richard C. Dubes, Chien-Chang Chen — 1987
• Estimating the Error Rate of a Prediction Rule: Improvement on Cross-ValidationBradley Efron — 1983
• Small Sample Error Rate Estimation for k-NN ClassifiersS.M. Weiss — 1991
• Submodel selection and evaluation in regression. The X-random caseLeo Breiman, Philip C. Spector — 1992
• C4.5: Programs for Machine LearningJ. R. Quinlan — 1992
• On the Distributional Properties of Model Selection CriteriaPing Zhang — 1992
• Neural networksDavidF. Signorini, JimM. Slattery, SIMON R. DODDS — 1995
• OFF-TRAINING SET ERROR AND A PRIORI DISTINCTIONS BETWEEN LEARNING ALGORITHMSD. Wolpert — 1994
• The Relationship Between PAC, the Statistical Physics Framework, the Bayesian Framework, and the VC FrameworkD. Wolpert — 1995
• A Conservation Law for Generalization PerformanceC. Schaffer — 1994

Cited by

• A modular architecture for systematic text categorisationAndrew J. Barnes — 2013
• Software defect prediction using static code metrics : formulating a methodologyDavid Philip Harry Gray — 2013
• Social networks and collaborative filtering for large-scale requirements elicitationSL Lim — 2011
• A New Metric-Based Approach to Model SelectionDale Schuurmans — 1997
• Extraction de couples nom-verbe sémantiquement liés : une technique symbolique automatiqueVincent Claveau — 2003
• Machine Learning for First-Order Theorem ProvingJames P. Bridge, Sean B. Holden, Lawrence C. Paulson — 2014
• Tense and Mood Decision with Similarity Search in Japanese to Spanish Machine TranslationTsutomu Endo — 2009
• Multiattribute Loss Aversion and Reference Dependence: Evidence from the Performing Arts IndustryNecati Tereyağoğlu, Peter S. Fader, Senthil K. Veeraraghavan — 2017
• A Study of Early Stopping and Model Selection Applied to the Papermaking IndustryVanesa López — 2000
• Building bayesian networks from data: a constraint-based approachNicandro Cruz Ramírez — 2001
• Tree-Based Credal Networks for ClassificationMarco Zaffalon, Enrico Fagiuoli — 2003
• Technologies for Mobile ITS Applications and Safer DrivingChristian Manasseh — 2010
• Tolerance to missing data using a likelihood ratio based classifier for computer-aided classification of breast cancerAnna O. Bilska‐Wolak, Carey E FloydJr — 2004
• Automatic segmentation of diatom images for classificationP. Van der Vorm — 2004
• Simple point-of-care risk stratification in acute coronary syndromes: the AMIS modelDavid J. Kurz, Abraham Bernstein, Katherine Hunt — 2008
• Multinomial nonparametric predictive inference : selection, classification and subcategory dataRebecca M. Baker — 2010
• Predicting variations of perceptual performance across individuals from neural activity using pattern classifiersMichael Murböck — 2010
• On-Line New Event Detection using Single Pass ClusteringRon Papka, James Allan — 1998
• To aggregate or not to aggregate high-dimensional classifiersConnie I Reimers-Hild — 2011
• Modulation of anticipatory postural activity for multiple conditions of a whole-body pointing task.Miguel Pereira Gámez — 2012

Related papers

• Classification and Regression TreesJohn Van Ryzin, Leo Breiman, Jerome H. Friedman — 2000
• Bagging PredictorsLeo Breiman — 1996
• Random ForestsLeo Breiman — 2001
• An introduction to ROC analysisTom Fawcett — 2006
• The Nature of Statistical Learning TheoryVladimir Vapnik — 1995
• LIBSVM: A library for support vector machinesChih-Chung Chang, Chih‐Jen Lin — 2011
• Induction of Decision TreesJ. R. Quinlan — 1986
• Statistical learning theoryYuhai Wu, Vladimir Vapnik — 1998
• Regression Shrinkage and Selection via the LassoRobert Tibshirani — 1996
• The WEKA data mining software: an updateMark Hall, Eibe Frank, Geoffrey Holmes — 2009