Neural Network Ensembles

Summary

It is shown that the remaining residual generalization error can be reduced by invoking ensembles of similar networks, which helps improve the performance and training of neural networks for classification.

Keywords

Artificial intelligence, Artificial neural network, Computer science, Generalization, Residual

References

Protein secondary structure and homology by neural networks The α‐helices in rhodopsinHenrik Bohr, J. Bohr, Søren Brunak — 1988
Bibliography on estimation of misclassificationGodfried Toussaint — 1974
A Theoretical Basis for the Analysis of Multiversion Software Subject to Coincident ErrorsD.E. Eckhardt, L.D. Lee — 1985
Generalization of back-propagation to recurrent neural networks.Fernando J. Pineda — 1987
Molecular-dynamics study of a three-dimensional one-component model for distortive phase transitionsT. Schneider, E. Stoll — 1978
Optimization by Simulated AnnealingScott Kirkpatrick, C. D. Gelatt, M.P. Vecchi — 1983
An introduction to computing with neural netsRichard P. Lippmann — 1987
A Learning Algorithm for Boltzmann MachinesDavid H. Ackley, Geoffrey E. Hinton, Terrence J. Sejnowski — 1985
Neural nets for adaptive filtering and adaptive pattern recognitionBernard Widrow, Robin Winter — 1988
Predicting the secondary structure of globular proteins using neural network models.Ning Qian, Terrence J. Sejnowski — 1988
Principles of neurodynamicsAlexander Mullin, Frank F. Rosenblatt — 1962
Learning internal representations by error propagationDavid E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams — 1986
Introduction to Combinatorial AnalysisR. A. Leibler, John Riordan — 1958
A statistical approach to learning and generalization in layered neural networksEsther Levin, Naftali Tishby, Sara A. Solla — 1989
Parallel Networks that Learn to Pronounce English TextTerrence J. Sejnowski — 1987
An Introduction to Combinatorial AnalysisJohn R. Riordan — 1980
An introduction to computing with neural netsRichard P. Lippmann — 1987
Broken ergodicityR. G. Palmer — 1982

Cited by

Algorithms and Applications for Land Cover Classification – A ReviewBjörn Waske, Mingmin Chi, Jón Atli Benediktsson — 2010
Dynamic classifier ensemble using classification confidenceLeijun Li, Bo Zou, Qinghua Hu — 2013
Ensemble neural classifier design for face recognitionTerry Windeatt — 2007
Combined approach to pattern classification in parametric caseMichał Woźniak — 2007
An empirical investigation of tree ensembles in biometrics and bioinformatics researchYan Ma — 2007
Modeling Mobile User Behavior for Anomaly DetectionSenaka Buthpitiya — 2014
Neural networks for automatic speech recognition: a reviewJean‐Paul Haton — 1999
CLASSIFYING MUSIC BY GENRE USING A DISCRETE WAVELET TRANSFORM AND A ROUND-ROBIN ENSEMBLEMarco Grimaldi, Anil Kokaram, Pádraig Cunningham — 2003
VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas SegmentationRafael Jordá García — 2019
Self-organizing map and multilayer perceptron for malay speech recognitionKia Eng Goh — 2006
Ensembles as a Sequence of ClassifiersLars Asker, Richard Maclin — 1997
Methods for knowledge discovery in dataSantiago Patricio Serendero Sáez — 2004
Méthodes statistiques pour l'évaluation et la reconfiguration des réseaux de suivi de la qualité de l'eau de surface.Bahaa Khalil — 2010
Learning from cooperation using justificationsEloi Puertas, Eva Armengol — 2006
Topic-Specific Optimization and Structuring.David A. Evans, James G. Shanahan, Tong Xiang — 2001
Change-point detection with supervised learning and feature selectionVictor Eruhimov, Vladimir Martyanov, Eugene Tuv — 2007
Predictive Techniques and Methods for Decision Support in Situations with Poor Data QualityRikard König — 2009
Neural Networks and Cellular Automata ComplexityJan Gorodkin, August Sørensen, Ole Winther — 1993
Combining the Predictions of Multiple Classifiers: Using Competitive Learning to Initialize Neural NetworksRichard Maclin, Jude Shavlik — 1995
Meta-Induction and the Wisdom of CrowdsPaul D. Thorn, Gerhard Schurz — 2012

Related papers

Physician-Friendly Machine Learning: A Case Study with Cardiovascular Disease Risk PredictionMeghana Padmanabhan, Pengyu Yuan, Govind Chada — 2019
Breakdown of Machine Learning AlgorithmsMunesh Meena, Ruchi Sehrawat — 2022
A Machine Learning Tutorial for Operational Meteorology, Part I: Traditional Machine LearningRandy J. Chase, David Harrison, Amanda Burke — 2022
An improved model training method for residual convolutional neural networks in deep learningXuelei Li, Rengang Li, Yaqian Zhao — 2020
Generalization Step Analysis for Privacy Preserving Data PublishingLV Pin, Yuntao Wu — 2010
A Review on Machine Learning & It’s AlgorithmsNipun Jain, Rajeev Kumar — 2022
Introduction to supervised machine learning in clinical epidemiologySachiko Ono, Tadahiro Goto — 2022
Application of Machine Learning in Animal Disease Analysis and PredictionShuwen Zhang, Qiang Su, Qin Chen — 2020
Artificial Intelligence, Machine Learning, and Medicine: A Little Background Goes a Long Way Toward Understanding.Mark P. Cote, James H. Lubowitz, Jefferson C. Brand — 2021