Locally Weighted Learning

Summary

The survey discusses distance functions, smoothing parameters, weighting functions, local model structures, regularization of the estimates and bias, assessing predictions, handling noisy data and outliers, improving the quality of predictions by tuning fit parameters, and applications of locally weighted learning.

Keywords

Computer science, Outlier, Weighting, Smoothing, Artificial intelligence

References

A Technique for Automatic Contouring Field Survey DataG. D. Lodwick, J. Whittle — 1971
On the Nonparametric Estimation of Regression FunctionsJacqueline Benedetti — 1977
CABOT: An Adaptive Approach to Case-Based SearchJames P. Callan, Tom Fawcett, Edwina L. Rissland — 1991
Efficient Algorithms with Neural Network BehaviorStephen M. Omohundro — 1987
A VARIABLE SPAN SMOOTHERJerome H. Friedman — 1984
Estimating regression functions and their derivatives by the kernel methodThéo Gasser, Holger Müller — 1984
Multiresolution Instance-Based LearningKan Deng, Andrew Moore — 1995
Scaling Up Average Reward Reinforcement Learning by Approximating the Domain Models and the Value FunctionPrasad Tadepalli, DoKyeong Ok — 1996
Curve and surface fittingPeter Lancaster — 1986
Massively Parallel Memory-Based ParsingHiroaki Kitano, Tetsuya Higuchi — 1991
A study of instance-based algorithms for supervised learning tasks: mathematical, empirical, and psychological evaluationsDavid W. Aha, Dennis Kibler — 1990
Example-Based Machine Translation on Massively Parallel ProcessorsEiichiro Sumita, Kozo Oi, Osamu Furuse — 1993
High Performance Natural Language Processing on Semantic Network Array ProcessorHiroaki Kitano, Dan Moldovan, Seungho Cha — 1991
High Performance Memory-Based Translation on IXM2 Massively Parallel Associative Memory ProcessorHiroaki Kitano, Tetsuya Higuchi — 1991
Function Approximation with Neural Networks and Local Methods: Bias, Variance and SmoothnessSteve Lawrence, Ah Chung Tsoi, Andrew D. Back — 1996
Employing Linear Regression in Regression Tree LeavesAram Karalič — 1992
Kernels for Nonparametric Curve EstimationThéo Gasser, H-G Muller, Volker Mammitzsch — 1985
Quality assurance in air pollution measurementsTodd R. Johnson, S.J. Penkala — 1985
Challenges of massive parallelismHiroaki Kitano — 1993
A Comprehensive and Practical Model of Memory-Based Machine TranslationHiroaki Kitano — 1993

Cited by

A local learning approach to real-time parameter estimation - application to an aircraftLilian Ronceray, M. Jeanneau, D. Alazard — 2007
Programmation dynamique avec approximation de la fonction valeurRémi Munos — 2008
Experience inclusion in iterative learning controllers: Fuzzy model based approachesSubash C.B. Gopinath, Indra Narayan Kar, Rajendra Bhatt — 2008
Qualitatively Faithful Quantitative PredictionDorian Sue, Daniel Vladušič, Ivan Bratko — 2003
CANSS: A Candidate Selection and Search Algorithm to Initialize Car TrackingFrank Dellaert — 2007
Hierarchical reinforcement learning: a hybrid approachMalcolm Ryan — 2004
Iterative RELIEF for Feature Weighting: Algorithms, Theories, and ApplicationsÁngel Jesús Lázaro Martínez, Jesús Asensi Díaz — 2007
A proposed method of local feature-weighting to improve predictions of basic nearest neighbor ruleOmid Dehzangi, Mansoor Zolghadri Jahromi — 2007
Prosodic feature generation for back-channel predictionThamar Solorio, Olac Fuentes, Nigel Ward — 2006
Experience-Based Iterative Learning Controllers for Robotic SystemsMuhammad Arif, Tadashi Ishihara, Hikaru Inooka — 2002
An Applied Comparison of the Prediction Intervals of Common Empirical Modeling StrategiesBrandon Rasmussen, J. Wesley Hines, Andrei Gribok — 2003
How the Selection of Training Patterns can Improve the Generalization Capability in Radial Basis Neural NetworksJosé M. Valls, Inés M. Galván, Pedro Isasi — 2003
Efficient Local Flexible Nearest Neighbor ClassificationCarlotta Domeniconi, Dimitrios Gunopulos — 2002
Predicting polycyclic aromatic hydrocarbon concentrations in soil and water samplesGeoffrey Holmes, Dale Fletcher, Peter Reutemann — 2010
Interpretable machine learning approaches in computational biologySebastian Briesemeister — 2012
Evolving Generalized Euclidean Distances for Training RBNNJosé M. Valls, Ricardo Aler, Oscar Fernández — 2007
Estimating the Time between Twitter Messages and Future EventsAli Hürriyetoğlu, Florian Kunneman, Antal van den Bosch — 2013
Mechanism Design and Analysis Using Simulation-Based Game ModelsMichael P. Wellman, Yevgeniy Vorobeychik — 2008
Processus décisionnels de Markov en intelligence artificielleOlivier Buffet, Olivier Sigaud — 2008
A Taxonomy of Performance Prediction Systems in the Parallel and Distributed Computing GridsSena Seneviratne, David Levy, Rajkumar Buyya — 2013

Related papers

New Internet search volume-based weighting method for integrating various environmental impactsChangyoon Ji, Taehoon Hong — 2016
A study of weighting factors of the quadratic performance indexW. Wakeland — 1969
Extended implied weightingPablo A. Goloboff — 2014
The application of combination weighting approach in multiple attribute decision makingWen Tang, Ai-Zu Chen, Dongmei Li — 2009
Weighting in LCA – approaches and applicationsMagnus Bengtsson, Bengt Steen — 2000
Index weighting methodsZhuying Huang, Jianping Chai, Bo Li — 2017
Using Weighting Adjustments to Compensate for Survey NonresponseGary R. Pike — 2008
Application of Combination Weighting Method to Weight Calculation in Performance Evaluation of ICTChun Lu, Lili Li, Di Wu — 2015
Densely Connected Networks with Smoothed Labels Regularization for Tea Diseases DetectionsDikdik Krisnandi, R. Budiarianto Suryo Kusumo, R. Sandra Yuwana — 2021