Learning to predict by the methods of temporal differences
Explore this paper's citation graph
Summary
This article introduces a class of incremental learning procedures specialized for prediction-that is, for using past experience with an incompletely known system to predict its future behavior, and proves their convergence and optimality for special cases and relate them to supervised-learning methods.
- Type
- article
- Published
- 1988-08-01
- Cited by
- 4,882
- References
- 32
- Access
- Open access
- OpenAlex
- https://openalex.org/W2100677568
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:3349598
Keywords
Temporal difference learning, Computer science, Artificial intelligence, Machine learning, Heuristic
References
- A Unified Theory of Heuristic Evaluation Functions and its Application to Learning
- Learning and problem-solving with multilayer connectionist systems (adaptive, strategy learning, neural networks, reinforcement learning)
- Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems
- A Computer and Communication Network Performance Analysis Primer (Prentice Hall, Englewood Cliffs, NJ, 1985; revised, 1987)
- Intelligent Behavior as an Adaptation to the Task Environment
- Learning by statistical cooperation of self-interested neuron-like computing elements.
- Temporal credit assignment in reinforcement learning
- Dynamic Programming: Models and Applications
- Learning to Predict Sequences
- Neuronlike adaptive elements that can solve difficult learning control problems
- Computers and Thought
- Simulation of the classically conditioned nictitating membrane response by a neuron-like adaptive element: response topography, neuronal firing, and interstimulus intervals.
- Temporal primacy overrides prior training in serial compound conditioning of the rabbit’s nictitating membrane response
- Disjunctive models of Boolean category learning
- Toward a modern theory of adaptive networks: expectation and prediction.
- A Learning Algorithm for Boltzmann Machines
- An Adaptive Optimal Controller for Discrete-Time Markov Environments
- Matrix Iterative Analysis
- Finite Markov chains
- A neuronal model of classical conditioning
Cited by
- Autonomous perceptual feature extraction in a topology-constrained architecture
- Biologically-Inspired Computing Approaches To Cognitive Systems: a partial tour of the literature
- Epistemological Databases for Probabilistic Knowledge Base Construction
- Minimal Residual Approaches for Policy Evaluation in Large Sparse Markov Chains
- Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum.
- Hierarchical reinforcement learning: a hybrid approach
- Least Squares Solutions of the HJB Equation With Neural Network Value-Function Approximators
- Chained learning architectures in a simple closed-loop behavioural context
- Posterior Weighted Reinforcement Learning with State Uncertainty
- Learning where to look for a hidden target
- The Origins and Organization of Vertebrate Pavlovian Conditioning.
- Heuristic Selection of Actions in Multiagent Reinforcement Learning
- Hybridisation of expertise and reinforcement learning in dialogue systems
- Stochastic Enforced Hill-Climbing
- Training a Back-Propagation Network with Temporal Difference Learning and a database for the board game Pente
- Distributed Decision-Making and TaskCoordination in Dynamic, Uncertain andReal-Time Multiagent Environments
- Evolving A Sense Of Valency
- Combining Entropy Based Heuristics and Min-Max Search with Temporal Differences to Play Hidden State Games
- Learning to Play Games from Multiple Imperfect Teachers
- A new Q(lambda) with interim forward view and Monte Carlo equivalence
Related papers
- Study on Sort Mode of Ecotourism Students in University
- Employment: ‘too much, the wrong sort, or none at all’
- A Study on Sort Mode of Law Talented Persons in University
- THE IMPROVEMENT OF SELECTION SORT ALGORITHM
- Research on the Determining Methods of Maintaining Spare Part Sort in Vehicle Equipment Based on the DHGF Theory