Graph partitioning techniques for Markov Decision Processes decomposition

Keywords

Computer science, Decomposition, Markov decision process, Graph partition, Graph

References

• Decomposition Techniques for Planning in Stochastic DomainsThomas Dean, Shieu‐Hong Lin — 1995
• Introduction to Reinforcement LearningRichard S. Sutton, Andrew G. Barto — 1998
• Hierarchical Solution of Markov Decision Processes using Macro-actionsMiloš Hauskrecht, Nicolas Meuleau, Leslie Pack Kaelbling — 1998
• An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel ComputationsBruce Hendrickson, Robert W. Leland — 1995
• Value-function reinforcement learning in Markov gamesMichael L. Littman — 2001
• Decomposition of systems governed by Markov chainsHarold J. Kushner, C. Chen — 1974
• Stochastic dynamic programming with factored representationsCraig Boutilier, Richard Dearden, Moisés Goldszmidt — 2000
• Abstraction and Approximate Decision-Theoretic PlanningRichard Dearden, Craig Boutilier — 1997
• Decision-Theoretic Planning: Structural Assumptions and Computational LeverageCraig Boutilier, Taraneh Dean, Steve Hanks — 1999
• PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS*Alex Pothen, Horst D. Simon, K. N. Liou — 1990
• Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingKasra Hazeghi, Martin L. Puterman — 1994
• An efficient heuristic procedure for partitioning graphsBrian W. Kernighan, Shang Min Lin — 1970
• Flexible Decomposition Algorithms for Weakly Coupled Markov Decision ProblemsRonald Parr — 1998
• Dynamic ProgrammingÖzkan Ufuk Nalbantoğlu — 2018
• Theoretical Results on Reinforcement Learning with Temporally Abstract OptionsDoina Precup, R. Sutton, Satinder Singh — 1998

Cited by

• Map partitioning to approximate an exploration strategy in mobile roboticsGuillaume Lozenguez, Lounis Adouane, Aurélie Beynier — 2011
• Influence of modeling structure in probabilistic sequential decision problemsFlorent Teichteil-Königsbuch, Patrick Fabiani — 2006
• Designing Effective Policies for Minimal AgentsK. Broda, C. J. Hogger — 2010
• Planning large systems with MDPs: case study of inland waterways supervisionGuillaume Desquesnes, Guillaume Lozenguez, Arnaud Doniec — 2016
• Vers une distribution des MDP à grande échelle : étude de cas des voies navigablesGuillaume Desquesnes, Guillaume Lozendes, Arnaud Doniec — 2016
• Résolution approchée par décomposition de processus décisionnels de Markov appliquée à l'exploration en robotique mobileGuillaume Lozenguez, Lounis Adouane, Aurélie Beynier — 2013
• Problèmes décisionnels de Markov temporels : formalisation et résolutionEmmanuel Rachelson — 2009
• Temporal Markov Decision Problems : Formalization and ResolutionEmmanuel Rachelson — 2009
• MDP à grande échelle : étude de cas des voies navigablesGuillaume Desquesnes, Guillaume Lozenguez, Arnaud Doniec — 2016
• Draft : Dealing with Large MDPs ,Arnaud Doniec — 2018
• Autonomous Search and Rescue Rotorcraft Mission Stochastic Planning with Generic DBNsF. Teichteil-Königsbuch, P. Fabiani — 2006
• Dealing with Large MDPs, Case Study of Waterway Networks SupervisionG. Desquesnes, G. Lozenguez, Arnaud Doniec — 2016

Related papers

• Flexible Decomposition Algorithms for Weakly Coupled Markov Decision ProblemsRonald Parr — 1998
• Influence of modeling structure in probabilistic sequential decision problemsFlorent Teichteil-Königsbuch, Patrick Fabiani — 2006
• Efficient solution of Markov decision problems with multiscale representationsJake Bouvrie, Mauro Maggioni — 2012
• A simulation-based learning automata framework for solving semi-Markov decision problems under long-run average rewardAbhijit Gosavi, Tapas K. Das, Sudeep Sarkar — 2004
• Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingMartin L. Puterman — 1994
• Decision-Theoretic Planning: Structural Assumptions and Computational LeverageCraig Boutilier, Taraneh Dean, Steve Hanks — 1999
• Solving Concurrent Markov Decision ProcessesDaniel S. Weld — 2004
• Path-Constrained Markov Decision Processes: bridging the gap between probabilistic model-checking and decision-theoretic planningFlorent Teichteil-Königsbuch — 2012