Robust markov decision processes with uncertain transition matrices

Keywords

Markov decision process, Mathematical optimization, Mathematics, Recursion (computer science), Robustness (evolution)

References

• Trajectory-based Air Traffic Management (TB-ATM) under Weather UncertaintyArnab Nilim, Laurent El Ghaoui, Ghaoui Mark — 2001
• Markov decision processes with uncertain transition rates: sensitivity and robust controlSuresh Kalyanasundaram, Edwin K. P. Chong, Ness B. Shroff — 2002
• Handbook of Markov decision processes : methods and applicationsEugene A. Feinberg, Adam Shwartz — 2002
• An Introduction to Signal Detection and EstimationH. Vincent Poor — 1994
• Bounded-parameter Markov decision processesRobert Givan, Sonia M. Leach, Thomas Dean — 2000
• Prior Distributions on Spaces of Probability MeasuresThomas S. Ferguson — 1974
• Testing Statistical Hypothesis.C. F. Crouse, E. L. Lehmann — 1960
• Zero-sum Markov games and worst-case optimal control of queueing systemsEitan Altman, Arie Hordijk — 1995
• Markov Decision Processes with Imprecise Transition ProbabilitiesChelsea C. White, Hany K. El-Deib — 1994
• Minimax analysis of stochastic problemsAlexander Shapiro, Anton J. Kleywegt — 2002
• Perturbation and stability theory for Markov control problemsM. Abbad, Jerzy A. Filar — 1992
• Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingKasra Hazeghi, Martin L. Puterman — 1994
• Theory of point estimationEric R. Ziegel, E. L. Lehmann, George Casella — 1950
• Robust Dynamic ProgrammingGarud Iyengar — 2005
• Algorithms for singularly perturbed limiting average Markov control problemsM. Abbad, Jerzy A. Filar, Tomasz R. Bielecki — 1990
• Convex OptimizationFlorian Jarre, Stephen A. Vavasis — 2010
• Learning Under AmbiguityLarry G. Epstein, Martin Schneider — 2007
• Mathematical StatisticsR. A. F. — 1944
• Algorithms for singularly perturbed limiting average Markov control problemsM. Abbad, Jerzy A. Filar, Tomasz R. Bielecki — 1992
• Markov decision processes with uncertain transition probabilitiesJ. Satia, R. Lave — 1973

Cited by

• Solving Uncertain MDPs by Reusing State Information and PlansPing Hou, William Yeoh, Tran Cao Son — 2014
• Solution Methods for Constrained Markov Decision Process with Continuous Probability ModulationJanusz Marecki, Marek Petrik, Dharmashankar Subramanian — 2013
• Theory and Applications of Robust OptimizationDimitris Bertsimas, David B. Brown, Constantine Caramanis — 2010
• Algorithmic aspects of mean-variance optimization in Markov decision processesShie Mannor, John N. Tsitsiklis — 2013
• Cognitive Radio Network for the Smart Grid: Experimental System Architecture, Control Algorithms, Security, and Microgrid TestbedRobert C. Qiu, Zhen Hu, Zhe Chen — 2011
• Percentile optimization in uncertain Markov decision processes with application to efficient explorationErick Delage, Shie Mannor — 2007
• Bayesian Robustness in the Control of Gene Regulatory NetworksRanadip Pal, Aniruddha Datta, Edward R. Dougherty — 2007
• Reallocations in teams of UAVs using dynamic programming and mixed initiative interactionsElói Pereira, João Borges de Sousa — 2010
• Cooperative control of teams of unmanned air vehiclesElói Pereira — 2009
• Optimal Control of Software Ensuring Safety and FunctionalityArvind Easwaran, Sampath Kannan, Insup Lee — 2005
• GENERATION OF STATIONARY CONTROL POLICIES WITH BEST EXPECTED PERFORMANCE FOR A FAMILY OF MARKOV CHAINSNoah Berlow, Ranadip Pal — 2012
• Robust Intervention in Probabilistic Boolean NetworksRanadip Pal, Aniruddha Datta, Edward R. Dougherty — 2007
• Percentile Optimization for Markov Decision Processes with Parameter UncertaintyErick Delage, Shie Mannor — 2010
• Dynamic Reallocation in Teams of Unmanned Air VehiclesElói Pereira, João Borges de Sousa — 2009
• Proceedings of the Twenty-Eighth AAAI Conference on Artificial IntelligenceGadi Aleksandrowicz, Hana Chockler, Joseph Y. Halpern — 2014
• Privacy-Preserving Policy Synthesis in Markov Decision ProcessesParham Gohari, Matthew Hale, Ufuk Topcu — 2020
• A few lessons learned in reinforcement learning for quadcopter attitude controlNicola Bernini, Mikhail Bessa, Rémi Delmas — 2021
• Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal ContextsNicola Bernini, Mikhail Bessa, Rémi Delmas — 2021
• Deterministic Sequencing of Exploration and Exploitation for Reinforcement LearningPiyush Gupta, Vaibhav Srivastava — 2022
• The Trembling-Hand Problem for LTLf PlanningPian Yu, Shufang Zhu, Giuseppe De Giacomo — 2024

Related papers

• Robust Dynamic ProgrammingGarud Iyengar — 2005
• Dynamic Programming and Optimal ControlDimitri P. Bertsekas — 1995
• Robust Control of Markov Decision Processes with Uncertain Transition MatricesArnab Nilim, Laurent El Ghaoui — 2005
• Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingKasra Hazeghi, Martin L. Puterman — 1994
• Robust Markov Decision Processes using Sigma Point samplingLuca F. Bertuccelli, Jonathan P. How — 2008
• Robust Markov Decision Process: Beyond RectangularityGrand Clement, Julien — 2018
• Approximate Robust Policy Iteration Using Multilayer Perceptron Neural Networks for Discounted Infinite-Horizon Markov Decision Processes With Uncertain Correlated Transition MatricesBaohua Li, Jennie Si — 2010
• Robust MDPs with k-Rectangular UncertaintyShie Mannor, Ofir Mebel, Huan Xu — 2016
• A Robust Approach to Markov Decision Problems with Uncertain Transition ProbabilitiesIoannis Ch. Paschalidis, Seong-Cheol Kang — 2008