Near-Optimal Controls of Discrete-Time Dynamic Systems Driven by Singularly-Perturbed Markov Chains

Keywords

Markov chain, Discrete time and continuous time, Theory of computation, Limit (mathematics), Optimal control

References

• Theory of Suboptimal Decisions: Decomposition and AggregationA. A. Pervozvanskiĭ, V. G. Gaitsgori — 1988
• Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering ProblemsHarold J. Kushner — 1990
• Singular perturbation methods in control : analysis and designP.V. Kokotović, Hassan K. Khalil, J. O’Reilly — 1986
• Stochastic Controls: Hamiltonian Systems and HJB EquationsJiongmin Yong, Xun Yu Zhou — 1999
• Continuous-Time Markov Chains and Applications: A Singular Perturbation ApproachRobert L. Strawderman, George G. Yin, Qing Zhang — 1997
• Ordinary Differential Equations.Ray Redheffer, Jack K. Hale — 1971
• Asymptotic Optimization of a Nonlinear Hybrid System Governed by a Markov Decision ProcessEitan Altman, Vladimir Gaitsgory — 1997
• Ergodic Control of a Singularly Perturbed Markov Process in Discrete Time with General State and Compact Action SpacesTomasz R. Bielecki — 1998
• Singularly Perturbed Discrete-Time Markov ChainsGeorge Yin, Q. Zhang — 2000
• Relaxed variational problemsJ. Warga — 1962
• On asymptotic optimization of a class of nonlinear stochastic hybrid systemsPeng Shi, Eitan Altman, Vladimir Gaitsgory — 1998
• Singularly perturbed difference equations in optimal control problemsG. L. Blankenship — 1981
• Nearly optimal state feedback controls for stochastic systems with wideband noise disturbancesHarold J. Kushner, Wolfgang Runggaldier — 1987
• Approximation and Weak Convergence Methods for Random ProcessesIoannis Karatzas, Harold J. Kushner — 1984
• Theory of linear operators in Hilbert spaceН. И. Ахиезер, I. M. Glazman — 1961
• Statistical Multiplexing of Multiple Time-Scale Markov StreamsDavid Tse, Robert G. Gallager, John N. Tsitsiklis — 1995
• Markov Processes: Characterization and ConvergenceAndris Abakuks, S. N. Ethier, Thomas G. Kurtz — 2005
• Continuous-Time Markov Chains and ApplicationsG. George Yin, Zhang Qing — 1998
• Aggregation of Variables in Dynamic SystemsHerbert A. Simon, Albert Ando — 1961
• Stochastic ControlsJiongmin Yong, Xun Zhou — 1999

Cited by

• Hybrid Stochastic Systems: Numerical Methods, Limit Results, And ControlsTuan Anh Hoang — 2017
• Discrete singularly perturbed control problems (A survey)Г. А. Курина, Mikhail Dmitriev, D. Subbaram Naidu — 2017
• Asymptotic Properties and Associated Control Problems of Discrete-Time Singularly Perturbed Markov ChainsG. Badowski, G. Yin, Q. Zhang — 2002
• Discrete-time Singularly Perturbed Markov ChainsG. Yin, Qing Zhang — 2003
• SINGULAR PERTURBATIONS AND TIME SCALES IN CONTROL THEORIES AND APPLICATIONS: AN OVERVIEW 2002-2012Yan Zhang, D. Naidu, Chenxiao Cai — 2011

Related papers

• The Optimal Control Model on Dynamic Input-OutputGuozhi Liu — 2002
• Characterization of constant policies in optimal controlMorton I. Kamien, Eitan Muller — 1986
• Approximate dynamic programming methods applied to far trajectory planning in optimal controlHans-Georg Wahl, Marc Holzäpfel, Frank Gauterin — 2014
• Computational Control of an HIV ModelC. Myburgh, K. H. Wong — 2005
• Dissipativity in Infinite Horizon Optimal Control and Dynamic ProgrammingDavid Angeli, Lars Grüne — 2023
• Optimal control of oscillatory systems by iterative dynamic programmingRein Luus — 2008
• Comparative Study of Dynamic Programming and Pontryagin’s Minimum Principle on Energy Management for a Parallel Hybrid Electric VehicleYuan Zou, Teng Liu, Sun Fengchun — 2013