A MARKOVIAN FUNCTION OF A MARKOV CHAIN

Keywords

Markov chain, Mathematics, Markov process, Markov chain mixing time, Markov renewal process

References

• Stochastic Models for LearningS. Vajda, Robert R. Bush, Frederick Mosteller — 1956
• Stochastic processesJ. L. Doob, J. L. Doob — 1953
• Stochastic models for learning.Robert R. Bush, Frederick Mosteller — 1955

Cited by

• Spatial birth-and-death Markov processesViktor Bezborodov — 2014
• Markov Chain Aggregation for Agent-Based ModelsSven Banisch — 2015
• Exploring the Relationship Between Learnability and Linguistic UniversalsAnna N. Rafferty, Thomas L. Griffiths, Marc Ettlinger — 2011
• On the Loss of Information Incurred by Lumping States of a Markov ChainBo Henry Lindqvist — 2016
• Models for Evaluating the Performability of Degradable Computing SystemsLiang Wu — 1982
• Equivalence and Reduction of Hidden Markov ModelsVijay Balasubramanian — 1993
• On tractable wireless channel modelsAn Mei Chen, Ramesh R. Rao — 1998
• Markov birth-and-death dynamics of populationsViktor Bezborodov — 2015
• Some problems in stochastic analysis : Itô's formula for convex functions, interacting particle systems and Dyson's Brownian motionNastasiya F. Grinberg — 2011
• Statistical Aspects of Lumpability Hypotheses for Markov Chains.Marlin U. Thomas, Donald R. Barr — 1973
• A Bayesian Approach to Learning Hidden Markov Model Topology with Applications to Biological Sequence AnalysisAlexander Schliep — 2001
• Conditional Markov Chains Part II: Consistency and CopulaeTomasz R. Bielecki, Jacek Jakubowski, Mariusz Niewęgłowski — 2015
• Ancestral branching, cut-and-paste algorithms and associated tree and partition-valued processesHarry Crane — 2011
• Moment closure in a Moran model with recombinationEllen Baake, Thiemo Hustedt — 2011
• Stability Analysis of Jump-Linear Systems Driven by Finite-State Machines with Markovian InputsSudarshan S. Patilkulkarni — 2004
• Time-varying network modelsHarry Crane — 2015
• Coding for Computing Irreducible Markovian Functions of Sources with MemorySheng Huang, Mikael Skoglund — 2013
• On the Rate of Information Loss in Memoryless SystemsBernhard C. Geiger, Gernot Kubin — 2013
• Characterization of bursty channels using Markov modelsS. Srinivas, K. Sam Shanmugan — 1993
• Moments of Solutions of a Class of Stochastic Differential EquationsJ. A. McKenna, J. A. Morrison — 1971

Related papers

• The Research of Markov Chain Application under Two Common Real World ExamplesJing Xun — 2021
• An EM Algorithm for Markov Modulated Markov ProcessesY. Ephraim, William J. Roberts — 2009
• Application of Markov Chains to Analyze and Predict the Time SeriesTie Liu — 2010
• Generalized Markov stability of network communitiesAurelio Patelli, Andrea Gabrielli, Giulio Cimini — 2019