On the Rate of Information Loss in Memoryless Systems

Keywords

Markov process, Bounded function, Mathematics, Random variable, Kullback–Leibler divergence

References

• Information Theory: 1948-1998 - Guest EditorialSergio Verdú — 1998
• Lumpings of Markov Chains, Entropy Rate Preservation, and Higher-Order LumpabilityBernhard C. Geiger, Christoph Temmel — 2012
• A MARKOVIAN FUNCTION OF A MARKOV CHAINC. J. Burke, M. Rosenblatt — 1958
• Entropy invariance for autoregressive processes constructed by linear filteringMonica Dumitrescu, Georgiana Popovici — 2011
• Rényi Information Dimension: Fundamental Limits of Almost Lossless Analog CompressionYihong Wu, Sergio Verdú — 2010
• Entropy of the Mixture of Sources and Entropy DimensionMarek Śmieja, Jacek Tabor — 2011
• On the dimension and entropy of probability distributionsA. Rényi — 1959
• Loss and Recovery of Information by Coarse Observation of Stochastic ChainSatosi Watanabé, C.T. Abraham — 1960
• Probability, random variables and stochastic processesJ.G. Proakis — 1985
• Some results on the information loss in dynamical systemsBernhard C. Geiger, Gernot Kubin — 2011
• Information and information stability of random variables and processesD. Brillinger, M. Pinsker, A. Feinstein — 1964
• A useful theorem for nonlinear devices having Gaussian inputsRobert M. Price — 1958
• Information Measures for Deterministic Input-Output SystemsBernhard C. Geiger, Gernot Kubin — 2013
• Lumpings of Markov chains and entropy rate lossBernhard C. Geiger, Christoph Temmel — 2012
• FINITE MARKOV CHAINSB. Nordstrom — 2005
• Discrete Time Signal ProcessingB. Champagne, F. Labeau — 2004
• Functions of a Markov Process that are MarkovianR. Davis, K. Lii, D. Politis — 2011
• Lumpings of Markov chains, entropy rate preservation, and higher-order lumpabilityGeiger, Bernhard C., Temmel, Christoph — 2014

Cited by

• On the Mutual Information of Multi-hop Acoustic Sensors Network in Underwater Wireless CommunicationRaju Shrestha — 2014
• Information-Theoretic Analysis of Memoryless Deterministic SystemsBernhard C. Geiger, Gernot Kubin — 2016
• On the Performance of the Underwater Acoustic Sensor NetworksMahmoud Elsayed — 2015

Related papers

• On relationship between loss probability and utilization factor on real-time basisMikihiko Nishiara — 2008
• Exact and approximate analysis of ATM cell loss correlationJih-Liang Tseng, John F. Meyer — 1996
• A Probably Approximately Correct Answer to Distributed Stochastic Optimization in a Non-stationary EnvironmentB. N. Bharath, P. Vaishali — 2016
• The value of timing information in event-triggered control: The scalar caseMohammad Javad Khojasteh, Pavankumar Tallapragada, Jorge Cortés — 2016
• ON/OFF STORAGE SYSTEMS WITH STATE-DEPENDENT INPUT, OUTPUT, AND SWITCHING RATESOnno Boxma, Haya Kaspi, Offer Kella — 2005
• Effective bandwidths for a class of non Markovian fluid sourcesKimon Kontovasilis, Nikolas Mitrou — 1997
• Tracking of real-valued Markovian random processes with asymmetric cost and observationParisa Mansourifard, Bhaskar Krishnamachari, Tara Javidi — 2015
• Optimal infinite horizon control under a low data rate.Girish N. Nair, Minyi Huang, Robin J. Evans — 2006
• Large Deviations for Large Capacity Loss Networks with Fixed Routing and Polyhedral Admission SetsCheng‐Shang Chang, Hung‐Jen Wang — 1997
• Parameters of Discrete Time Models of Detection of ChangeAmnon Rapoport, Graham J. Burkheimer — 1973