Nonparametric Divergence Estimation and its Applications to Machine Learning

Keywords

Bhattacharyya distance, Estimator, Nonparametric statistics, Artificial intelligence, Hellinger distance

References

• Rényi Divergence and Its PropertiesTim van Erven, Peter Harremoës — 2010
• General study of group membership. II. Determination of nearby groups.A. M. Pérez García — 1993
• ESTIMATION OF ENTROPIES AND DIVERGENCES VIA NEAREST NEIGHBORSNikolai Leonenko, Luc Pronzato, Vippal Savani — 2006
• A Test for Normality Based on Sample EntropyOldrich A Vasicek — 1976
• Nonparametric Divergence Estimation with Applications to Machine Learning on DistributionsBarnabás Póczos, Liang Xiong, Jeff Schneider — 2011
• Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IVH. L. Le Roy, Lucien LeCam, Jerzy Neyman — 1969
• Probabilistic Latent Semantic AnalysisThomas Hofmann — 1999
• Empirical estimation of entropy functionals with confidenceKumar Sricharan, Raviv Raich, Alfred O. Hero — 2010
• Independent subspace analysis using geodesic spanning treesBarnabás Póczos, András Lörincz — 2005
• Parametric Bayesian Estimation of Differential Entropy and Relative EntropyMaya R. Gupta, Santosh Kumar Srivastava — 2010
• A class of Rényi information estimators for multidimensional densitiesNikolai Leonenko, Luc Pronzato, Vippal Savani — 2008
• Fractal random walks from a variational formalism for Tsallis entropies.Pablo A. Alemany, Damián H. Zanette — 1994
• A global geometric framework for nonlinear dimensionality reduction.Joshua B. Tenenbaum, Vin de Silva, John Langford — 2000
• Correction: A class of Rényi information estimators for multidimensional densitiesNikolai Leonenko, Luc Pronzato — 2010
• Principal manifolds and nonlinear dimensionality reduction via tangent space alignmentZhenyue Zhang, Hongyuan Zha — 2004
• A new class of random vector entropy estimators and its applications in testing statistical hypothesesM. N. Goria, Nikolai Leonenko, Victor Mergel — 2005
• Causality detection based on information-theoretic approaches in time series analysisKateřina Hlaváčková‐Schindler, Milan Paluš, Martin Vejmelka — 2007
• A nonparametric estimate of a multivariate density functionD. O. Loftsgaarden, Charles P. Quesenberry — 1965
• Nonlinear dimensionality reduction by locally linear embedding.Sam T. Roweis, Lawrence K. Saul — 2000
• Applications of entropic spanning graphsAlfred O. Hero, Bing Ma, Olivier Michel — 2002

Cited by

• Binary code learning via optimal class representationsXiang Zhou, Fumin Shen, Yang Yang — 2016
• Estimating Probability Distributions and their PropertiesShashank Singh — 2020
• Nonparametric Kernel Estimation and Regression on DistributionsV. Singh, Donghan Wang — 2015
• Proposal Estimating Probability Distributions and their PropertiesShashank Singh, B. Póczos — 2018

Related papers

• Nonparametric Different-Feature Selection Using Wasserstein DistanceWenbo Zheng, Fei–Yue Wang, Chao Gou — 2020
• Feature Extraction by Non-Parametric Mutual Information MaximizationKari Torkkola — 2003
• Linear-Time Learning on Distributions with Approximate Kernel EmbeddingsDanica J. Sutherland, Junier B. Oliva, Barnabás Póczos — 2015
• Clustering with Beta DivergencesMehmet Emin Basbug, Barbara E. Engelhardt — 2015
• One-Class Support Measure Machines for Group Anomaly DetectionKrikamol Muandet, Bernhard Schölkopf — 2013
• Kernel-based distribution features for statistical tests and Bayesian inferenceWittawat Jitkrittum — 2017
• Local Component AnalysisNicolas Le Roux, Francis Bach — 2011