Type 1 and 2 mixtures of Kullback-Leibler divergences as cost functions in dimensionality reduction based on similarity preservation

Keywords

Softmax function, Kullback–Leibler divergence, Embedding, Dimensionality reduction, Divergence (linguistics)

References

• Columbia Object Image Library (COIL100)S.K. Nayar — 1996
• Curvilinear Distance Analysis versus IsomapJohn A. Lee, Amaury Lendasse, Michel Verleysen — 2002
• A kernel view of the dimensionality reduction of manifoldsJihun Ham, Daniel D. Lee, Sebastian Mika — 2004
• Algorithms for Drawing Graphs: an Annotated BibliographyGiuseppe Di Battista, Peter Eades, Roberto Tamassia — 1988
• Multidimensional scaling: I. Theory and methodWarren S. Torgerson — 1952
• Quality assessment of dimensionality reduction: Rank-based criteriaJohn A. Lee, Michel Verleysen — 2009
• Some distance properties of latent root and vector methods used in multivariate analysisJ. C. Gower — 1966
• A global geometric framework for nonlinear dimensionality reduction.Joshua B. Tenenbaum, Vin de Silva, John Langford — 2000
• Local multidimensional scalingJarkko Venna, Samuel Kaski — 2006
• Generalized Alpha-Beta Divergences and Their Application to Robust Nonnegative Matrix FactorizationAndrzej Cichocki, Sergio Cruces, Шун-ичи Амари — 2011
• Nonlinear dimensionality reduction by locally linear embedding.Sam T. Roweis, Lawrence K. Saul — 2000
• Discussion of a set of points in terms of their mutual distancesGale Young, A. S. Householder — 1938
• Modern Multidimensional Scaling: Theory and ApplicationsIngwer Borg, P.A.P. Groenen — 1999
• On the convexity of some divergence measures based on entropy functionsJacob Burbea, C. Radhakrishna Rao — 1982
• Analysis of a complex of statistical variables into principal components.H. Hotelling — 1933
• Scale-independent quality criteria for dimensionality reductionJohn A. Lee, Michel Verleysen — 2010
• Correlation-maximizing surrogate gene space for visual mining of gene expression patterns in developing barley endosperm tissueMarc Strickert, Nese Sreenivasulu, Björn Usadel — 2007
• Gradient-based learning applied to document recognitionYann LeCun, Léon Bottou, Yoshua Bengio — 1998
• Stochastic neighbor embedding (SNE) for dimension reduction and visualization using arbitrary divergencesKerstin Bunte, Sven Haase, Michael Biehl — 2012
• Nonlinear projection with curvilinear distances: Isomap versus curvilinear distance analysisJohn A. Lee, Amaury Lendasse, Michel Verleysen — 2004

Cited by

• Advances in dissimilarity-based data visualisationAndrej Gisbrecht — 2015
• A visual framework to accelerate knowledge discovery based on dimensionality reduction minimizing degradation of qualityAntonio Gracia Berná — 2014
• Discriminative dimensionality reduction for regression problems using the Fisher metricAlexander Schulz, Barbara Hammer — 2015
• Data visualization via latent variables and mixture models: a brief surveyRodolphe Priam, Mohamed Nadif — 2016
• Metric Learning in Dimensionality ReductionAlexander Schulz, Barbara Hammer — 2015
• From one graph to many: Ensemble transduction for content-based database retrievalJim Jing-Yan Wang, Yijun Sun — 2014
• Analysis of Electricity Bill Data using Interactive Dimensionality ReductionSerafí­n Alonso, Miguel A. Prada, Juan J. Fuertes — 2015
• Multi-scale similarities in stochastic neighbour embedding: Reducing dimensionality while preserving both local and global structureJohn A. Lee, Diego H. Peluffo-Ordóńez, Michel Verleysen — 2015
• Correlation-based embedding of pairwise score dataMarc Strickert, Kerstin Bunte, Frank-Michael Schleif — 2014
• Generalized kernel framework for unsupervised spectral methods of dimensionality reductionDiego H. Peluffo-Ordóńez, John A. Lee, Michel Verleysen — 2014
• A methodology to compare Dimensionality Reduction algorithms in terms of loss of qualityAntonio Gracia, Santiago González, Vı́ctor Robles — 2014
• Data visualization by nonlinear dimensionality reductionAndrej Gisbrecht, Barbara Hammer — 2015
• Interactive interface for efficient data visualization via a geometric approachJ. A. Salazar-Castro, Y. C. Rosas-Narvaez, Andrés Pantoja — 2015
• Dimensionality Reduction by Supervised Neighbor Embedding Using Laplacian SearchJianwei Zheng, Hangke Zhang, Carlo Cattani — 2014
• Vector Quantization by Minimizing Kullback-Leibler DivergenceLan Yang, Jingbin Wang, Yujin Tu — 2015
• Towards Dimensionality Reduction for Smart Home Sensor DataBassam Mokbel, Alexander Schulz — 2015
• Recent methods for dimensionality reduction: A brief comparative analysisDiego H. Peluffo-Ordóńez, John A. Lee, Michel Verleysen — 2014
• Human-centered machine learning through interactive visualizationDominik Sacha, Michael Sedlmair, Leishi Zhang — 2016
• Unsupervised dimensionality reduction: the challenge of big data visualizationKerstin Bunte, John A. Lee — 2015
• Geometrical homotopy for data visualizationDiego H. Peluffo-Ordóńez, Juan Carlos Alvarado‐Pérez, John A. Lee — 2015

Related papers

• Improved deep face identification with multi-class pairwise discriminant lossJae Young Choi — 2017
• Deep CNN ensemble for recognition of face imagesRobert Szmurło, S. Osowski — 2021
• Multiscale stochastic neighbor embedding: Towards parameter-free dimensionality reductionJohn A. Lee, Diego H. Peluffo-Ordóńez, Michel Verleysen — 2014
• High-Dimensional Multimodal Distribution EmbeddingEnikő Székely, Éric Bruno, Stéphane Marchand‐Maillet — 2010
• Shift-invariant similarities circumvent distance concentration in stochastic neighbor embedding and variantsJohn A. Lee, Michel Verleysen — 2011
• Lung Nodule Classification Using Supervised Manifold Learning Based on All-Class and Pairwise-Class Feature ExtractionQian Yu — 2012
• Exploratory Observation Machine (XOM) with Kullback-Leibler Divergence for Dimensionality Reduction and VisualizationKerstin Bunte, Barbara Hammer, Thomas Villmann — 2010