Visualizing Data using t-SNE

Summary

A new technique called t-SNE that visualizes high-dimensional data by giving each datapoint a location in a two or three-dimensional map, a variation of Stochastic Neighbor Embedding that is much easier to optimize, and produces significantly better visualizations by reducing the tendency to crowd points together in the center of the map.

Keywords

Isomap, Computer science, Embedding, Visualization, Nonlinear dimensionality reduction

References

The principle of minimized iterations in the solution of the matrix eigenvalue problemWalter E. Arnoldi — 1951
Columbia Object Image Library (COIL100)S.K. Nayar — 1996
Visualizing Similarity Data with a Mixture of MapsJames N. Cook, Ilya Sutskever, Andriy Mnih — 2007
On a Connection between Kernel PCA and Metric Multidimensional ScalingChristopher K. I. Williams — 2004
Jacobi-Davidson Style QR and QZ Algorithms for the Reduction of Matrix PencilsDiederik R. Fokkema, Gérard L. G. Sleijpen, H.A. van der Vorst — 1998
Multidimensional scaling: I. Theory and methodWarren S. Torgerson — 1952
A global geometric framework for nonlinear dimensionality reduction.Joshua B. Tenenbaum, Vin de Silva, John Langford — 2000
Learning a kernel matrix for nonlinear dimensionality reductionKilian Q. Weinberger, Fei Sha, Lawrence K. Saul — 2004
Special issue on diffusion maps and waveletsCharles K. Chui, David L. Donoho — 2006
Nonlinear dimensionality reduction by locally linear embedding.Sam T. Roweis, Lawrence K. Saul — 2000
Nuclear feature extraction for breast tumor diagnosisW. Nick Street, William H. Wolberg, O. L. Mangasarian — 1993
Analysis of a complex of statistical variables into principal components.H. Hotelling — 1933
Learning Deep Architectures for AIYoshua Bengio — 2007
Nonlinear dimensionality reduction of data manifolds with essential loopsJohn A. Lee, Michel Verleysen — 2005
On the Dimensionality of Face SpaceMarsha Meytlis, L. Sirovich — 2007
Diffusion maps, spectral clustering and reaction coordinates of dynamical systemsBoaz Nadler, Stéphane Lafon, Ronald R. Coifman — 2005
From Visual Data Exploration to Visual Data Mining: A SurveyMaria Cristina Ferreira de Oliveira, Haim Levkowitz — 2003
Colored Maximum Variance UnfoldingLe Song, Arthur Gretton, Karsten Borgwardt — 2007
Partially labeled classification with Markov random walksMartin Szummer, Tommi Jaakkola — 2001
Random Walks for Image SegmentationLeo Grady — 2006

Cited by

Sparse representation of dataThomas Villmann, Frank-Michael Schleif, Barbara Hammer — 2010
Manifold Learning for Jointly Modeling Topic and VisualizationTuan M. V. Le, Hady W. Lauw — 2014
Advances in dissimilarity-based data visualisationAndrej Gisbrecht — 2015
On the effect of clustering on quality assessment measures for dimensionality reductionBassam Mokbel, Andrej Gisbrecht, Barbara Hammer — 2010
Mathematical Foundations of the Self Organized Neighbor Embedding (SONE) for Dimension Reduction and VisualizationKerstin Bunte, Sven Haase, Sven Haase — 2011
A unified data representation theory for network visualization, ordering and coarse-grainingФедотенко Инна Леонидовна, Дорошко Ольга Михайловна — 2014
Clinical Outcome Prediction Using Single-Cell DataGiannantonio Bottino, G. Mandrone — 2016
High-dimensional single-cell analysis reveals the immune signature of narcolepsyRadhiana Hassan, Azian Abd. Aziz, Ahmad Rashid Mohd Ralib — 2016
TopicLens: Efficient Multi-Level Visual Topic Exploration of Large-Scale Document CollectionsOlivier Koumba — 2017
Machine learning and computer vision approaches for phenotypic profilingM. M. G. El-Rab, M. R. Mahmoud, P. Baron — 2017
Cross-View Retrieval via Probability-Based Semantics-Preserving HashingZijia Lin, Guiguang Ding, Jungong Han — 2017
A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization圭亮北村, 俊祐横山, 徹徳尾野 — 2018
Generalizing Pooling Functions in CNNs: Mixed, Gated, and TreeReymas Martinus Reinhard Ruimassa — 2018
PhenoGraph and viSNE Facilitate the Identification of Abnormal T-Cell Populations in Routine Clinical Flow Cytometric Data艾玉明 — 2017
Visualizing Big Data Outliers Through Distributed Aggregation輝明遠藤 — 2018
A brief review of single-cell transcriptomic technologies.孝一岡田, 伸也畠山, 誠伊丹 — 2018
Inter-class sparsity based discriminative least square regressionJie Wen, Yong Xu, Yong Xu — 2018
The cis-regulatory dynamics of embryonic development at single cell resolutionJoseph Gianquinto, Marc Cloes — 2017
Single-Cell Deconvolution of Fibroblast Heterogeneity in Mouse Pulmonary FibrosisBogdan Costinescu, Dan Dragomirescu, Antonio Lioy — 2018
EMR-based medical knowledge representation and inference via Markov random fields and distributed representation learningJavier Antem Azpeitia, Laurent Dupeyron — 2017

Related papers

Learning Multiple Layers of Features from Tiny ImagesAlex Krizhevsky — 2024
Efficient Estimation of Word Representations in Vector SpaceTomáš Mikolov, Kai Chen, Greg S. Corrado — 2013
Deep LearningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton — 2015
UMAP: Uniform Manifold Approximation and Projection for Dimension ReductionLeland McInnes, John J. Healy, Melville, James — 2018
GloVe: Global Vectors for Word RepresentationJeffrey Pennington, Richard Socher, Christopher D. Manning — 2014
Deep Residual Learning for Image RecognitionKaiming He, Xiangyu Zhang, Shaoqing Ren — 2015
ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton — 2012
Distributed Representations of Words and Phrases and their CompositionalityTomáš Mikolov, Ilya Sutskever, Kai Chen — 2013
ImageNet Large Scale Visual Recognition ChallengeOlga Russakovsky, Jia Deng, Hao Su — 2014